Sep 15 18:50:24.957068 ip-10-0-129-252 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 18:50:25.350079 ip-10-0-129-252 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 18:50:25.350079 ip-10-0-129-252 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 18:50:25.350079 ip-10-0-129-252 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 18:50:25.350079 ip-10-0-129-252 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 18:50:25.350079 ip-10-0-129-252 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 18:50:25.352880 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.352788    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 18:50:25.356837 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356823    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 18:50:25.356837 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356837    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356841    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356844    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356852    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356873    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356878    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356882    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356885    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356887    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356890    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356893    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356895    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356898    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356901    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356904    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 18:50:25.356900 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356907    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356910    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356913    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356915    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356918    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356921    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356923    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356926    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356928    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356931    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356934    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356936    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356939    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356941    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356944    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356946    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356951    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356954    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356957    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356960    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 18:50:25.357303 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356964    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356967    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356969    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356972    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356976    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356978    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356981    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356983    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356986    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356988    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356990    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356993    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356995    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.356998    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357001    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357004    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357007    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357010    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357012    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357015    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 18:50:25.358085 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357017    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357020    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357023    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357025    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357029    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357033    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357035    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357038    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357041    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357044    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357046    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357049    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357052    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357055    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357057    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357060    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357063    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357066    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357068    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357071    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 18:50:25.358583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357073    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357077    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357080    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357083    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357087    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357090    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357092    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357095    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357098    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357100    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357103    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357105    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357108    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357111    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357114    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357116    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357119    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357122    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357125    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357128    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 18:50:25.359090 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357130    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 18:50:25.359572 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357133    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 18:50:25.359572 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.357135    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 18:50:25.361375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361355    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 18:50:25.361375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361375    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361379    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361383    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361386    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361389    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361394    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361398    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361401    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361404    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361407    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361410    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361413    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361416    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361418    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361421    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361424    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361428    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361431    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361434    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 18:50:25.361436 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361438    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361441    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361444    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361447    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361450    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361452    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361458    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361460    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361463    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361466    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361468    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361471    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361473    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361476    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361479    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361481    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361484    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361486    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361489    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361493    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 18:50:25.361961 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361496    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361499    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361502    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361505    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361508    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361510    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361513    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361515    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361518    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361520    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361524    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361526    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361529    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361532    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361535    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361538    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361541    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361543    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361546    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 18:50:25.362456 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361549    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361551    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361554    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361556    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361559    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361561    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361565    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361567    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361570    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361573    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361576    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361579    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361582    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361584    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361587    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361589    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361592    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361594    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361597    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361600    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361602    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 18:50:25.362940 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361605    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361607    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361610    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361613    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361617    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361619    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361624    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361626    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361629    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361632    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361635    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361638    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361640    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361643    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361645    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361648    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361650    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361653    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.361656    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 18:50:25.363449 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362021    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362026    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362029    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362032    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362035    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362038    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362041    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362044    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362047    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362049    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362052    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362054    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362057    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362061    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362065    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362068    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362071    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362074    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362078    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 18:50:25.363932 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362080    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362083    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362086    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362088    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362091    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362094    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362096    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362099    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362101    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362104    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362106    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362109    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362111    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362114    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362117    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362120    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362122    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362124    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362127    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362129    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 18:50:25.364403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362132    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362135    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362138    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362141    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362144    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362146    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362149    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362151    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362154    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362156    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362160    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362164    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362166    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362169    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362171    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362174    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362177    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362179    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362181    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362184    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 18:50:25.364890 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362187    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362189    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362192    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362194    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362197    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362199    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362202    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362204    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362207    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362209    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362212    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362214    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362217    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362219    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362222    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362224    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362227    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362231    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362233    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362236    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 18:50:25.365375 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362238    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362240    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362244    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362247    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362250    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362253    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362255    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362258    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362260    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362263    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362266    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362268    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362271    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362275    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362278    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362281    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362284    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362287    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362290    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 18:50:25.365872 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.362293    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362368    2572 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362410    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362417    2572 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362421    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362425    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362428    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362432    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362436    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362439    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362442    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362446    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362450    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362453    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362457    2572 flags.go:64] FLAG: --cgroup-root=""
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362460    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362464    2572 flags.go:64] FLAG: --client-ca-file=""
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362468    2572 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362471    2572 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362476    2572 flags.go:64] FLAG: --cluster-domain=""
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362479    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362482    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362485    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362489    2572 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 18:50:25.366325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362492    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362496    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362499    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362502    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362505    2572 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362508    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362511    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362514    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362517    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362520    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362524    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362527    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362530    2572 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362533    2572 flags.go:64] FLAG: --enable-server="true"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362536    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362540    2572 flags.go:64] FLAG: --event-burst="100"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362543    2572 flags.go:64] FLAG: --event-qps="50"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362546    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362548    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362551    2572 flags.go:64] FLAG: --eviction-hard=""
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362555    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362558    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362561    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362564    2572 flags.go:64] FLAG: --eviction-soft=""
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362568    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 18:50:25.366921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362571    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362574    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362577    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362580    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362583    2572 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362586    2572 flags.go:64] FLAG: --feature-gates=""
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362590    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362593    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362596    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362599    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362602    2572 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362605    2572 flags.go:64] FLAG: --help="false"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362608    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362611    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362614    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362617    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362620    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362623    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362626    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362629    2572 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362632    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362635    2572 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362638    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362641    2572 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 18:50:25.367576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362644    2572 flags.go:64] FLAG: --kube-reserved=""
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362647    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362650    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362653    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362656    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362659    2572 flags.go:64] FLAG: --lock-file=""
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362662    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362664    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362667    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362673    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362676    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362679    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362682    2572 flags.go:64] FLAG: --logging-format="text"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362685    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362688    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362691    2572 flags.go:64] FLAG: --manifest-url=""
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362694    2572 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362698    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362701    2572 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362705    2572 flags.go:64] FLAG: --max-pods="110"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362712    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362715    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362718    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362720    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362723    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 18:50:25.368186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362726    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362729    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362736    2572 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362739    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362742    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362745    2572 flags.go:64] FLAG: --pod-cidr=""
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362748    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362755    2572 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362758    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362761    2572 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362765    2572 flags.go:64] FLAG: --port="10250"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362768    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362771    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0991a91473124178c"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362774    2572 flags.go:64] FLAG: --qos-reserved=""
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362777    2572 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362780    2572 flags.go:64] FLAG: --register-node="true"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362783    2572 flags.go:64] FLAG: --register-with-taints=""
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362787    2572 flags.go:64] FLAG: --registry-burst="10"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362790    2572 flags.go:64] FLAG: --registry-qps="5"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362793    2572 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362796    2572 flags.go:64] FLAG: --reserved-memory=""
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362799    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362817    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362823    2572 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362828    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 18:50:25.368796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362831    2572 flags.go:64] FLAG: --runonce="false"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362834    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362837    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362841    2572 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362844    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362846    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362849    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362860    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362864    2572 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362866    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362869    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362873    2572 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362875    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362879    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362882    2572 flags.go:64] FLAG: --system-cgroups=""
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362885    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362891    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362894    2572 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362896    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362901    2572 flags.go:64] FLAG: --tls-min-version=""
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362904    2572 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362907    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362910    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362913    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362916    2572 flags.go:64] FLAG: --v="2"
Sep 15 18:50:25.369421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362920    2572 flags.go:64] FLAG: --version="false"
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362924    2572 flags.go:64] FLAG: --vmodule=""
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362927    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.362931    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363048    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363052    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363055    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363058    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363061    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363064    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363066    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363069    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363072    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363074    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363077    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363080    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363082    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363085    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363088    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363090    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363093    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 18:50:25.370030 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363096    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363099    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363101    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363104    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363106    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363109    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363112    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363115    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363117    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363120    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363122    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363125    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363128    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363130    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363133    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363136    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363138    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363141    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363143    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363146    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 18:50:25.370570 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363148    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363151    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363154    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363156    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363158    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363161    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363164    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363166    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363169    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363171    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363174    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363176    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363181    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363184    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363186    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363189    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363192    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363196    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363201    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 18:50:25.371068 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363204    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363208    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363211    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363215    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363218    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363221    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363224    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363227    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363230    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363233    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363235    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363238    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363241    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363243    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363246    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363249    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363251    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363254    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363256    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 18:50:25.371547 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363259    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363262    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363264    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363267    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363271    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363274    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363278    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363280    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363283    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363286    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363288    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363291    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363293    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363296    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363298    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363301    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363304    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363306    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363309    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363312    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 18:50:25.372019 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363314    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363318    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363321    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.363323    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.364625    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.372136    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.372151    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.372169    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.372175    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372240    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372244    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372248    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372251    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372254    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 18:50:25.372510 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372256    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372259    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372263    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372268    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372271    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372274    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372278    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372282    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372285    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372288    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372291    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372294    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372298    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372302    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372306    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372309    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372312    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372315    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 18:50:25.372953 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372318    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372321    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372324    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372327    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372329    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372332    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372336    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372339    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372342    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372345    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372347    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372350    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372353    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372355    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372358    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372361    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372364    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372366    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372369    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372371    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 18:50:25.373384 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372374    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372377    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372379    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372382    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372384    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372387    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372390    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372393    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372395    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372398    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372400    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372403    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372406    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372408    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372411    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372413    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372416    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372418    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372421    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372425    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 18:50:25.373894 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372428    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372430    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372433    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372436    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372438    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372441    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372443    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372446    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372449    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372451    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372454    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372456    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372459    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372462    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372464    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372467    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372469    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372472    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372475    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372478    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 18:50:25.374410 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372481    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372483    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372486    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372489    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372491    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372494    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372496    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372499    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372502    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372505    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372508    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372511    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372515    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372518    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372520    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 18:50:25.374968 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372523    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.372528    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372645    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372650    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372653    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372656    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372659    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372662    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372664    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372667    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372670    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372672    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372675    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372677    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372680    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 18:50:25.375330 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372683    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372685    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372688    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372691    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372693    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372696    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372699    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372701    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372703    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372706    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372709    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372711    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372714    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372717    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372719    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372723    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372725    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372728    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372731    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372733    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 18:50:25.375706 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372736    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372738    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372741    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372744    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372747    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372749    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372752    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372754    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372757    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372760    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372762    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372765    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372768    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372771    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372774    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372777    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372779    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372783    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372785    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372788    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 18:50:25.376206 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372790    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372793    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372796    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372798    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372801    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372819    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372822    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372825    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372828    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372831    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372833    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372836    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372838    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372842    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372846    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372849    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372852    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372855    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372859    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372863    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 18:50:25.376685 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372866    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372869    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372871    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372874    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372877    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372879    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372882    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372884    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372887    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372890    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372892    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372895    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372897    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372900    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372902    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372905    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372907    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372910    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372913    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 18:50:25.377178 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372915    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372918    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372921    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372923    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372926    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372929    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:25.372933    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.372937    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.373034    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.375491    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.376548    2572 server.go:1019] "Starting client certificate rotation"
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.376644    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 18:50:25.377625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.376709    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 18:50:25.379422 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.379408    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 18:50:25.384669 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.383664    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 18:50:25.399486 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.399469    2572 log.go:25] "Validated CRI v1 runtime API"
Sep 15 18:50:25.403510 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.403495    2572 log.go:25] "Validated CRI v1 image API"
Sep 15 18:50:25.404316 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.404302    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 18:50:25.410430 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.410412    2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8bfa1bba-ba6c-4e0c-9733-333e2f4f4bf2:/dev/nvme0n1p3 d2f0a872-632b-4f03-9761-1f9b33956881:/dev/nvme0n1p4]
Sep 15 18:50:25.410490 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.410428    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 18:50:25.411674 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.411660    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 18:50:25.416549 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.416449    2572 manager.go:216] Machine: {Timestamp:2026-09-15 18:50:25.41409308 +0000 UTC m=+0.362321396 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102920 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25d250b67df00f213b834183890038 SystemUUID:ec25d250-b67d-f00f-213b-834183890038 BootID:d8daae6c-13de-4a4b-b4cd-225c7b6c064f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f4:d4:43:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f4:d4:43:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:64:5b:2b:3d:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 18:50:25.416549 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.416546    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 18:50:25.416662 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.416651    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 18:50:25.420173 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.420151    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 18:50:25.420296 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.420176    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-252.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 18:50:25.421007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.420998    2572 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 18:50:25.421039 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.421010    2572 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 18:50:25.421039 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.421017    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 18:50:25.421973 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.421963    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 18:50:25.423228 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.423219    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 18:50:25.427879 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.427869    2572 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 18:50:25.427979 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.427970    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 18:50:25.428015 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.427998    2572 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 18:50:25.428043 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.428015    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 18:50:25.428043 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.428026    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 18:50:25.428043 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.428036    2572 kubelet.go:398] "Adding apiserver pod source"
Sep 15 18:50:25.428115 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.428047    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 18:50:25.428385 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.428374    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 18:50:25.428431 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.428391    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 18:50:25.430708 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.430687    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 18:50:25.433610 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.433596    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 18:50:25.433666 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.433630    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 18:50:25.437325 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437312    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 18:50:25.437381 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437333    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 18:50:25.437381 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437340    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 18:50:25.437381 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437345    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 18:50:25.437381 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437354    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 18:50:25.437381 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437359    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 18:50:25.437381 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437372    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 18:50:25.437381 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437377    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 18:50:25.437567 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437386    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 18:50:25.437567 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437394    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 18:50:25.437567 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437406    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 18:50:25.437567 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437422    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 18:50:25.437567 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437452    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 18:50:25.437567 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.437460    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 18:50:25.441487 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.441440    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 18:50:25.441487 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.441465    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-252.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 18:50:25.441487 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.441402    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 18:50:25.441770 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.441748    2572 server.go:1268] "Started kubelet"
Sep 15 18:50:25.441845 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.441814    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 18:50:25.441901 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.441840    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 18:50:25.441901 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.441894    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 18:50:25.442794 ip-10-0-129-252 systemd[1]: Started Kubernetes Kubelet.
Sep 15 18:50:25.445878 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.445842    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 18:50:25.447484 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.447463    2572 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 18:50:25.447907 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.447884    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 18:50:25.454018 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.453996    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 18:50:25.454679 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.452671    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-252.ec2.internal.18d59327a5a422f9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-252.ec2.internal,UID:ip-10-0-129-252.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-252.ec2.internal,},FirstTimestamp:2026-09-15 18:50:25.441645305 +0000 UTC m=+0.389873622,LastTimestamp:2026-09-15 18:50:25.441645305 +0000 UTC m=+0.389873622,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-252.ec2.internal,}"
Sep 15 18:50:25.454899 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.454883    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nv4ql"
Sep 15 18:50:25.455480 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.455465    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 18:50:25.455603 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.455583    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:25.456239 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456221    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 18:50:25.456328 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456225    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 18:50:25.456328 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456266    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 18:50:25.456431 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456365    2572 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 18:50:25.456431 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456375    2572 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 18:50:25.456533 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456520    2572 factory.go:55] Registering systemd factory
Sep 15 18:50:25.456580 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456538    2572 factory.go:223] Registration of the systemd container factory successfully
Sep 15 18:50:25.456756 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456744    2572 factory.go:153] Registering CRI-O factory
Sep 15 18:50:25.456830 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456758    2572 factory.go:223] Registration of the crio container factory successfully
Sep 15 18:50:25.456830 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456823    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 18:50:25.456936 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456844    2572 factory.go:103] Registering Raw factory
Sep 15 18:50:25.456936 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.456859    2572 manager.go:1196] Started watching for new ooms in manager
Sep 15 18:50:25.457195 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.457182    2572 manager.go:349] Starting recovery of all containers
Sep 15 18:50:25.462833 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.462798    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nv4ql"
Sep 15 18:50:25.464723 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.464699    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 18:50:25.464801 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.464725    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-252.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 18:50:25.465299 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.465285    2572 manager.go:354] Recovery completed
Sep 15 18:50:25.471876 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.471862    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 18:50:25.474023 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.474007    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 18:50:25.474101 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.474040    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 18:50:25.474101 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.474051    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientPID"
Sep 15 18:50:25.474592 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.474576    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 18:50:25.474592 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.474591    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 18:50:25.474725 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.474575    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 18:50:25.474725 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.474609    2572 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 18:50:25.475749 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.475729    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 18:50:25.475831 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.475756    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 18:50:25.475831 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.475767    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientPID"
Sep 15 18:50:25.476738 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.476725    2572 policy_none.go:49] "None policy: Start"
Sep 15 18:50:25.476821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.476741    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 18:50:25.476821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.476751    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 18:50:25.478776 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.478761    2572 policy_none.go:47] "Start"
Sep 15 18:50:25.508475 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.508460    2572 manager.go:337] "Starting Device Plugin manager"
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.508492    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.508501    2572 server.go:87] "Starting device plugin registration server"
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.508682    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.508694    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.508822    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.508889    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.508898    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.509536    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 18:50:25.533321 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.509583    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:25.549685 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.549659    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 18:50:25.550780 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.550763    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 18:50:25.550910 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.550819    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 18:50:25.550910 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.550842    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 18:50:25.551006 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.550919    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 18:50:25.552600 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.552582    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 18:50:25.609618 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.609572    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 18:50:25.610348 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.610333    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 18:50:25.610431 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.610363    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 18:50:25.610431 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.610377    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientPID"
Sep 15 18:50:25.610431 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.610402    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.619465 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.619448    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.619531 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.619471    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-252.ec2.internal\": node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:25.647298 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.647276    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:25.651338 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.651323    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal"]
Sep 15 18:50:25.651387 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.651380    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 18:50:25.652063 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.652049    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 18:50:25.652143 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.652077    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 18:50:25.652143 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.652091    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientPID"
Sep 15 18:50:25.654414 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.654399    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 18:50:25.654523 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.654509    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.654570 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.654535    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 18:50:25.655051 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.655037    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 18:50:25.655116 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.655055    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 18:50:25.655116 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.655060    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 18:50:25.655116 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.655090    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientPID"
Sep 15 18:50:25.655209 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.655074    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 18:50:25.655209 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.655146    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientPID"
Sep 15 18:50:25.657194 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.657178    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfe6aff89ab7e85ebb937c981c5f196c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal\" (UID: \"dfe6aff89ab7e85ebb937c981c5f196c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.657267 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.657201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfe6aff89ab7e85ebb937c981c5f196c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal\" (UID: \"dfe6aff89ab7e85ebb937c981c5f196c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.657267 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.657217    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/878442b3229afc76d9706c25b8cfca80-config\") pod \"kube-apiserver-proxy-ip-10-0-129-252.ec2.internal\" (UID: \"878442b3229afc76d9706c25b8cfca80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.657416 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.657400    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.657502 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.657423    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 18:50:25.658097 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.658083    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 18:50:25.658165 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.658110    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 18:50:25.658165 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.658121    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeHasSufficientPID"
Sep 15 18:50:25.682421 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.682402    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-252.ec2.internal\" not found" node="ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.686844 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.686831    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-252.ec2.internal\" not found" node="ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.747372 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.747356    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:25.757443 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.757423    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfe6aff89ab7e85ebb937c981c5f196c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal\" (UID: \"dfe6aff89ab7e85ebb937c981c5f196c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.757502 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.757478    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfe6aff89ab7e85ebb937c981c5f196c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal\" (UID: \"dfe6aff89ab7e85ebb937c981c5f196c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.757537 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.757506    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfe6aff89ab7e85ebb937c981c5f196c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal\" (UID: \"dfe6aff89ab7e85ebb937c981c5f196c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.757569 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.757529    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/878442b3229afc76d9706c25b8cfca80-config\") pod \"kube-apiserver-proxy-ip-10-0-129-252.ec2.internal\" (UID: \"878442b3229afc76d9706c25b8cfca80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.757569 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.757562    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/878442b3229afc76d9706c25b8cfca80-config\") pod \"kube-apiserver-proxy-ip-10-0-129-252.ec2.internal\" (UID: \"878442b3229afc76d9706c25b8cfca80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.757630 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.757593    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfe6aff89ab7e85ebb937c981c5f196c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal\" (UID: \"dfe6aff89ab7e85ebb937c981c5f196c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.847598 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.847568    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:25.948276 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:25.948227    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:25.986662 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.986643    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:25.989837 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:25.989823    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:26.048611 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:26.048474    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:26.148978 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:26.148950    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:26.249538 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:26.249484    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:26.353686 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:26.353664    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:26.374320 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.374295    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 18:50:26.375779 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.375759    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 18:50:26.375913 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.375893    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 18:50:26.454050 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:26.454030    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-252.ec2.internal\" not found"
Sep 15 18:50:26.466609 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.466589    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 18:50:26.470404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.470382    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 18:45:26 +0000 UTC" deadline="2028-06-08 23:40:08.661682584 +0000 UTC"
Sep 15 18:50:26.470454 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.470403    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15172h49m42.191282158s"
Sep 15 18:50:26.556135 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.556084    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:26.570140 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.570123    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 18:50:26.570977 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.570965    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal"
Sep 15 18:50:26.577636 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.577620    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 18:50:26.939746 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:26.939704    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe6aff89ab7e85ebb937c981c5f196c.slice/crio-559e834e378e26f4d36d25909eaa10f171f2b9530a5989e49c172bd1ef0477e2 WatchSource:0}: Error finding container 559e834e378e26f4d36d25909eaa10f171f2b9530a5989e49c172bd1ef0477e2: Status 404 returned error can't find the container with id 559e834e378e26f4d36d25909eaa10f171f2b9530a5989e49c172bd1ef0477e2
Sep 15 18:50:26.942188 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:26.942162    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878442b3229afc76d9706c25b8cfca80.slice/crio-5000842ec3752a0eb0ca845d205f25bd2ee4dad182d581c0db855c68521c6563 WatchSource:0}: Error finding container 5000842ec3752a0eb0ca845d205f25bd2ee4dad182d581c0db855c68521c6563: Status 404 returned error can't find the container with id 5000842ec3752a0eb0ca845d205f25bd2ee4dad182d581c0db855c68521c6563
Sep 15 18:50:26.946689 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:26.946677    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 18:50:27.013513 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.013491    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 18:50:27.432591 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.432565    2572 apiserver.go:52] "Watching apiserver"
Sep 15 18:50:27.439432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.439407    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 18:50:27.440563 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.440539    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4cs2c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7","openshift-cluster-node-tuning-operator/tuned-6mmx8","openshift-dns/node-resolver-skgjx","openshift-image-registry/node-ca-q4w7m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal","openshift-multus/multus-additional-cni-plugins-x2grv","openshift-network-diagnostics/network-check-target-xbnzw","kube-system/global-pull-secret-syncer-krv8r","kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal","openshift-multus/multus-w7dsq","openshift-multus/network-metrics-daemon-kdrm2","openshift-network-operator/iptables-alerter-l5pnb","openshift-ovn-kubernetes/ovnkube-node-nzrd5"]
Sep 15 18:50:27.444487 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.444469    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.446683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.446652    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.446858 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.446835    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 18:50:27.447150 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.447134    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 18:50:27.447232 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.447160    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 18:50:27.447232 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.447137    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 18:50:27.447351 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.447269    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qp82p\""
Sep 15 18:50:27.447410 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.447385    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 18:50:27.448560 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.448542    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 18:50:27.448870 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.448853    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 18:50:27.448973 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.448946    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.449036 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.449024    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j4xtd\""
Sep 15 18:50:27.449092 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.449047    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:50:27.450748 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.450726    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:50:27.450893 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.450787    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 18:50:27.450893 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.450810    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2nvrr\""
Sep 15 18:50:27.451118 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.451102    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.452818 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.452803    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 18:50:27.452913 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.452874    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-85sts\""
Sep 15 18:50:27.453086 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.453063    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 18:50:27.453444 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.453428    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.454318 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.454293    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 18:50:27.455220 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.455195    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 18:50:27.455328 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.455283    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 18:50:27.455396 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.455337    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 18:50:27.455536 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.455520    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rdntb\""
Sep 15 18:50:27.455940 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.455919    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.458582 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.458566    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.458711 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.458691    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:27.460352 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.460329    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 18:50:27.460441 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.460384    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 18:50:27.460545 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.460527    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n2zfj\""
Sep 15 18:50:27.460748 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.460733    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 18:50:27.460888 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.460866    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 18:50:27.460974 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.460905    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 18:50:27.461038 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.460995    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:27.461397 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.461382    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 18:50:27.463174 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.463157    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jzfs5\""
Sep 15 18:50:27.463267 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.463198    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 18:50:27.463332 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.463266    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 18:50:27.463844 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.463826    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.466070 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466047    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-node-log\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.466171 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466078    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-sys\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.466171 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv4pl\" (UniqueName: \"kubernetes.io/projected/31a96b62-7d42-46e3-953f-7bf8307c9ce1-kube-api-access-dv4pl\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.466171 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466121    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc04cb5c-5790-4e11-b945-7bbee9ec032f-dbus\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.466357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.466357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466228    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.466357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466250    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.466357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466267    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysconfig\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.466357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466285    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq4b8\" (UniqueName: \"kubernetes.io/projected/35059c7d-0268-4441-aa2d-31c14f50358b-kube-api-access-zq4b8\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.466357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466305    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysctl-conf\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.466357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466320    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-systemd\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.466357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466338    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31a96b62-7d42-46e3-953f-7bf8307c9ce1-serviceca\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-log-socket\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466399    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-systemd-units\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466420    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-etc-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-ovn\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466514    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlds6\" (UniqueName: \"kubernetes.io/projected/6e7d74ae-abe1-47fb-b643-45c32faa36f5-kube-api-access-hlds6\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d4dfebb-0f63-4913-9251-6142c5787c88-iptables-alerter-script\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466691    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466698    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw4wc\" (UniqueName: \"kubernetes.io/projected/6d4dfebb-0f63-4913-9251-6142c5787c88-kube-api-access-qw4wc\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466701    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 18:50:27.466821 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-modprobe-d\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466856    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p248f\""
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v2q9\" (UniqueName: \"kubernetes.io/projected/e2c60d2c-6078-48ea-ae82-1f246ce0da13-kube-api-access-9v2q9\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466910    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovn-node-metrics-cert\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.466989    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-lib-modules\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-var-lib-kubelet\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467091    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-host\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467142    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc04cb5c-5790-4e11-b945-7bbee9ec032f-kubelet-config\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467186    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-systemd\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467201    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467264    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-cni-netd\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467289    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovnkube-config\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d4dfebb-0f63-4913-9251-6142c5787c88-host-slash\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.467378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-kubernetes\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.468224 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467412    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-run\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.468224 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467421    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:27.468224 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cnibin\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.468224 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.467474    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:27.468224 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-slash\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.468224 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.467533    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-cni-bin\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.468224 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468146    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-env-overrides\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.468224 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468195    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysctl-d\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.468786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2ea6961-4c54-48f3-bb95-878cb343e43f-tmp\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.468786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27s5q\" (UniqueName: \"kubernetes.io/projected/f2ea6961-4c54-48f3-bb95-878cb343e43f-kube-api-access-27s5q\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.468786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468372    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31a96b62-7d42-46e3-953f-7bf8307c9ce1-host\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.468786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468435    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.468786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468482    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.468786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468524    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35059c7d-0268-4441-aa2d-31c14f50358b-hosts-file\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.468786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468553    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35059c7d-0268-4441-aa2d-31c14f50358b-tmp-dir\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.468786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468585    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-run-netns\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.469241 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468854    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovnkube-script-lib\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.469241 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-tuned\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.469241 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.468973    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.469241 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.469012    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-system-cni-dir\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.469241 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.469139    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-kubelet\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.469241 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.469222    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-var-lib-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.471866 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.471840    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.473949 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.473929    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:27.474025 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.473995    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:27.474025 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.474009    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 18:50:27.474156 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.474129    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h8txg\""
Sep 15 18:50:27.492906 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.492873    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qlbv7"
Sep 15 18:50:27.503567 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.503549    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qlbv7"
Sep 15 18:50:27.556835 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.556798    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal" event={"ID":"878442b3229afc76d9706c25b8cfca80","Type":"ContainerStarted","Data":"5000842ec3752a0eb0ca845d205f25bd2ee4dad182d581c0db855c68521c6563"}
Sep 15 18:50:27.557058 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.557044    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 18:50:27.557982 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.557964    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal" event={"ID":"dfe6aff89ab7e85ebb937c981c5f196c","Type":"ContainerStarted","Data":"559e834e378e26f4d36d25909eaa10f171f2b9530a5989e49c172bd1ef0477e2"}
Sep 15 18:50:27.570475 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570453    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc04cb5c-5790-4e11-b945-7bbee9ec032f-dbus\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.570554 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-systemd\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.570554 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-run\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.570554 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570512    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27s5q\" (UniqueName: \"kubernetes.io/projected/f2ea6961-4c54-48f3-bb95-878cb343e43f-kube-api-access-27s5q\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.570554 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31a96b62-7d42-46e3-953f-7bf8307c9ce1-host\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-device-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570569    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-systemd\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570600    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-run\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570614    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc04cb5c-5790-4e11-b945-7bbee9ec032f-dbus\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570634    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31a96b62-7d42-46e3-953f-7bf8307c9ce1-host\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-slash\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570695    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-cni-bin\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570722    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysctl-d\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-slash\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-cni-bin\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.570803 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570792    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-system-cni-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-hostroot\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570865    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2jf6\" (UniqueName: \"kubernetes.io/projected/8a02bee1-859c-448c-88bf-6522ac1d6023-kube-api-access-z2jf6\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysctl-d\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570913    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-run-netns\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.570952    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-run-netns\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571004    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovnkube-script-lib\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571022    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-tuned\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-system-cni-dir\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-var-lib-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-sys\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571086    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-sys-fs\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571101    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-cni-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571123    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-system-cni-dir\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571125    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-netns\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.571363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571176    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-sys\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571257    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571316    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-var-lib-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571342    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571399    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ad4e021-957c-4b7c-bab5-79a1bbdd6601-konnectivity-ca\") pod \"konnectivity-agent-4cs2c\" (UID: \"6ad4e021-957c-4b7c-bab5-79a1bbdd6601\") " pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq4b8\" (UniqueName: \"kubernetes.io/projected/35059c7d-0268-4441-aa2d-31c14f50358b-kube-api-access-zq4b8\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571482    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-systemd\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571512    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-cni-bin\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571513    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571540    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-multus-certs\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-etc-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-ovn\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571640    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-systemd\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571646    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw4wc\" (UniqueName: \"kubernetes.io/projected/6d4dfebb-0f63-4913-9251-6142c5787c88-kube-api-access-qw4wc\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-modprobe-d\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571685    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-etc-openvswitch\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.572184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571698    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-socket-dir-parent\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvmwz\" (UniqueName: \"kubernetes.io/projected/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-kube-api-access-dvmwz\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571739    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-run-ovn\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571823    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovn-node-metrics-cert\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571887    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-cni-multus\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571893    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-modprobe-d\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-daemon-config\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571926    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.571969    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovnkube-script-lib\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572018    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572041    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-cni-netd\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovnkube-config\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572123    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-cni-netd\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d4dfebb-0f63-4913-9251-6142c5787c88-host-slash\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d4dfebb-0f63-4913-9251-6142c5787c88-host-slash\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.573060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572172    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-kubernetes\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572217    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2ea6961-4c54-48f3-bb95-878cb343e43f-tmp\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572249    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-cnibin\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-kubernetes\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cnibin\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-env-overrides\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-registration-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572371    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572581    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35059c7d-0268-4441-aa2d-31c14f50358b-hosts-file\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572591    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cnibin\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572614    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35059c7d-0268-4441-aa2d-31c14f50358b-tmp-dir\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572626    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovnkube-config\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35059c7d-0268-4441-aa2d-31c14f50358b-hosts-file\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572687    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ad4e021-957c-4b7c-bab5-79a1bbdd6601-agent-certs\") pod \"konnectivity-agent-4cs2c\" (UID: \"6ad4e021-957c-4b7c-bab5-79a1bbdd6601\") " pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9v4\" (UniqueName: \"kubernetes.io/projected/328e93d0-feb2-4202-a5ce-2937d032d93b-kube-api-access-4q9v4\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.573951 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.572754    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572756    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572809    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a02bee1-859c-448c-88bf-6522ac1d6023-cni-binary-copy\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572879    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-kubelet\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572920    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-node-log\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-socket-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572955    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35059c7d-0268-4441-aa2d-31c14f50358b-tmp-dir\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.572972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-conf-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.573010    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret podName:dc04cb5c-5790-4e11-b945-7bbee9ec032f nodeName:}" failed. No retries permitted until 2026-09-15 18:50:28.072989443 +0000 UTC m=+3.021217766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret") pod "global-pull-secret-syncer-krv8r" (UID: "dc04cb5c-5790-4e11-b945-7bbee9ec032f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573004    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-host-kubelet\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573040    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-node-log\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573075    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysconfig\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573101    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysconfig\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysctl-conf\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.574851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573165    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31a96b62-7d42-46e3-953f-7bf8307c9ce1-serviceca\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573195    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-k8s-cni-cncf-io\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573220    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-log-socket\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573266    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-systemd-units\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573282    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-sysctl-conf\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlds6\" (UniqueName: \"kubernetes.io/projected/6e7d74ae-abe1-47fb-b643-45c32faa36f5-kube-api-access-hlds6\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d4dfebb-0f63-4913-9251-6142c5787c88-iptables-alerter-script\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-lib-modules\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573414    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-var-lib-kubelet\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573540    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2c60d2c-6078-48ea-ae82-1f246ce0da13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573552    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc04cb5c-5790-4e11-b945-7bbee9ec032f-kubelet-config\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573590    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-kubelet\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573597    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-systemd-units\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e7d74ae-abe1-47fb-b643-45c32faa36f5-log-socket\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v2q9\" (UniqueName: \"kubernetes.io/projected/e2c60d2c-6078-48ea-ae82-1f246ce0da13-kube-api-access-9v2q9\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-host\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573745    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.575404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573766    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31a96b62-7d42-46e3-953f-7bf8307c9ce1-serviceca\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-etc-kubernetes\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573823    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-host\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573834    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e7d74ae-abe1-47fb-b643-45c32faa36f5-env-overrides\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573870    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4pl\" (UniqueName: \"kubernetes.io/projected/31a96b62-7d42-46e3-953f-7bf8307c9ce1-kube-api-access-dv4pl\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.573998    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-lib-modules\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.574008    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2ea6961-4c54-48f3-bb95-878cb343e43f-var-lib-kubelet\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.574086    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc04cb5c-5790-4e11-b945-7bbee9ec032f-kubelet-config\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.574569    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d4dfebb-0f63-4913-9251-6142c5787c88-iptables-alerter-script\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.575079    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2ea6961-4c54-48f3-bb95-878cb343e43f-etc-tuned\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.575168    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2ea6961-4c54-48f3-bb95-878cb343e43f-tmp\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.575976 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.575183    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e7d74ae-abe1-47fb-b643-45c32faa36f5-ovn-node-metrics-cert\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.584855 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.584825    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27s5q\" (UniqueName: \"kubernetes.io/projected/f2ea6961-4c54-48f3-bb95-878cb343e43f-kube-api-access-27s5q\") pod \"tuned-6mmx8\" (UID: \"f2ea6961-4c54-48f3-bb95-878cb343e43f\") " pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.585267 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.585246    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq4b8\" (UniqueName: \"kubernetes.io/projected/35059c7d-0268-4441-aa2d-31c14f50358b-kube-api-access-zq4b8\") pod \"node-resolver-skgjx\" (UID: \"35059c7d-0268-4441-aa2d-31c14f50358b\") " pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.585860 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.585838    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw4wc\" (UniqueName: \"kubernetes.io/projected/6d4dfebb-0f63-4913-9251-6142c5787c88-kube-api-access-qw4wc\") pod \"iptables-alerter-l5pnb\" (UID: \"6d4dfebb-0f63-4913-9251-6142c5787c88\") " pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.586569 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.586534    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v2q9\" (UniqueName: \"kubernetes.io/projected/e2c60d2c-6078-48ea-ae82-1f246ce0da13-kube-api-access-9v2q9\") pod \"multus-additional-cni-plugins-x2grv\" (UID: \"e2c60d2c-6078-48ea-ae82-1f246ce0da13\") " pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.586782 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.586757    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv4pl\" (UniqueName: \"kubernetes.io/projected/31a96b62-7d42-46e3-953f-7bf8307c9ce1-kube-api-access-dv4pl\") pod \"node-ca-q4w7m\" (UID: \"31a96b62-7d42-46e3-953f-7bf8307c9ce1\") " pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.589076 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.589054    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlds6\" (UniqueName: \"kubernetes.io/projected/6e7d74ae-abe1-47fb-b643-45c32faa36f5-kube-api-access-hlds6\") pod \"ovnkube-node-nzrd5\" (UID: \"6e7d74ae-abe1-47fb-b643-45c32faa36f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.674565 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ad4e021-957c-4b7c-bab5-79a1bbdd6601-agent-certs\") pod \"konnectivity-agent-4cs2c\" (UID: \"6ad4e021-957c-4b7c-bab5-79a1bbdd6601\") " pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:27.674660 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674572    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9v4\" (UniqueName: \"kubernetes.io/projected/328e93d0-feb2-4202-a5ce-2937d032d93b-kube-api-access-4q9v4\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.674660 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:27.674660 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674605    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a02bee1-859c-448c-88bf-6522ac1d6023-cni-binary-copy\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.674660 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-socket-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-conf-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674744    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-conf-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.674773    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-k8s-cni-cncf-io\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674801    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-socket-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.674851    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs podName:0daf85a6-a551-4ef0-8f17-2d7ab335e1a4 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:28.174831891 +0000 UTC m=+3.123060212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs") pod "network-metrics-daemon-kdrm2" (UID: "0daf85a6-a551-4ef0-8f17-2d7ab335e1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674859    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-k8s-cni-cncf-io\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.674898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674877    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-kubelet\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-etc-kubernetes\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.674977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-device-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-system-cni-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675051    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675065    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-hostroot\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675040    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-etc-kubernetes\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-kubelet\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675086    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-device-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2jf6\" (UniqueName: \"kubernetes.io/projected/8a02bee1-859c-448c-88bf-6522ac1d6023-kube-api-access-z2jf6\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675086    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675110    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-system-cni-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-hostroot\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-sys-fs\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675220    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-cni-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675246    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-netns\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.675361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ad4e021-957c-4b7c-bab5-79a1bbdd6601-konnectivity-ca\") pod \"konnectivity-agent-4cs2c\" (UID: \"6ad4e021-957c-4b7c-bab5-79a1bbdd6601\") " pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675300    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-sys-fs\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675309    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-cni-dir\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-cni-bin\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675331    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a02bee1-859c-448c-88bf-6522ac1d6023-cni-binary-copy\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675334    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-cni-bin\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675359    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-multus-certs\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675390    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-socket-dir-parent\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675393    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-multus-certs\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675361    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-run-netns\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675417    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvmwz\" (UniqueName: \"kubernetes.io/projected/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-kube-api-access-dvmwz\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-cni-multus\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675464    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-socket-dir-parent\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675475    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-daemon-config\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-host-var-lib-cni-multus\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-cnibin\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-registration-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675567    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a02bee1-859c-448c-88bf-6522ac1d6023-cnibin\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675600    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/328e93d0-feb2-4202-a5ce-2937d032d93b-registration-dir\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.676773 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.675875    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ad4e021-957c-4b7c-bab5-79a1bbdd6601-konnectivity-ca\") pod \"konnectivity-agent-4cs2c\" (UID: \"6ad4e021-957c-4b7c-bab5-79a1bbdd6601\") " pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:27.676773 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.676071    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a02bee1-859c-448c-88bf-6522ac1d6023-multus-daemon-config\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.676960 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.676942    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ad4e021-957c-4b7c-bab5-79a1bbdd6601-agent-certs\") pod \"konnectivity-agent-4cs2c\" (UID: \"6ad4e021-957c-4b7c-bab5-79a1bbdd6601\") " pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:27.680578 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.680561    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 18:50:27.680662 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.680583    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 18:50:27.680662 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.680596    2572 projected.go:196] Error preparing data for projected volume kube-api-access-h2lk7 for pod openshift-network-diagnostics/network-check-target-xbnzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:27.680662 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:27.680647    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7 podName:517c7cd0-f112-4ff3-b3a8-fffaf90d5167 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:28.180630223 +0000 UTC m=+3.128858548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h2lk7" (UniqueName: "kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7") pod "network-check-target-xbnzw" (UID: "517c7cd0-f112-4ff3-b3a8-fffaf90d5167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:27.682711 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.682656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvmwz\" (UniqueName: \"kubernetes.io/projected/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-kube-api-access-dvmwz\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:27.682972 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.682954    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9v4\" (UniqueName: \"kubernetes.io/projected/328e93d0-feb2-4202-a5ce-2937d032d93b-kube-api-access-4q9v4\") pod \"aws-ebs-csi-driver-node-f7rl7\" (UID: \"328e93d0-feb2-4202-a5ce-2937d032d93b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.683270 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.683254    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2jf6\" (UniqueName: \"kubernetes.io/projected/8a02bee1-859c-448c-88bf-6522ac1d6023-kube-api-access-z2jf6\") pod \"multus-w7dsq\" (UID: \"8a02bee1-859c-448c-88bf-6522ac1d6023\") " pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.755808 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.755784    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x2grv"
Sep 15 18:50:27.763007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.762983    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5pnb"
Sep 15 18:50:27.767899 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:27.767872    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c60d2c_6078_48ea_ae82_1f246ce0da13.slice/crio-ac698057020e2c8ebe85d6d651ff5deb929b0d0a0106e9d22d42b664445ba400 WatchSource:0}: Error finding container ac698057020e2c8ebe85d6d651ff5deb929b0d0a0106e9d22d42b664445ba400: Status 404 returned error can't find the container with id ac698057020e2c8ebe85d6d651ff5deb929b0d0a0106e9d22d42b664445ba400
Sep 15 18:50:27.774333 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:27.774305    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4dfebb_0f63_4913_9251_6142c5787c88.slice/crio-369d5b19bcd2a2a8ca122b5b5f81e9753a74f12f97df29f5505f4ac270ba67b0 WatchSource:0}: Error finding container 369d5b19bcd2a2a8ca122b5b5f81e9753a74f12f97df29f5505f4ac270ba67b0: Status 404 returned error can't find the container with id 369d5b19bcd2a2a8ca122b5b5f81e9753a74f12f97df29f5505f4ac270ba67b0
Sep 15 18:50:27.775327 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.775305    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6mmx8"
Sep 15 18:50:27.777641 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.777622    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-skgjx"
Sep 15 18:50:27.783130 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.783109    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q4w7m"
Sep 15 18:50:27.789156 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:27.789133    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ea6961_4c54_48f3_bb95_878cb343e43f.slice/crio-8fd0ad0b13d1b703327912e72943b0cf7113ec8ce93fa953e9069ad4eab3ccf0 WatchSource:0}: Error finding container 8fd0ad0b13d1b703327912e72943b0cf7113ec8ce93fa953e9069ad4eab3ccf0: Status 404 returned error can't find the container with id 8fd0ad0b13d1b703327912e72943b0cf7113ec8ce93fa953e9069ad4eab3ccf0
Sep 15 18:50:27.790384 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.790357    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:27.795689 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.795550    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:27.799030 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.798016    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 18:50:27.801539 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.801508    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7"
Sep 15 18:50:27.806417 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:27.806395    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w7dsq"
Sep 15 18:50:27.806810 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:27.806786    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7d74ae_abe1_47fb_b643_45c32faa36f5.slice/crio-f1da0be2682e605bba0b61d58ca0c0fc3fde30213028939974a24c3404fb6e63 WatchSource:0}: Error finding container f1da0be2682e605bba0b61d58ca0c0fc3fde30213028939974a24c3404fb6e63: Status 404 returned error can't find the container with id f1da0be2682e605bba0b61d58ca0c0fc3fde30213028939974a24c3404fb6e63
Sep 15 18:50:27.811102 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:27.811059    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad4e021_957c_4b7c_bab5_79a1bbdd6601.slice/crio-f3fc1da07c1b66392e55b75e10c67c55f67fe8b59ff3dd6019fda5003ff6f0a6 WatchSource:0}: Error finding container f3fc1da07c1b66392e55b75e10c67c55f67fe8b59ff3dd6019fda5003ff6f0a6: Status 404 returned error can't find the container with id f3fc1da07c1b66392e55b75e10c67c55f67fe8b59ff3dd6019fda5003ff6f0a6
Sep 15 18:50:27.817223 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:27.817196    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328e93d0_feb2_4202_a5ce_2937d032d93b.slice/crio-5207415e6acb49d6826073b4e0310a0ef1a62c532046b05e8e5dd5eb47bf1121 WatchSource:0}: Error finding container 5207415e6acb49d6826073b4e0310a0ef1a62c532046b05e8e5dd5eb47bf1121: Status 404 returned error can't find the container with id 5207415e6acb49d6826073b4e0310a0ef1a62c532046b05e8e5dd5eb47bf1121
Sep 15 18:50:27.823659 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:50:27.823425    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a02bee1_859c_448c_88bf_6522ac1d6023.slice/crio-2e4ba4aad9f69321a69b791d9b99ca2e12b71c059dff1d19cb87397085713962 WatchSource:0}: Error finding container 2e4ba4aad9f69321a69b791d9b99ca2e12b71c059dff1d19cb87397085713962: Status 404 returned error can't find the container with id 2e4ba4aad9f69321a69b791d9b99ca2e12b71c059dff1d19cb87397085713962
Sep 15 18:50:28.078740 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.078652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:28.078931 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:28.078832    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:28.078931 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:28.078908    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret podName:dc04cb5c-5790-4e11-b945-7bbee9ec032f nodeName:}" failed. No retries permitted until 2026-09-15 18:50:29.078887084 +0000 UTC m=+4.027115394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret") pod "global-pull-secret-syncer-krv8r" (UID: "dc04cb5c-5790-4e11-b945-7bbee9ec032f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:28.179716 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.179690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:28.179879 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:28.179810    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:28.179879 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:28.179872    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs podName:0daf85a6-a551-4ef0-8f17-2d7ab335e1a4 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:29.179858676 +0000 UTC m=+4.128086982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs") pod "network-metrics-daemon-kdrm2" (UID: "0daf85a6-a551-4ef0-8f17-2d7ab335e1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:28.280555 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.280516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:28.280844 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:28.280804    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 18:50:28.280934 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:28.280853    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 18:50:28.280934 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:28.280867    2572 projected.go:196] Error preparing data for projected volume kube-api-access-h2lk7 for pod openshift-network-diagnostics/network-check-target-xbnzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:28.281048 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:28.280938    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7 podName:517c7cd0-f112-4ff3-b3a8-fffaf90d5167 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:29.280920548 +0000 UTC m=+4.229148872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2lk7" (UniqueName: "kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7") pod "network-check-target-xbnzw" (UID: "517c7cd0-f112-4ff3-b3a8-fffaf90d5167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:28.507151 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.507002    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 18:45:28 +0000 UTC" deadline="2028-02-13 07:38:31.731364759 +0000 UTC"
Sep 15 18:50:28.507151 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.507046    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12372h48m3.224325673s"
Sep 15 18:50:28.568906 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.568845    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7" event={"ID":"328e93d0-feb2-4202-a5ce-2937d032d93b","Type":"ContainerStarted","Data":"5207415e6acb49d6826073b4e0310a0ef1a62c532046b05e8e5dd5eb47bf1121"}
Sep 15 18:50:28.573705 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.573584    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"f1da0be2682e605bba0b61d58ca0c0fc3fde30213028939974a24c3404fb6e63"}
Sep 15 18:50:28.577603 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.577575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q4w7m" event={"ID":"31a96b62-7d42-46e3-953f-7bf8307c9ce1","Type":"ContainerStarted","Data":"0a6a2744c1338741496b9efa178832f4b6590d1d757fd5787d142e62a63755b1"}
Sep 15 18:50:28.581730 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.581705    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6mmx8" event={"ID":"f2ea6961-4c54-48f3-bb95-878cb343e43f","Type":"ContainerStarted","Data":"8fd0ad0b13d1b703327912e72943b0cf7113ec8ce93fa953e9069ad4eab3ccf0"}
Sep 15 18:50:28.592802 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.592772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4cs2c" event={"ID":"6ad4e021-957c-4b7c-bab5-79a1bbdd6601","Type":"ContainerStarted","Data":"f3fc1da07c1b66392e55b75e10c67c55f67fe8b59ff3dd6019fda5003ff6f0a6"}
Sep 15 18:50:28.598414 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.598387    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-skgjx" event={"ID":"35059c7d-0268-4441-aa2d-31c14f50358b","Type":"ContainerStarted","Data":"bb0b1746a8eb296cf95b7086c05f1ed3cc39ff87b1746c9a776548cecc6ccaee"}
Sep 15 18:50:28.605476 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.605393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5pnb" event={"ID":"6d4dfebb-0f63-4913-9251-6142c5787c88","Type":"ContainerStarted","Data":"369d5b19bcd2a2a8ca122b5b5f81e9753a74f12f97df29f5505f4ac270ba67b0"}
Sep 15 18:50:28.614305 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.614276    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerStarted","Data":"ac698057020e2c8ebe85d6d651ff5deb929b0d0a0106e9d22d42b664445ba400"}
Sep 15 18:50:28.633339 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:28.633307    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w7dsq" event={"ID":"8a02bee1-859c-448c-88bf-6522ac1d6023","Type":"ContainerStarted","Data":"2e4ba4aad9f69321a69b791d9b99ca2e12b71c059dff1d19cb87397085713962"}
Sep 15 18:50:29.086338 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:29.086300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:29.086543 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.086479    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:29.086543 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.086544    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret podName:dc04cb5c-5790-4e11-b945-7bbee9ec032f nodeName:}" failed. No retries permitted until 2026-09-15 18:50:31.086524908 +0000 UTC m=+6.034753232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret") pod "global-pull-secret-syncer-krv8r" (UID: "dc04cb5c-5790-4e11-b945-7bbee9ec032f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:29.187300 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:29.187262    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:29.187482 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.187443    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:29.187553 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.187538    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs podName:0daf85a6-a551-4ef0-8f17-2d7ab335e1a4 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:31.187516728 +0000 UTC m=+6.135745049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs") pod "network-metrics-daemon-kdrm2" (UID: "0daf85a6-a551-4ef0-8f17-2d7ab335e1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:29.288906 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:29.288235    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:29.288906 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.288445    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 18:50:29.288906 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.288467    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 18:50:29.288906 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.288482    2572 projected.go:196] Error preparing data for projected volume kube-api-access-h2lk7 for pod openshift-network-diagnostics/network-check-target-xbnzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:29.288906 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.288544    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7 podName:517c7cd0-f112-4ff3-b3a8-fffaf90d5167 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:31.288523937 +0000 UTC m=+6.236752246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2lk7" (UniqueName: "kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7") pod "network-check-target-xbnzw" (UID: "517c7cd0-f112-4ff3-b3a8-fffaf90d5167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:29.508193 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:29.508074    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 18:45:28 +0000 UTC" deadline="2028-03-19 11:06:56.019675559 +0000 UTC"
Sep 15 18:50:29.508193 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:29.508142    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13216h16m26.511538138s"
Sep 15 18:50:29.552068 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:29.552002    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:29.552068 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:29.552017    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:29.552310 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.552134    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:29.552310 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.552245    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:29.552421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:29.552324    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:29.552421 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:29.552408    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:31.104290 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:31.103722    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:31.104290 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.103880    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:31.104290 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.103941    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret podName:dc04cb5c-5790-4e11-b945-7bbee9ec032f nodeName:}" failed. No retries permitted until 2026-09-15 18:50:35.103919821 +0000 UTC m=+10.052148145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret") pod "global-pull-secret-syncer-krv8r" (UID: "dc04cb5c-5790-4e11-b945-7bbee9ec032f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:31.204247 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:31.204205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:31.204443 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.204371    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:31.204443 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.204441    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs podName:0daf85a6-a551-4ef0-8f17-2d7ab335e1a4 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:35.204414093 +0000 UTC m=+10.152642399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs") pod "network-metrics-daemon-kdrm2" (UID: "0daf85a6-a551-4ef0-8f17-2d7ab335e1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:31.305527 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:31.305493    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:31.305707 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.305662    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 18:50:31.305707 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.305686    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 18:50:31.305707 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.305700    2572 projected.go:196] Error preparing data for projected volume kube-api-access-h2lk7 for pod openshift-network-diagnostics/network-check-target-xbnzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:31.305915 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.305755    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7 podName:517c7cd0-f112-4ff3-b3a8-fffaf90d5167 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:35.305737981 +0000 UTC m=+10.253966291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2lk7" (UniqueName: "kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7") pod "network-check-target-xbnzw" (UID: "517c7cd0-f112-4ff3-b3a8-fffaf90d5167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:31.552035 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:31.551952    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:31.552201 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.552110    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:31.552553 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:31.552529    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:31.552701 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.552648    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:31.552795 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:31.552785    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:31.552997 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:31.552930    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:33.551502 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:33.551468    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:33.552005 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:33.551468    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:33.552005 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:33.551614    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:33.552005 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:33.551639    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:33.552005 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:33.551736    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:33.552005 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:33.551852    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:35.138301 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:35.138257    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:35.138790 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.138395    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:35.138790 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.138480    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret podName:dc04cb5c-5790-4e11-b945-7bbee9ec032f nodeName:}" failed. No retries permitted until 2026-09-15 18:50:43.138458274 +0000 UTC m=+18.086686583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret") pod "global-pull-secret-syncer-krv8r" (UID: "dc04cb5c-5790-4e11-b945-7bbee9ec032f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:35.238825 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:35.238791    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:35.239012 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.238991    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:35.239135 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.239100    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs podName:0daf85a6-a551-4ef0-8f17-2d7ab335e1a4 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:43.239044886 +0000 UTC m=+18.187273192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs") pod "network-metrics-daemon-kdrm2" (UID: "0daf85a6-a551-4ef0-8f17-2d7ab335e1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:35.339361 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:35.339324    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:35.339515 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.339494    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 18:50:35.339579 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.339519    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 18:50:35.339579 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.339529    2572 projected.go:196] Error preparing data for projected volume kube-api-access-h2lk7 for pod openshift-network-diagnostics/network-check-target-xbnzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:35.339702 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.339594    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7 podName:517c7cd0-f112-4ff3-b3a8-fffaf90d5167 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:43.339573525 +0000 UTC m=+18.287801837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2lk7" (UniqueName: "kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7") pod "network-check-target-xbnzw" (UID: "517c7cd0-f112-4ff3-b3a8-fffaf90d5167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:35.554471 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:35.554392    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:35.554626 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:35.554517    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:35.554626 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.554519    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:35.554626 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:35.554557    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:35.554808 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.554653    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:35.554808 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:35.554772    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:37.551963 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:37.551929    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:37.552455 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:37.552059    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:37.552455 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:37.552333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:37.552580 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:37.552448    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:37.552580 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:37.552571    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:37.552700 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:37.552673    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:39.552246 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:39.552202    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:39.552246 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:39.552243    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:39.552763 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:39.552326    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:39.552763 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:39.552414    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:39.552763 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:39.552498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:39.552763 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:39.552576    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:41.551592 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:41.551501    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:41.552002 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:41.551499    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:41.552002 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:41.551649    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:41.552002 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:41.551617    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:41.552002 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:41.551713    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:41.552002 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:41.551851    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:43.198300 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:43.198123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:43.198911 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.198272    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:43.198911 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.198444    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret podName:dc04cb5c-5790-4e11-b945-7bbee9ec032f nodeName:}" failed. No retries permitted until 2026-09-15 18:50:59.198423409 +0000 UTC m=+34.146651726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret") pod "global-pull-secret-syncer-krv8r" (UID: "dc04cb5c-5790-4e11-b945-7bbee9ec032f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:43.299725 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:43.299688    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:43.299867 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.299851    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:43.299925 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.299914    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs podName:0daf85a6-a551-4ef0-8f17-2d7ab335e1a4 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:59.299893431 +0000 UTC m=+34.248121739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs") pod "network-metrics-daemon-kdrm2" (UID: "0daf85a6-a551-4ef0-8f17-2d7ab335e1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:43.400483 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:43.400410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:43.400610 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.400574    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 18:50:43.400610 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.400598    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 18:50:43.400610 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.400610    2572 projected.go:196] Error preparing data for projected volume kube-api-access-h2lk7 for pod openshift-network-diagnostics/network-check-target-xbnzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:43.400717 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.400661    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7 podName:517c7cd0-f112-4ff3-b3a8-fffaf90d5167 nodeName:}" failed. No retries permitted until 2026-09-15 18:50:59.400648251 +0000 UTC m=+34.348876555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2lk7" (UniqueName: "kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7") pod "network-check-target-xbnzw" (UID: "517c7cd0-f112-4ff3-b3a8-fffaf90d5167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:43.551652 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:43.551618    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:43.551831 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.551738    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:43.552194 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:43.551953    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:43.552194 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.552056    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:43.552194 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:43.551623    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:43.552194 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:43.552160    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:43.670561 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:43.670483    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal" event={"ID":"878442b3229afc76d9706c25b8cfca80","Type":"ContainerStarted","Data":"8105cb4b2abec94759964f8de0d6a122d3602549476ee26a5cc75fffd0a3c3ef"}
Sep 15 18:50:43.685589 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:43.685544    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-252.ec2.internal" podStartSLOduration=16.68552865 podStartE2EDuration="16.68552865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:43.685104108 +0000 UTC m=+18.633332436" watchObservedRunningTime="2026-09-15 18:50:43.68552865 +0000 UTC m=+18.633756976"
Sep 15 18:50:44.674738 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.674706    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7" event={"ID":"328e93d0-feb2-4202-a5ce-2937d032d93b","Type":"ContainerStarted","Data":"d76c75e56885657c12a06a1e336c4c9e0227f9bce6c311de506d82e93e3d1445"}
Sep 15 18:50:44.676452 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.676423    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q4w7m" event={"ID":"31a96b62-7d42-46e3-953f-7bf8307c9ce1","Type":"ContainerStarted","Data":"648c05d4127cbaf183d0c2ace82df27cf13b57b5c918219db02ddc69b7c467f7"}
Sep 15 18:50:44.678273 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.678242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4cs2c" event={"ID":"6ad4e021-957c-4b7c-bab5-79a1bbdd6601","Type":"ContainerStarted","Data":"9fe9c5c49d1b0cd68c89f672172ff1d909893e483170249a6994671f80bef523"}
Sep 15 18:50:44.679898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.679871    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-skgjx" event={"ID":"35059c7d-0268-4441-aa2d-31c14f50358b","Type":"ContainerStarted","Data":"91730234645d1ca6591ec9c5e44bc4381050d3148cd64f2aef3ce7a00dbdd808"}
Sep 15 18:50:44.681602 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.681580    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5pnb" event={"ID":"6d4dfebb-0f63-4913-9251-6142c5787c88","Type":"ContainerStarted","Data":"74ff714b19d59c5115885679869a610910bbb0a0467e5e3d5f467a30b6518124"}
Sep 15 18:50:44.683338 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.683313    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerStarted","Data":"7f28a06d4f843ffade70588310a66939d8283854569112d2bc2ad03d1fea7492"}
Sep 15 18:50:44.684994 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.684970    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal" event={"ID":"dfe6aff89ab7e85ebb937c981c5f196c","Type":"ContainerStarted","Data":"22038373dcb370e6b6ad6a49eae7319bb9349bf4d3a7bdeb9f94db375571239e"}
Sep 15 18:50:44.690628 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.690589    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q4w7m" podStartSLOduration=3.591446789 podStartE2EDuration="18.6905779s" totalImagesPullingTime="15.099131111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:44.688868535 +0000 UTC m=+19.637096861" watchObservedRunningTime="2026-09-15 18:50:44.6905779 +0000 UTC m=+19.638806226"
Sep 15 18:50:44.703223 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.703157    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4cs2c" podStartSLOduration=3.667556659 podStartE2EDuration="18.703145243s" totalImagesPullingTime="15.035588584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:44.70278713 +0000 UTC m=+19.651015458" watchObservedRunningTime="2026-09-15 18:50:44.703145243 +0000 UTC m=+19.651373570"
Sep 15 18:50:44.733879 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.733834    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-skgjx" podStartSLOduration=3.633694764 podStartE2EDuration="18.733818781s" totalImagesPullingTime="15.100124017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:44.733663555 +0000 UTC m=+19.681891874" watchObservedRunningTime="2026-09-15 18:50:44.733818781 +0000 UTC m=+19.682047101"
Sep 15 18:50:44.764086 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:44.764048    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l5pnb" podStartSLOduration=3.637941899 podStartE2EDuration="18.764036179s" totalImagesPullingTime="15.12609428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:44.764033319 +0000 UTC m=+19.712261644" watchObservedRunningTime="2026-09-15 18:50:44.764036179 +0000 UTC m=+19.712264504"
Sep 15 18:50:45.552676 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:45.552498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:45.552846 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:45.552729    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:45.552846 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:45.552598    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:45.552846 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:45.552566    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:45.553014 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:45.552856    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:45.553014 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:45.552949    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:46.712940 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:46.712898    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:47.551333 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.551123    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:47.551493 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.551123    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:47.551493 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:47.551379    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:47.551493 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:47.551470    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:47.551598 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.551147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:47.551598 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:47.551570    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:47.654463 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.654442    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 18:50:47.692390 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.692366    2572 generic.go:356] "Generic (PLEG): container finished" podID="e2c60d2c-6078-48ea-ae82-1f246ce0da13" containerID="7f28a06d4f843ffade70588310a66939d8283854569112d2bc2ad03d1fea7492" exitCode=0
Sep 15 18:50:47.692479 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.692441    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerDied","Data":"7f28a06d4f843ffade70588310a66939d8283854569112d2bc2ad03d1fea7492"}
Sep 15 18:50:47.693979 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.693961    2572 generic.go:356] "Generic (PLEG): container finished" podID="dfe6aff89ab7e85ebb937c981c5f196c" containerID="22038373dcb370e6b6ad6a49eae7319bb9349bf4d3a7bdeb9f94db375571239e" exitCode=0
Sep 15 18:50:47.694050 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.694032    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal" event={"ID":"dfe6aff89ab7e85ebb937c981c5f196c","Type":"ContainerDied","Data":"22038373dcb370e6b6ad6a49eae7319bb9349bf4d3a7bdeb9f94db375571239e"}
Sep 15 18:50:47.695575 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.695549    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w7dsq" event={"ID":"8a02bee1-859c-448c-88bf-6522ac1d6023","Type":"ContainerStarted","Data":"c2dca52ef59634898e31d70884d6143f915820b67dfcd99e6ef09324a5a6d5f3"}
Sep 15 18:50:47.697410 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.697392    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7" event={"ID":"328e93d0-feb2-4202-a5ce-2937d032d93b","Type":"ContainerStarted","Data":"661ac865d829e3646959b0d5a42068c3be613646df2fd84a7a4981952f2ef9ac"}
Sep 15 18:50:47.700355 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.700334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"43abdc0a16b20c2081c3b46cf1ec52ccf03f4d0a582956e10a8a98bbd763e5d3"}
Sep 15 18:50:47.700444 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.700393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"52fcdd9239614a8233683fa69f19bbcb130d19c5f5f1a1a3e9ef34526c27095d"}
Sep 15 18:50:47.700496 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.700442    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"7a6f38fa829aeb6c9e52e7288d02cb271c09af231276c7fcc7f4c02c72ad3f4c"}
Sep 15 18:50:47.700496 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.700473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"4b184f1b57a1581806b48742c680c828f2026ce077a5b5410cd278a0365be83c"}
Sep 15 18:50:47.700589 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.700499    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"d011c40a9e4513cf742e72cda98dc9433a4b7845569010218bbe313a58468ccf"}
Sep 15 18:50:47.700589 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.700540    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"c94e90a66ce06c08ed03957b166cc60cdc74e367d93b5a21c6891c2a95838ddb"}
Sep 15 18:50:47.701587 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.701566    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6mmx8" event={"ID":"f2ea6961-4c54-48f3-bb95-878cb343e43f","Type":"ContainerStarted","Data":"08b99f710665aa179480c8a0e6e8f2f15257c7d098e8fa875c2e08d505d4047e"}
Sep 15 18:50:47.725452 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.725408    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6mmx8" podStartSLOduration=2.539469456 podStartE2EDuration="21.725391062s" totalImagesPullingTime="19.185921606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:47.72501649 +0000 UTC m=+22.673244817" watchObservedRunningTime="2026-09-15 18:50:47.725391062 +0000 UTC m=+22.673619388"
Sep 15 18:50:47.740030 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:47.739989    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w7dsq" podStartSLOduration=2.549946385 podStartE2EDuration="21.739975097s" totalImagesPullingTime="19.190028712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:47.739736412 +0000 UTC m=+22.687964738" watchObservedRunningTime="2026-09-15 18:50:47.739975097 +0000 UTC m=+22.688203423"
Sep 15 18:50:48.523126 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:48.523003    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T18:50:47.654459714Z","UUID":"45f1c886-816c-4afc-b21a-6305fa107409","Handler":null,"Name":"","Endpoint":""}
Sep 15 18:50:48.524423 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:48.524400    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 18:50:48.524537 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:48.524433    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 18:50:48.706076 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:48.706036    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal" event={"ID":"dfe6aff89ab7e85ebb937c981c5f196c","Type":"ContainerStarted","Data":"b15fb8c5423790213183fa4b277e6d6352f0cb17f5a2e3f50a8e34f06adf7985"}
Sep 15 18:50:48.722823 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:48.722770    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-252.ec2.internal" podStartSLOduration=21.722755571 podStartE2EDuration="21.722755571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:48.722314589 +0000 UTC m=+23.670542916" watchObservedRunningTime="2026-09-15 18:50:48.722755571 +0000 UTC m=+23.670983897"
Sep 15 18:50:49.112140 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.112070    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:49.112746 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.112625    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:49.551154 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.551126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:49.551302 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.551130    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:49.551302 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:49.551251    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:49.551302 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.551132    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:49.551460 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:49.551299    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:49.551460 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:49.551370    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:49.710590 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.710516    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7" event={"ID":"328e93d0-feb2-4202-a5ce-2937d032d93b","Type":"ContainerStarted","Data":"2b9bfae4b894c4cec33ca98a0a4448d9bac0eea40fabdbe3763e114dfa47e719"}
Sep 15 18:50:49.715620 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.715591    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"59966da153148ad829d4b9a69403ef5c28abfc70415c9f046749d2cf75ffefb6"}
Sep 15 18:50:49.716457 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.716438    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4cs2c"
Sep 15 18:50:49.726484 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:49.726431    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7rl7" podStartSLOduration=4.32838977 podStartE2EDuration="23.726420147s" totalImagesPullingTime="19.398030377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:49.726003613 +0000 UTC m=+24.674231938" watchObservedRunningTime="2026-09-15 18:50:49.726420147 +0000 UTC m=+24.674648511"
Sep 15 18:50:51.551302 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.551177    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:51.551564 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.551188    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:51.551564 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:51.551492    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:51.551564 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.551203    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:51.551670 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:51.551367    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:51.551670 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:51.551596    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:51.724989 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.724943    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" event={"ID":"6e7d74ae-abe1-47fb-b643-45c32faa36f5","Type":"ContainerStarted","Data":"eff1b7bf56f3a7b1499e3a3c975948c2d8c55e572c9cc1459bb1320b004ccaba"}
Sep 15 18:50:51.725515 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.725225    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:51.725515 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.725400    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:51.725515 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.725456    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:51.743165 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.743066    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:51.744076 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.744054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:50:51.751142 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:51.751096    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5" podStartSLOduration=10.654223716 podStartE2EDuration="25.751082212s" totalImagesPullingTime="15.096858496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:50:51.749651984 +0000 UTC m=+26.697880323" watchObservedRunningTime="2026-09-15 18:50:51.751082212 +0000 UTC m=+26.699310554"
Sep 15 18:50:53.437790 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:53.437763    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xbnzw"]
Sep 15 18:50:53.438205 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:53.437921    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:53.438205 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:53.438037    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:53.441393 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:53.441357    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kdrm2"]
Sep 15 18:50:53.441504 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:53.441494    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:53.441760 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:53.441733    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:53.442169 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:53.442148    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-krv8r"]
Sep 15 18:50:53.442252 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:53.442236    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:53.442360 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:53.442329    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:53.731034 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:53.730976    2572 generic.go:356] "Generic (PLEG): container finished" podID="e2c60d2c-6078-48ea-ae82-1f246ce0da13" containerID="3250f2480a2d9ed199a2957eec8d977fa8060038d18ad78ad812648354692413" exitCode=0
Sep 15 18:50:53.731145 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:53.731044    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerDied","Data":"3250f2480a2d9ed199a2957eec8d977fa8060038d18ad78ad812648354692413"}
Sep 15 18:50:54.551401 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:54.551375    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:54.551758 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:54.551374    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:54.551758 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:54.551471    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:54.551758 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:54.551547    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:55.552396 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:55.552365    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:55.553038 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:55.552488    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:56.551564 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:56.551363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:56.551684 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:56.551414    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:56.551684 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:56.551590    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:56.551684 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:56.551664    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:56.738873 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:56.738850    2572 generic.go:356] "Generic (PLEG): container finished" podID="e2c60d2c-6078-48ea-ae82-1f246ce0da13" containerID="7eb947f47257318b731a741c9f91ecf9c295ae8492a0a54aa33a66f9fe4f510f" exitCode=0
Sep 15 18:50:56.739577 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:56.738881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerDied","Data":"7eb947f47257318b731a741c9f91ecf9c295ae8492a0a54aa33a66f9fe4f510f"}
Sep 15 18:50:57.551662 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:57.551635    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:57.551827 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:57.551730    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:58.551367 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:58.551306    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:58.551882 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:58.551313    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:58.551882 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:58.551397    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbnzw" podUID="517c7cd0-f112-4ff3-b3a8-fffaf90d5167"
Sep 15 18:50:58.551882 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:58.551481    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krv8r" podUID="dc04cb5c-5790-4e11-b945-7bbee9ec032f"
Sep 15 18:50:58.746019 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:58.745988    2572 generic.go:356] "Generic (PLEG): container finished" podID="e2c60d2c-6078-48ea-ae82-1f246ce0da13" containerID="a6739d4c98095e6038c7c4984f13cbb927e8fe14c5df6eef022ebb87aebc482e" exitCode=0
Sep 15 18:50:58.746144 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:58.746033    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerDied","Data":"a6739d4c98095e6038c7c4984f13cbb927e8fe14c5df6eef022ebb87aebc482e"}
Sep 15 18:50:59.225684 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.225655    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:50:59.225889 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.225823    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:59.225889 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.225881    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret podName:dc04cb5c-5790-4e11-b945-7bbee9ec032f nodeName:}" failed. No retries permitted until 2026-09-15 18:51:31.225862336 +0000 UTC m=+66.174090647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret") pod "global-pull-secret-syncer-krv8r" (UID: "dc04cb5c-5790-4e11-b945-7bbee9ec032f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 18:50:59.326126 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.326095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:59.326268 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.326249    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:59.326318 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.326307    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs podName:0daf85a6-a551-4ef0-8f17-2d7ab335e1a4 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:31.326292629 +0000 UTC m=+66.274520932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs") pod "network-metrics-daemon-kdrm2" (UID: "0daf85a6-a551-4ef0-8f17-2d7ab335e1a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 18:50:59.427235 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.427208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:50:59.427370 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.427354    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 18:50:59.427414 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.427374    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 18:50:59.427414 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.427386    2572 projected.go:196] Error preparing data for projected volume kube-api-access-h2lk7 for pod openshift-network-diagnostics/network-check-target-xbnzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:59.427483 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.427431    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7 podName:517c7cd0-f112-4ff3-b3a8-fffaf90d5167 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:31.427418987 +0000 UTC m=+66.375647304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2lk7" (UniqueName: "kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7") pod "network-check-target-xbnzw" (UID: "517c7cd0-f112-4ff3-b3a8-fffaf90d5167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 18:50:59.551366 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.551303    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:50:59.551491 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:50:59.551448    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kdrm2" podUID="0daf85a6-a551-4ef0-8f17-2d7ab335e1a4"
Sep 15 18:50:59.852615 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.852550    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-252.ec2.internal" event="NodeReady"
Sep 15 18:50:59.852739 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.852678    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 18:50:59.900496 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.900468    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86d7f96496-qj6wt"]
Sep 15 18:50:59.902383 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.902360    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:50:59.904731 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.904707    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 18:50:59.904854 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.904830    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nk7cf\""
Sep 15 18:50:59.907211 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.905908    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 18:50:59.908979 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.908836    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 18:50:59.912866 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.912851    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 18:50:59.915243 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.915225    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86d7f96496-qj6wt"]
Sep 15 18:50:59.944315 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:50:59.944287    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.030755 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.030724    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.030755 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.030757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-ca-trust-extracted\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.030997 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.030778    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-trusted-ca\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.030997 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.030906    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-image-registry-private-configuration\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.030997 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.030932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6wh\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-kube-api-access-sz6wh\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.031146 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.031027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-certificates\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.031146 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.031054    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-installation-pull-secrets\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.031146 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.031079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-bound-sa-token\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.051815 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.051788    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.132139 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132058    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-image-registry-private-configuration\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.132139 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6wh\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-kube-api-access-sz6wh\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.132389 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-certificates\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.132389 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-installation-pull-secrets\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.132389 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132191    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-bound-sa-token\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.132389 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.132389 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132234    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-ca-trust-extracted\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.132389 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132259    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-trusted-ca\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.132389 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.132371    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 18:51:00.132389 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.132394    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d7f96496-qj6wt: secret "image-registry-tls" not found
Sep 15 18:51:00.132798 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.132499    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls podName:64d6f33e-4c4f-469b-93de-6cbd3c6e2c06 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:00.632471296 +0000 UTC m=+35.580699614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls") pod "image-registry-86d7f96496-qj6wt" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06") : secret "image-registry-tls" not found
Sep 15 18:51:00.132798 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.132753    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-ca-trust-extracted\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.133250 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.133221    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-certificates\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.133756 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.133733    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-trusted-ca\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.136984 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.136967    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-image-registry-private-configuration\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.137077 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.137002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-installation-pull-secrets\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.142331 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.142309    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-bound-sa-token\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.142698 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.142675    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6wh\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-kube-api-access-sz6wh\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.150667 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.150628    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.213334 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.213305    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pntg8"]
Sep 15 18:51:00.215631 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.215610    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.217515 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.217475    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 18:51:00.217612 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.217553    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vcddk\""
Sep 15 18:51:00.217709 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.217684    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 18:51:00.227489 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.227469    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pntg8"]
Sep 15 18:51:00.231405 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.231380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.285607 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.285588    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5nk72"]
Sep 15 18:51:00.287135 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.287122    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5nk72"
Sep 15 18:51:00.289057 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.289035    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 18:51:00.289057 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.289049    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 18:51:00.289198 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.289040    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 18:51:00.289251 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.289199    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6fg9f\""
Sep 15 18:51:00.295749 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.295733    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5nk72"]
Sep 15 18:51:00.333975 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.333951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8smzm\" (UniqueName: \"kubernetes.io/projected/8a7de796-7968-4885-a149-1b9fdcb8ead3-kube-api-access-8smzm\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.334087 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.334020    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.334087 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.334067    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7de796-7968-4885-a149-1b9fdcb8ead3-config-volume\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.334180 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.334112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7de796-7968-4885-a149-1b9fdcb8ead3-tmp-dir\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.341983 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.341949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.396723 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.396666    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.434841 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.434822    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7de796-7968-4885-a149-1b9fdcb8ead3-tmp-dir\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.434959 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.434864    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smzm\" (UniqueName: \"kubernetes.io/projected/8a7de796-7968-4885-a149-1b9fdcb8ead3-kube-api-access-8smzm\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.434959 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.434902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.434959 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.434919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01df7f55-d8f9-4e3b-8633-91fa6c8de669-cert\") pod \"ingress-canary-5nk72\" (UID: \"01df7f55-d8f9-4e3b-8633-91fa6c8de669\") " pod="openshift-ingress-canary/ingress-canary-5nk72"
Sep 15 18:51:00.434959 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.434948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49227\" (UniqueName: \"kubernetes.io/projected/01df7f55-d8f9-4e3b-8633-91fa6c8de669-kube-api-access-49227\") pod \"ingress-canary-5nk72\" (UID: \"01df7f55-d8f9-4e3b-8633-91fa6c8de669\") " pod="openshift-ingress-canary/ingress-canary-5nk72"
Sep 15 18:51:00.435170 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.434971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7de796-7968-4885-a149-1b9fdcb8ead3-config-volume\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.435170 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.435046    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 18:51:00.435267 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.435186    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7de796-7968-4885-a149-1b9fdcb8ead3-tmp-dir\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.435267 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.435218    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls podName:8a7de796-7968-4885-a149-1b9fdcb8ead3 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:00.935196664 +0000 UTC m=+35.883424989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls") pod "dns-default-pntg8" (UID: "8a7de796-7968-4885-a149-1b9fdcb8ead3") : secret "dns-default-metrics-tls" not found
Sep 15 18:51:00.435489 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.435472    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7de796-7968-4885-a149-1b9fdcb8ead3-config-volume\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.445376 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.445346    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8smzm\" (UniqueName: \"kubernetes.io/projected/8a7de796-7968-4885-a149-1b9fdcb8ead3-kube-api-access-8smzm\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.532524 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.532501    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.535558 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.535533    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01df7f55-d8f9-4e3b-8633-91fa6c8de669-cert\") pod \"ingress-canary-5nk72\" (UID: \"01df7f55-d8f9-4e3b-8633-91fa6c8de669\") " pod="openshift-ingress-canary/ingress-canary-5nk72"
Sep 15 18:51:00.535655 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.535569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49227\" (UniqueName: \"kubernetes.io/projected/01df7f55-d8f9-4e3b-8633-91fa6c8de669-kube-api-access-49227\") pod \"ingress-canary-5nk72\" (UID: \"01df7f55-d8f9-4e3b-8633-91fa6c8de669\") " pod="openshift-ingress-canary/ingress-canary-5nk72"
Sep 15 18:51:00.539401 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.538978    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01df7f55-d8f9-4e3b-8633-91fa6c8de669-cert\") pod \"ingress-canary-5nk72\" (UID: \"01df7f55-d8f9-4e3b-8633-91fa6c8de669\") " pod="openshift-ingress-canary/ingress-canary-5nk72"
Sep 15 18:51:00.544552 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.544525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49227\" (UniqueName: \"kubernetes.io/projected/01df7f55-d8f9-4e3b-8633-91fa6c8de669-kube-api-access-49227\") pod \"ingress-canary-5nk72\" (UID: \"01df7f55-d8f9-4e3b-8633-91fa6c8de669\") " pod="openshift-ingress-canary/ingress-canary-5nk72"
Sep 15 18:51:00.551390 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.551366    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:51:00.551469 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.551369    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:51:00.553354 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.553328    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 18:51:00.553680 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.553400    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 18:51:00.553680 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.553403    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 18:51:00.553680 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.553401    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4h8bk\""
Sep 15 18:51:00.595397 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.595379    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5nk72"
Sep 15 18:51:00.637747 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.636907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:00.637747 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.637163    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 18:51:00.637747 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.637182    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d7f96496-qj6wt: secret "image-registry-tls" not found
Sep 15 18:51:00.637747 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.637250    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls podName:64d6f33e-4c4f-469b-93de-6cbd3c6e2c06 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:01.637229726 +0000 UTC m=+36.585458034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls") pod "image-registry-86d7f96496-qj6wt" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06") : secret "image-registry-tls" not found
Sep 15 18:51:00.780883 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.780860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.830242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.830217    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:00.876587 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.876564    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5nk72"]
Sep 15 18:51:00.880076 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:00.880051    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01df7f55_d8f9_4e3b_8633_91fa6c8de669.slice/crio-d615bd47df0501c8e22233898ec3aba9b74131c33a5d830783acb36c98f73289 WatchSource:0}: Error finding container d615bd47df0501c8e22233898ec3aba9b74131c33a5d830783acb36c98f73289: Status 404 returned error can't find the container with id d615bd47df0501c8e22233898ec3aba9b74131c33a5d830783acb36c98f73289
Sep 15 18:51:00.939714 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:00.939687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:00.939882 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.939853    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 18:51:00.939985 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:00.939918    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls podName:8a7de796-7968-4885-a149-1b9fdcb8ead3 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:01.93990182 +0000 UTC m=+36.888130124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls") pod "dns-default-pntg8" (UID: "8a7de796-7968-4885-a149-1b9fdcb8ead3") : secret "dns-default-metrics-tls" not found
Sep 15 18:51:01.193392 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.193320    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:01.245763 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.245722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:01.555125 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.555055    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:51:01.557142 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.557119    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 18:51:01.557270 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.557198    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gnvqj\""
Sep 15 18:51:01.645793 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.645765    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:01.645943 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:01.645920    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 18:51:01.645943 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:01.645940    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d7f96496-qj6wt: secret "image-registry-tls" not found
Sep 15 18:51:01.646048 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:01.646008    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls podName:64d6f33e-4c4f-469b-93de-6cbd3c6e2c06 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:03.645987949 +0000 UTC m=+38.594216258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls") pod "image-registry-86d7f96496-qj6wt" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06") : secret "image-registry-tls" not found
Sep 15 18:51:01.754624 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.754583    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5nk72" event={"ID":"01df7f55-d8f9-4e3b-8633-91fa6c8de669","Type":"ContainerStarted","Data":"d615bd47df0501c8e22233898ec3aba9b74131c33a5d830783acb36c98f73289"}
Sep 15 18:51:01.947729 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.947698    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:01.947928 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:01.947861    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 18:51:01.948007 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:01.947932    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls podName:8a7de796-7968-4885-a149-1b9fdcb8ead3 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:03.947913623 +0000 UTC m=+38.896141942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls") pod "dns-default-pntg8" (UID: "8a7de796-7968-4885-a149-1b9fdcb8ead3") : secret "dns-default-metrics-tls" not found
Sep 15 18:51:01.983935 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:01.983903    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:02.379156 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:02.379060    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:02.434326 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:02.434287    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:03.660778 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:03.660742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:03.661164 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:03.660929    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 18:51:03.661164 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:03.660950    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d7f96496-qj6wt: secret "image-registry-tls" not found
Sep 15 18:51:03.661164 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:03.661018    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls podName:64d6f33e-4c4f-469b-93de-6cbd3c6e2c06 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:07.660998396 +0000 UTC m=+42.609226714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls") pod "image-registry-86d7f96496-qj6wt" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06") : secret "image-registry-tls" not found
Sep 15 18:51:03.962793 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:03.962767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:03.962954 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:03.962933    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 18:51:03.963016 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:03.963007    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls podName:8a7de796-7968-4885-a149-1b9fdcb8ead3 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:07.962987778 +0000 UTC m=+42.911216083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls") pod "dns-default-pntg8" (UID: "8a7de796-7968-4885-a149-1b9fdcb8ead3") : secret "dns-default-metrics-tls" not found
Sep 15 18:51:03.964123 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:03.964098    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:04.063960 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:04.063926    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:04.764040 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:04.764001    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5nk72" event={"ID":"01df7f55-d8f9-4e3b-8633-91fa6c8de669","Type":"ContainerStarted","Data":"4b75eaa8f0db78386793fdae78932417a5d307e8097112a1547436ae4d8093eb"}
Sep 15 18:51:04.767234 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:04.767204    2572 generic.go:356] "Generic (PLEG): container finished" podID="e2c60d2c-6078-48ea-ae82-1f246ce0da13" containerID="f404b9bcd54cbe595074cfbca02131c62ff376010ae875cf1b47d405e7f72217" exitCode=0
Sep 15 18:51:04.767366 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:04.767257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerDied","Data":"f404b9bcd54cbe595074cfbca02131c62ff376010ae875cf1b47d405e7f72217"}
Sep 15 18:51:04.778771 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:04.778720    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5nk72" podStartSLOduration=1.7320128449999999 podStartE2EDuration="4.77870146s" totalImagesPullingTime="3.046688615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:04.777972433 +0000 UTC m=+39.726200760" watchObservedRunningTime="2026-09-15 18:51:04.77870146 +0000 UTC m=+39.726929768"
Sep 15 18:51:05.772350 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:05.772315    2572 generic.go:356] "Generic (PLEG): container finished" podID="e2c60d2c-6078-48ea-ae82-1f246ce0da13" containerID="b8aa0cd88ff5d13f980be4807c09282325d6fc04a48fc928bc5db9dfa08d8565" exitCode=0
Sep 15 18:51:05.772823 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:05.772386    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerDied","Data":"b8aa0cd88ff5d13f980be4807c09282325d6fc04a48fc928bc5db9dfa08d8565"}
Sep 15 18:51:06.778273 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:06.778236    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2grv" event={"ID":"e2c60d2c-6078-48ea-ae82-1f246ce0da13","Type":"ContainerStarted","Data":"47d8006c47121fa022c56cad4dbaa052afad96f100e9c53fcc55e5ba09e0aac5"}
Sep 15 18:51:06.797483 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:06.797439    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x2grv" podStartSLOduration=11.632089113 podStartE2EDuration="40.797424628s" totalImagesPullingTime="29.165335515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:06.796152407 +0000 UTC m=+41.744380733" watchObservedRunningTime="2026-09-15 18:51:06.797424628 +0000 UTC m=+41.745652953"
Sep 15 18:51:06.916048 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:06.916018    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:07.016513 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:07.016487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:07.687946 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:07.687912    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:07.688090 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:07.688041    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 18:51:07.688090 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:07.688056    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d7f96496-qj6wt: secret "image-registry-tls" not found
Sep 15 18:51:07.688168 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:07.688114    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls podName:64d6f33e-4c4f-469b-93de-6cbd3c6e2c06 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:15.688096364 +0000 UTC m=+50.636324677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls") pod "image-registry-86d7f96496-qj6wt" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06") : secret "image-registry-tls" not found
Sep 15 18:51:07.989930 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:07.989862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:07.990240 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:07.989996    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 18:51:07.990240 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:07.990049    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls podName:8a7de796-7968-4885-a149-1b9fdcb8ead3 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:15.990033935 +0000 UTC m=+50.938262240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls") pod "dns-default-pntg8" (UID: "8a7de796-7968-4885-a149-1b9fdcb8ead3") : secret "dns-default-metrics-tls" not found
Sep 15 18:51:08.581741 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.581711    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp"]
Sep 15 18:51:08.605500 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.605472    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz"]
Sep 15 18:51:08.605626 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.605592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp"
Sep 15 18:51:08.608898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.608874    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zvfrp\""
Sep 15 18:51:08.621489 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.621466    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"]
Sep 15 18:51:08.621597 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.621578    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz"
Sep 15 18:51:08.623660 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.623640    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-85wrs\""
Sep 15 18:51:08.623752 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.623663    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 18:51:08.623752 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.623728    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:51:08.643508 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.643488    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"]
Sep 15 18:51:08.643618 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.643592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.645762 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.645746    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:51:08.645876 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.645826    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 15 18:51:08.645876 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.645868    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fc9t2\""
Sep 15 18:51:08.645999 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.645902    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 15 18:51:08.645999 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.645940    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 15 18:51:08.661614 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.661597    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp"]
Sep 15 18:51:08.661702 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.661623    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz"]
Sep 15 18:51:08.661702 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.661637    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"]
Sep 15 18:51:08.661702 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.661649    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"]
Sep 15 18:51:08.661702 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.661694    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:08.663774 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.663758    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 15 18:51:08.663774 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.663765    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mggnz\""
Sep 15 18:51:08.663913 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.663769    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:51:08.664098 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.664082    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 15 18:51:08.680248 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.680225    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"]
Sep 15 18:51:08.697779 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.697763    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"]
Sep 15 18:51:08.697875 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.697865    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:08.701497 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.700716    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 15 18:51:08.701497 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.700711    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2zgqm\""
Sep 15 18:51:08.701497 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.700982    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 15 18:51:08.723835 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.723800    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"]
Sep 15 18:51:08.723948 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.723846    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"]
Sep 15 18:51:08.723948 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.723861    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-5j4nh"]
Sep 15 18:51:08.723948 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.723929    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:08.725994 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.725941    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 15 18:51:08.726117 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.725960    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-blkh6\""
Sep 15 18:51:08.726117 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.726004    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 18:51:08.726230 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.726120    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 18:51:08.727068 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.727047    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 15 18:51:08.747816 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.747788    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79988fc9d-2hkvw"]
Sep 15 18:51:08.747897 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.747870    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:08.749635 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.749619    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 15 18:51:08.749962 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.749945    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qgvx9\""
Sep 15 18:51:08.750045 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.750020    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:51:08.750098 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.750052    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 15 18:51:08.750148 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.750101    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 15 18:51:08.754700 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.754683    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 15 18:51:08.771980 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.771961    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-5j4nh"]
Sep 15 18:51:08.772045 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.771986    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79988fc9d-2hkvw"]
Sep 15 18:51:08.772088 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.772052    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:08.774107 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.774091    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 15 18:51:08.774494 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.774472    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 15 18:51:08.774577 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.774487    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 18:51:08.774577 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.774523    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 15 18:51:08.774875 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.774859    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 15 18:51:08.774940 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.774884    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 18:51:08.774940 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.774863    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ct7sj\""
Sep 15 18:51:08.784901 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.784880    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"]
Sep 15 18:51:08.796100 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46d4w\" (UniqueName: \"kubernetes.io/projected/f7247b78-45ba-41f1-8c20-18e98be8919d-kube-api-access-46d4w\") pod \"network-check-source-6f8b768455-dcfqp\" (UID: \"f7247b78-45ba-41f1-8c20-18e98be8919d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp"
Sep 15 18:51:08.796195 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:08.796195 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d35fd842-e79c-413f-a16a-5d3c762a540e-serving-cert\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.796195 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796188    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:08.796326 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796242    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:08.796326 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d35fd842-e79c-413f-a16a-5d3c762a540e-config\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.796326 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796294    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p6qn\" (UniqueName: \"kubernetes.io/projected/d35fd842-e79c-413f-a16a-5d3c762a540e-kube-api-access-5p6qn\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.796479 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796326    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kldj\" (UniqueName: \"kubernetes.io/projected/2fd39fb6-e22e-44cd-b437-62da746705b7-kube-api-access-2kldj\") pod \"volume-data-source-validator-86695b7cc7-2sbnz\" (UID: \"2fd39fb6-e22e-44cd-b437-62da746705b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz"
Sep 15 18:51:08.796479 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.796349    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrnd\" (UniqueName: \"kubernetes.io/projected/a8196193-e95a-4452-81c2-f57e72d7a10f-kube-api-access-hhrnd\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:08.808065 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.808050    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"]
Sep 15 18:51:08.808140 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.808109    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:08.810020 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.809999    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 15 18:51:08.810135 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.810082    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 15 18:51:08.810200 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.810114    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 15 18:51:08.810200 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.810143    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nklps\""
Sep 15 18:51:08.810304 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.810268    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:51:08.824219 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.824200    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:08.885438 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.885390    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-b7x59"]
Sep 15 18:51:08.886787 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.886769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:08.897496 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897477    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:08.897569 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897509    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-default-certificate\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:08.897569 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-serving-cert\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:08.897569 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:08.897723 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:08.897614    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 18:51:08.897723 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:08.897617    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 18:51:08.897723 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897653    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d35fd842-e79c-413f-a16a-5d3c762a540e-config\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.897723 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:08.897661    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls podName:a8196193-e95a-4452-81c2-f57e72d7a10f nodeName:}" failed. No retries permitted until 2026-09-15 18:51:09.397648632 +0000 UTC m=+44.345876937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pgw4v" (UID: "a8196193-e95a-4452-81c2-f57e72d7a10f") : secret "samples-operator-tls" not found
Sep 15 18:51:08.897723 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:08.897687    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert podName:bd7bfb06-40d9-4a17-bb64-bb61eb77901b nodeName:}" failed. No retries permitted until 2026-09-15 18:51:09.397673886 +0000 UTC m=+44.345902190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-2zgjc" (UID: "bd7bfb06-40d9-4a17-bb64-bb61eb77901b") : secret "networking-console-plugin-cert" not found
Sep 15 18:51:08.897723 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-config\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:08.897723 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kldj\" (UniqueName: \"kubernetes.io/projected/2fd39fb6-e22e-44cd-b437-62da746705b7-kube-api-access-2kldj\") pod \"volume-data-source-validator-86695b7cc7-2sbnz\" (UID: \"2fd39fb6-e22e-44cd-b437-62da746705b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897742    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897762    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-stats-auth\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897778    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r79tf\" (UniqueName: \"kubernetes.io/projected/af5b55b6-64de-4833-8abe-2a0b0f5ba519-kube-api-access-r79tf\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897903    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d35fd842-e79c-413f-a16a-5d3c762a540e-serving-cert\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.897975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbk6c\" (UniqueName: \"kubernetes.io/projected/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-kube-api-access-mbk6c\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898008    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898032    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p6qn\" (UniqueName: \"kubernetes.io/projected/d35fd842-e79c-413f-a16a-5d3c762a540e-kube-api-access-5p6qn\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898058    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-trusted-ca\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:08.898096 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898092    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:08.898489 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898145    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrnd\" (UniqueName: \"kubernetes.io/projected/a8196193-e95a-4452-81c2-f57e72d7a10f-kube-api-access-hhrnd\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:08.898489 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898185    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5h98\" (UniqueName: \"kubernetes.io/projected/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-kube-api-access-p5h98\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:08.898489 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898208    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:08.898489 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898213    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d35fd842-e79c-413f-a16a-5d3c762a540e-config\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.898489 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46d4w\" (UniqueName: \"kubernetes.io/projected/f7247b78-45ba-41f1-8c20-18e98be8919d-kube-api-access-46d4w\") pod \"network-check-source-6f8b768455-dcfqp\" (UID: \"f7247b78-45ba-41f1-8c20-18e98be8919d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp"
Sep 15 18:51:08.898683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.898526    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:08.900085 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.900067    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:08.901304 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.901282    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d35fd842-e79c-413f-a16a-5d3c762a540e-serving-cert\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.902446 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.902430    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 15 18:51:08.902749 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.902725    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9pg8d\""
Sep 15 18:51:08.902749 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.902734    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 18:51:08.903508 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.903492    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 18:51:08.904212 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.904193    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 15 18:51:08.915260 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.915238    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-b7x59"]
Sep 15 18:51:08.917892 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.916980    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kldj\" (UniqueName: \"kubernetes.io/projected/2fd39fb6-e22e-44cd-b437-62da746705b7-kube-api-access-2kldj\") pod \"volume-data-source-validator-86695b7cc7-2sbnz\" (UID: \"2fd39fb6-e22e-44cd-b437-62da746705b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz"
Sep 15 18:51:08.917892 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.916996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p6qn\" (UniqueName: \"kubernetes.io/projected/d35fd842-e79c-413f-a16a-5d3c762a540e-kube-api-access-5p6qn\") pod \"service-ca-operator-cf7c776b7-kfxkw\" (UID: \"d35fd842-e79c-413f-a16a-5d3c762a540e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.917892 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.917219    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46d4w\" (UniqueName: \"kubernetes.io/projected/f7247b78-45ba-41f1-8c20-18e98be8919d-kube-api-access-46d4w\") pod \"network-check-source-6f8b768455-dcfqp\" (UID: \"f7247b78-45ba-41f1-8c20-18e98be8919d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp"
Sep 15 18:51:08.917892 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.917303    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrnd\" (UniqueName: \"kubernetes.io/projected/a8196193-e95a-4452-81c2-f57e72d7a10f-kube-api-access-hhrnd\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:08.920628 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.920395    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 15 18:51:08.929870 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.929852    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz"
Sep 15 18:51:08.951040 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.951007    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"
Sep 15 18:51:08.980392 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.980370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:08.999278 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999237    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5880853-f8ef-48cc-af5a-47ed879d1cbf-tmp\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5h98\" (UniqueName: \"kubernetes.io/projected/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-kube-api-access-p5h98\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999338    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5880853-f8ef-48cc-af5a-47ed879d1cbf-trusted-ca-bundle\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999463    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-default-certificate\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:08.999479    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:09.499459371 +0000 UTC m=+44.447687719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : configmap references non-existent config key: service-ca.crt
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-serving-cert\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999538    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7kt\" (UniqueName: \"kubernetes.io/projected/d894b34b-bb7a-410e-b2d4-a575f914a913-kube-api-access-4v7kt\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999567    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5880853-f8ef-48cc-af5a-47ed879d1cbf-service-ca-bundle\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999594    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp558\" (UniqueName: \"kubernetes.io/projected/f5880853-f8ef-48cc-af5a-47ed879d1cbf-kube-api-access-pp558\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:08.999683 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999657    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-config\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999699    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999781    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d894b34b-bb7a-410e-b2d4-a575f914a913-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-stats-auth\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999874    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r79tf\" (UniqueName: \"kubernetes.io/projected/af5b55b6-64de-4833-8abe-2a0b0f5ba519-kube-api-access-r79tf\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:08.999949    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:08.999972    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbk6c\" (UniqueName: \"kubernetes.io/projected/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-kube-api-access-mbk6c\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.000000    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:09.499984457 +0000 UTC m=+44.448212764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : secret "router-metrics-certs-default" not found
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.000052    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.000081    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f5880853-f8ef-48cc-af5a-47ed879d1cbf-snapshots\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.000106    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5880853-f8ef-48cc-af5a-47ed879d1cbf-serving-cert\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.000134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-trusted-ca\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:09.000221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.000160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:09.000861 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.000224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d894b34b-bb7a-410e-b2d4-a575f914a913-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.000861 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.000365    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:09.000861 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.000411    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls podName:7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:09.50039664 +0000 UTC m=+44.448624965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-bq8tq" (UID: "7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60") : secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:09.000861 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.000413    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-config\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:09.001059 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.001002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:09.001223 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.001201    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-trusted-ca\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:09.002520 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.002490    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-default-certificate\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:09.002735 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.002716    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-stats-auth\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:09.003373 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.003331    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-serving-cert\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:09.009292 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.009267    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbk6c\" (UniqueName: \"kubernetes.io/projected/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-kube-api-access-mbk6c\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:09.010085 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.009964    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5h98\" (UniqueName: \"kubernetes.io/projected/5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3-kube-api-access-p5h98\") pod \"console-operator-696884fb9c-5j4nh\" (UID: \"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3\") " pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:09.010768 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.010743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r79tf\" (UniqueName: \"kubernetes.io/projected/af5b55b6-64de-4833-8abe-2a0b0f5ba519-kube-api-access-r79tf\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:09.055907 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.055886    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:09.081502 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.081477    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:09.100853 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.100834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f5880853-f8ef-48cc-af5a-47ed879d1cbf-snapshots\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.100931 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.100860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5880853-f8ef-48cc-af5a-47ed879d1cbf-serving-cert\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.100931 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.100891    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d894b34b-bb7a-410e-b2d4-a575f914a913-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.100931 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.100913    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5880853-f8ef-48cc-af5a-47ed879d1cbf-tmp\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.101047 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.100968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5880853-f8ef-48cc-af5a-47ed879d1cbf-trusted-ca-bundle\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.101047 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.100988    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7kt\" (UniqueName: \"kubernetes.io/projected/d894b34b-bb7a-410e-b2d4-a575f914a913-kube-api-access-4v7kt\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.101047 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.101010    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5880853-f8ef-48cc-af5a-47ed879d1cbf-service-ca-bundle\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.101047 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.101034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp558\" (UniqueName: \"kubernetes.io/projected/f5880853-f8ef-48cc-af5a-47ed879d1cbf-kube-api-access-pp558\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.101184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.101105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d894b34b-bb7a-410e-b2d4-a575f914a913-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.101543 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.101498    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f5880853-f8ef-48cc-af5a-47ed879d1cbf-snapshots\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.101872 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.101745    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d894b34b-bb7a-410e-b2d4-a575f914a913-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.101872 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.101801    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5880853-f8ef-48cc-af5a-47ed879d1cbf-tmp\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.102002 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.101984    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5880853-f8ef-48cc-af5a-47ed879d1cbf-trusted-ca-bundle\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.102047 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.102010    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5880853-f8ef-48cc-af5a-47ed879d1cbf-service-ca-bundle\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.103084 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.103065    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d894b34b-bb7a-410e-b2d4-a575f914a913-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.103555 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.103534    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5880853-f8ef-48cc-af5a-47ed879d1cbf-serving-cert\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.109113 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.109084    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7kt\" (UniqueName: \"kubernetes.io/projected/d894b34b-bb7a-410e-b2d4-a575f914a913-kube-api-access-4v7kt\") pod \"kube-storage-version-migrator-operator-6c8f84f897-2pj2t\" (UID: \"d894b34b-bb7a-410e-b2d4-a575f914a913\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.109304 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.109287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp558\" (UniqueName: \"kubernetes.io/projected/f5880853-f8ef-48cc-af5a-47ed879d1cbf-kube-api-access-pp558\") pod \"insights-operator-5844b856db-b7x59\" (UID: \"f5880853-f8ef-48cc-af5a-47ed879d1cbf\") " pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.115174 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.115152    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"
Sep 15 18:51:09.213435 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.213408    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-b7x59"
Sep 15 18:51:09.216553 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.216533    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp"
Sep 15 18:51:09.225473 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.225454    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz"]
Sep 15 18:51:09.227642 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:09.227622    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd39fb6_e22e_44cd_b437_62da746705b7.slice/crio-071f6dd9db8180c847517b5dfa609060915584f87ef2d1e489e6cafaa9fc8f9c WatchSource:0}: Error finding container 071f6dd9db8180c847517b5dfa609060915584f87ef2d1e489e6cafaa9fc8f9c: Status 404 returned error can't find the container with id 071f6dd9db8180c847517b5dfa609060915584f87ef2d1e489e6cafaa9fc8f9c
Sep 15 18:51:09.248006 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.247986    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw"]
Sep 15 18:51:09.250732 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:09.250712    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35fd842_e79c_413f_a16a_5d3c762a540e.slice/crio-2195537ee5f29676e7a94665939e278c544ae07496dd74e4dde34560d9a18fd9 WatchSource:0}: Error finding container 2195537ee5f29676e7a94665939e278c544ae07496dd74e4dde34560d9a18fd9: Status 404 returned error can't find the container with id 2195537ee5f29676e7a94665939e278c544ae07496dd74e4dde34560d9a18fd9
Sep 15 18:51:09.352856 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.352829    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-5j4nh"]
Sep 15 18:51:09.355471 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:09.355444    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efaf851_b1f7_477c_b7ec_c7ff8aabd0f3.slice/crio-5d5233f57e195e8ae488960846f66f35a479be9f15bb2fedb90e33abe635c970 WatchSource:0}: Error finding container 5d5233f57e195e8ae488960846f66f35a479be9f15bb2fedb90e33abe635c970: Status 404 returned error can't find the container with id 5d5233f57e195e8ae488960846f66f35a479be9f15bb2fedb90e33abe635c970
Sep 15 18:51:09.399280 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.399231    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t"]
Sep 15 18:51:09.401669 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:09.401641    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd894b34b_bb7a_410e_b2d4_a575f914a913.slice/crio-fb65b1b58822783f84c83819a79f7961a4181db1d3fd338ff307a385d763fb59 WatchSource:0}: Error finding container fb65b1b58822783f84c83819a79f7961a4181db1d3fd338ff307a385d763fb59: Status 404 returned error can't find the container with id fb65b1b58822783f84c83819a79f7961a4181db1d3fd338ff307a385d763fb59
Sep 15 18:51:09.404486 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.404080    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:09.404486 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.404131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:09.404486 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.404321    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 18:51:09.404486 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.404371    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls podName:a8196193-e95a-4452-81c2-f57e72d7a10f nodeName:}" failed. No retries permitted until 2026-09-15 18:51:10.404353768 +0000 UTC m=+45.352582089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pgw4v" (UID: "a8196193-e95a-4452-81c2-f57e72d7a10f") : secret "samples-operator-tls" not found
Sep 15 18:51:09.404644 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.404495    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 18:51:09.404644 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.404547    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert podName:bd7bfb06-40d9-4a17-bb64-bb61eb77901b nodeName:}" failed. No retries permitted until 2026-09-15 18:51:10.404533046 +0000 UTC m=+45.352761349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-2zgjc" (UID: "bd7bfb06-40d9-4a17-bb64-bb61eb77901b") : secret "networking-console-plugin-cert" not found
Sep 15 18:51:09.500554 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.500532    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-b7x59"]
Sep 15 18:51:09.503247 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:09.503224    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5880853_f8ef_48cc_af5a_47ed879d1cbf.slice/crio-50be548cb9f2ee548361341a79fbcef6207e0d889bdc9e67d51ff3d3f5e711f7 WatchSource:0}: Error finding container 50be548cb9f2ee548361341a79fbcef6207e0d889bdc9e67d51ff3d3f5e711f7: Status 404 returned error can't find the container with id 50be548cb9f2ee548361341a79fbcef6207e0d889bdc9e67d51ff3d3f5e711f7
Sep 15 18:51:09.504495 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.504477    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:09.504583 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.504531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:09.504626 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.504606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:09.504696 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.504627    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:09.504696 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.504675    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls podName:7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:10.504661329 +0000 UTC m=+45.452889642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-bq8tq" (UID: "7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60") : secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:09.504823 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.504716    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:10.504703758 +0000 UTC m=+45.452932062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : configmap references non-existent config key: service-ca.crt
Sep 15 18:51:09.504823 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.504763    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 18:51:09.504823 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:09.504801    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:10.504791039 +0000 UTC m=+45.453019347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : secret "router-metrics-certs-default" not found
Sep 15 18:51:09.531112 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.531090    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp"]
Sep 15 18:51:09.533327 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:09.533310    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7247b78_45ba_41f1_8c20_18e98be8919d.slice/crio-8089ae0c0f5f52cc42abbbe3ce7cc0d38b3caf3fddd4997e37db6e766100c619 WatchSource:0}: Error finding container 8089ae0c0f5f52cc42abbbe3ce7cc0d38b3caf3fddd4997e37db6e766100c619: Status 404 returned error can't find the container with id 8089ae0c0f5f52cc42abbbe3ce7cc0d38b3caf3fddd4997e37db6e766100c619
Sep 15 18:51:09.786370 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.786341    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz" event={"ID":"2fd39fb6-e22e-44cd-b437-62da746705b7","Type":"ContainerStarted","Data":"071f6dd9db8180c847517b5dfa609060915584f87ef2d1e489e6cafaa9fc8f9c"}
Sep 15 18:51:09.787342 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.787326    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" event={"ID":"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3","Type":"ContainerStarted","Data":"5d5233f57e195e8ae488960846f66f35a479be9f15bb2fedb90e33abe635c970"}
Sep 15 18:51:09.788318 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.788299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp" event={"ID":"f7247b78-45ba-41f1-8c20-18e98be8919d","Type":"ContainerStarted","Data":"8089ae0c0f5f52cc42abbbe3ce7cc0d38b3caf3fddd4997e37db6e766100c619"}
Sep 15 18:51:09.789417 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.789397    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t" event={"ID":"d894b34b-bb7a-410e-b2d4-a575f914a913","Type":"ContainerStarted","Data":"fb65b1b58822783f84c83819a79f7961a4181db1d3fd338ff307a385d763fb59"}
Sep 15 18:51:09.790433 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.790416    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw" event={"ID":"d35fd842-e79c-413f-a16a-5d3c762a540e","Type":"ContainerStarted","Data":"2195537ee5f29676e7a94665939e278c544ae07496dd74e4dde34560d9a18fd9"}
Sep 15 18:51:09.791358 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:09.791342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-b7x59" event={"ID":"f5880853-f8ef-48cc-af5a-47ed879d1cbf","Type":"ContainerStarted","Data":"50be548cb9f2ee548361341a79fbcef6207e0d889bdc9e67d51ff3d3f5e711f7"}
Sep 15 18:51:10.413188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:10.413150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:10.413647 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:10.413210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:10.413647 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.413351    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 18:51:10.413647 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.413417    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 18:51:10.413647 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.413431    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls podName:a8196193-e95a-4452-81c2-f57e72d7a10f nodeName:}" failed. No retries permitted until 2026-09-15 18:51:12.413410688 +0000 UTC m=+47.361639009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pgw4v" (UID: "a8196193-e95a-4452-81c2-f57e72d7a10f") : secret "samples-operator-tls" not found
Sep 15 18:51:10.413647 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.413483    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert podName:bd7bfb06-40d9-4a17-bb64-bb61eb77901b nodeName:}" failed. No retries permitted until 2026-09-15 18:51:12.413465344 +0000 UTC m=+47.361693655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-2zgjc" (UID: "bd7bfb06-40d9-4a17-bb64-bb61eb77901b") : secret "networking-console-plugin-cert" not found
Sep 15 18:51:10.514956 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:10.513800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:10.514956 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:10.513919    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:10.514956 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:10.513998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:10.514956 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.514166    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 18:51:10.514956 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.514228    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:12.514211198 +0000 UTC m=+47.462439526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : secret "router-metrics-certs-default" not found
Sep 15 18:51:10.514956 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.514594    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:10.514956 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.514645    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls podName:7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:12.514629984 +0000 UTC m=+47.462858291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-bq8tq" (UID: "7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60") : secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:10.514956 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:10.514711    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:12.514701089 +0000 UTC m=+47.462929395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : configmap references non-existent config key: service-ca.crt
Sep 15 18:51:11.801254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:11.801205    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz" event={"ID":"2fd39fb6-e22e-44cd-b437-62da746705b7","Type":"ContainerStarted","Data":"a985e84afe3280868a50f9c67086c6f0d5c18e0f15563b9824f7f925ed71484f"}
Sep 15 18:51:11.815322 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:11.815249    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-2sbnz" podStartSLOduration=2.088235631 podStartE2EDuration="3.815226562s" totalImagesPullingTime="1.726990931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:11.814173808 +0000 UTC m=+46.762402135" watchObservedRunningTime="2026-09-15 18:51:11.815226562 +0000 UTC m=+46.763454890"
Sep 15 18:51:11.908265 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:11.908169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:11.966161 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:11.966134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:12.431775 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:12.431729    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:12.431941 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:12.431795    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:12.431941 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.431907    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 18:51:12.432027 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.431985    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert podName:bd7bfb06-40d9-4a17-bb64-bb61eb77901b nodeName:}" failed. No retries permitted until 2026-09-15 18:51:16.431966285 +0000 UTC m=+51.380194596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-2zgjc" (UID: "bd7bfb06-40d9-4a17-bb64-bb61eb77901b") : secret "networking-console-plugin-cert" not found
Sep 15 18:51:12.432027 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.431915    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 18:51:12.432127 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.432057    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls podName:a8196193-e95a-4452-81c2-f57e72d7a10f nodeName:}" failed. No retries permitted until 2026-09-15 18:51:16.432041732 +0000 UTC m=+51.380270044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pgw4v" (UID: "a8196193-e95a-4452-81c2-f57e72d7a10f") : secret "samples-operator-tls" not found
Sep 15 18:51:12.532395 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:12.532365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:12.532531 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:12.532429    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:12.532531 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:12.532483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:12.532620 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.532532    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:16.532514921 +0000 UTC m=+51.480743225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : configmap references non-existent config key: service-ca.crt
Sep 15 18:51:12.532620 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.532583    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 18:51:12.532697 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.532645    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:16.532632776 +0000 UTC m=+51.480861079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : secret "router-metrics-certs-default" not found
Sep 15 18:51:12.532697 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.532583    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:12.532697 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:12.532678    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls podName:7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:16.532672407 +0000 UTC m=+51.480900711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-bq8tq" (UID: "7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60") : secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:14.672879 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:14.672836    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:14.728697 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:14.728666    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:15.590436 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.590383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:15.641999 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.641977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:15.761533 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.761506    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:15.761914 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:15.761856    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 18:51:15.761914 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:15.761875    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d7f96496-qj6wt: secret "image-registry-tls" not found
Sep 15 18:51:15.762009 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:15.761924    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls podName:64d6f33e-4c4f-469b-93de-6cbd3c6e2c06 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:31.761906658 +0000 UTC m=+66.710135036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls") pod "image-registry-86d7f96496-qj6wt" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06") : secret "image-registry-tls" not found
Sep 15 18:51:15.814525 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.814488    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-b7x59" event={"ID":"f5880853-f8ef-48cc-af5a-47ed879d1cbf","Type":"ContainerStarted","Data":"c13ee21149b574395281effa99f05a579e253577d798bbde914957b6deb6b5b0"}
Sep 15 18:51:15.816093 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.816069    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" event={"ID":"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3","Type":"ContainerStarted","Data":"4fa30846a0d0552903ce94a8809d166bda11753ce0eecd8af13fd865af0e01ff"}
Sep 15 18:51:15.816229 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.816207    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:15.821847 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.817876    2572 patch_prober.go:28] interesting pod/console-operator-696884fb9c-5j4nh container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body=
Sep 15 18:51:15.821847 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.817962    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podUID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused"
Sep 15 18:51:15.822258 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.822220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp" event={"ID":"f7247b78-45ba-41f1-8c20-18e98be8919d","Type":"ContainerStarted","Data":"bc4534e372281f1b2af739993b1bbff9282896cd9653354076ee0bd82c30ec90"}
Sep 15 18:51:15.824586 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.824562    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t" event={"ID":"d894b34b-bb7a-410e-b2d4-a575f914a913","Type":"ContainerStarted","Data":"6d0c603d82876e4328b8d8a8f811108fce52d51dcac130c3bbd5fe4dd18afcf6"}
Sep 15 18:51:15.826058 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.826037    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw" event={"ID":"d35fd842-e79c-413f-a16a-5d3c762a540e","Type":"ContainerStarted","Data":"8a871e7578c841e7adc5fa3e97ed6346a0f30a7439b8b71d821426c07a343b0e"}
Sep 15 18:51:15.831767 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.831725    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-b7x59" podStartSLOduration=1.773230203 podStartE2EDuration="7.831712288s" totalImagesPullingTime="6.058482085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:15.830714427 +0000 UTC m=+50.778942753" watchObservedRunningTime="2026-09-15 18:51:15.831712288 +0000 UTC m=+50.779940616"
Sep 15 18:51:15.845423 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.845235    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podStartSLOduration=1.6389657880000001 podStartE2EDuration="7.845219284s" totalImagesPullingTime="6.206253496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:15.844106039 +0000 UTC m=+50.792334366" watchObservedRunningTime="2026-09-15 18:51:15.845219284 +0000 UTC m=+50.793447611"
Sep 15 18:51:15.857488 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.857447    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t" podStartSLOduration=1.70009795 podStartE2EDuration="7.857419321s" totalImagesPullingTime="6.157321371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:15.857073987 +0000 UTC m=+50.805302314" watchObservedRunningTime="2026-09-15 18:51:15.857419321 +0000 UTC m=+50.805647649"
Sep 15 18:51:15.871455 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:15.871415    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw" podStartSLOduration=1.560537635 podStartE2EDuration="7.871398102s" totalImagesPullingTime="6.310860467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:15.869963962 +0000 UTC m=+50.818192288" watchObservedRunningTime="2026-09-15 18:51:15.871398102 +0000 UTC m=+50.819626430"
Sep 15 18:51:16.065564 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.065529    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:16.065670 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.065647    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 18:51:16.065721 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.065711    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls podName:8a7de796-7968-4885-a149-1b9fdcb8ead3 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:32.065694262 +0000 UTC m=+67.013922569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls") pod "dns-default-pntg8" (UID: "8a7de796-7968-4885-a149-1b9fdcb8ead3") : secret "dns-default-metrics-tls" not found
Sep 15 18:51:16.469439 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.469399    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:16.469615 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.469451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:16.469615 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.469571    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 18:51:16.469615 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.469592    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 18:51:16.469780 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.469656    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls podName:a8196193-e95a-4452-81c2-f57e72d7a10f nodeName:}" failed. No retries permitted until 2026-09-15 18:51:24.469634508 +0000 UTC m=+59.417862833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pgw4v" (UID: "a8196193-e95a-4452-81c2-f57e72d7a10f") : secret "samples-operator-tls" not found
Sep 15 18:51:16.469780 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.469675    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert podName:bd7bfb06-40d9-4a17-bb64-bb61eb77901b nodeName:}" failed. No retries permitted until 2026-09-15 18:51:24.469666062 +0000 UTC m=+59.417894367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-2zgjc" (UID: "bd7bfb06-40d9-4a17-bb64-bb61eb77901b") : secret "networking-console-plugin-cert" not found
Sep 15 18:51:16.570327 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.570293    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:16.570497 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.570356    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:16.570497 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.570406    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:16.570619 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.570496    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:24.570450857 +0000 UTC m=+59.518679179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : configmap references non-existent config key: service-ca.crt
Sep 15 18:51:16.570619 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.570507    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:16.570619 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.570522    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 18:51:16.570619 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.570547    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls podName:7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:24.570537014 +0000 UTC m=+59.518765319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-bq8tq" (UID: "7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60") : secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:16.570619 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.570574    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:24.570559657 +0000 UTC m=+59.518787969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : secret "router-metrics-certs-default" not found
Sep 15 18:51:16.832653 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.832572    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/0.log"
Sep 15 18:51:16.832653 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.832627    2572 generic.go:356] "Generic (PLEG): container finished" podID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3" containerID="4fa30846a0d0552903ce94a8809d166bda11753ce0eecd8af13fd865af0e01ff" exitCode=255
Sep 15 18:51:16.833499 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.833480    2572 scope.go:117] "RemoveContainer" containerID="4fa30846a0d0552903ce94a8809d166bda11753ce0eecd8af13fd865af0e01ff"
Sep 15 18:51:16.833680 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.833651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" event={"ID":"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3","Type":"ContainerDied","Data":"4fa30846a0d0552903ce94a8809d166bda11753ce0eecd8af13fd865af0e01ff"}
Sep 15 18:51:16.838020 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.837992    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b65x6"]
Sep 15 18:51:16.849165 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.849115    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-dcfqp" podStartSLOduration=2.811536126 podStartE2EDuration="8.849097276s" totalImagesPullingTime="6.03756115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:16.848960937 +0000 UTC m=+51.797189290" watchObservedRunningTime="2026-09-15 18:51:16.849097276 +0000 UTC m=+51.797325600"
Sep 15 18:51:16.854557 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.854527    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:16.854900 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.854871    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b65x6"]
Sep 15 18:51:16.855159 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.855136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.857269 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.857248    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 18:51:16.857472 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.857306    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pj5l2\""
Sep 15 18:51:16.857544 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.857328    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 18:51:16.875456 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.873418    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02baeeee-715d-447a-b611-0cb7ff968801-crio-socket\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.875456 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.873494    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02baeeee-715d-447a-b611-0cb7ff968801-data-volume\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.875456 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.873621    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.875456 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.873760    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.875456 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.873785    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-642lw\" (UniqueName: \"kubernetes.io/projected/02baeeee-715d-447a-b611-0cb7ff968801-kube-api-access-642lw\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.910270 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.910249    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:16.975146 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.975122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02baeeee-715d-447a-b611-0cb7ff968801-crio-socket\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.975281 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.975155    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02baeeee-715d-447a-b611-0cb7ff968801-data-volume\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.975281 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.975217    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.975281 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.975249    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02baeeee-715d-447a-b611-0cb7ff968801-crio-socket\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.975281 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.975259    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.975493 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.975284    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-642lw\" (UniqueName: \"kubernetes.io/projected/02baeeee-715d-447a-b611-0cb7ff968801-kube-api-access-642lw\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.975493 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.975325    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 18:51:16.975493 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.975371    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:16.975493 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.975388    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:17.475369516 +0000 UTC m=+52.423597841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : configmap "kube-rbac-proxy" not found
Sep 15 18:51:16.975493 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:16.975409    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:17.475398311 +0000 UTC m=+52.423626630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:16.975748 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.975536    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02baeeee-715d-447a-b611-0cb7ff968801-data-volume\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:16.982625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:16.982602    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-642lw\" (UniqueName: \"kubernetes.io/projected/02baeeee-715d-447a-b611-0cb7ff968801-kube-api-access-642lw\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:17.288998 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.288970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:17.348673 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.348641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:17.431204 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.431181    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:17.479708 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.479683    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:17.479822 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.479735    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:17.479871 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:17.479851    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:17.479919 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:17.479910    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:18.479896182 +0000 UTC m=+53.428124499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:17.479961 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:17.479930    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 18:51:17.479998 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:17.479975    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:18.479963784 +0000 UTC m=+53.428192089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : configmap "kube-rbac-proxy" not found
Sep 15 18:51:17.533760 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.533703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:17.582281 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.582197    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:17.843164 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.843101    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/1.log"
Sep 15 18:51:17.843507 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.843490    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/0.log"
Sep 15 18:51:17.843561 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.843527    2572 generic.go:356] "Generic (PLEG): container finished" podID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3" containerID="9cc47aa359747a0f31c7d333cbfd33694dc22fe95c8de0b9f495595858337bd8" exitCode=255
Sep 15 18:51:17.843613 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.843575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" event={"ID":"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3","Type":"ContainerDied","Data":"9cc47aa359747a0f31c7d333cbfd33694dc22fe95c8de0b9f495595858337bd8"}
Sep 15 18:51:17.843673 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.843659    2572 scope.go:117] "RemoveContainer" containerID="4fa30846a0d0552903ce94a8809d166bda11753ce0eecd8af13fd865af0e01ff"
Sep 15 18:51:17.843875 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.843858    2572 scope.go:117] "RemoveContainer" containerID="9cc47aa359747a0f31c7d333cbfd33694dc22fe95c8de0b9f495595858337bd8"
Sep 15 18:51:17.844076 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:17.844055    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-5j4nh_openshift-console-operator(5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3)\"" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podUID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3"
Sep 15 18:51:17.973345 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:17.973318    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:18.074957 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:18.074937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:18.486898 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:18.486864    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:18.487056 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:18.486936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:18.487056 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:18.487011    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:18.487171 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:18.487012    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 18:51:18.487171 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:18.487122    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:20.487103331 +0000 UTC m=+55.435331650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:18.487171 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:18.487144    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:20.48713389 +0000 UTC m=+55.435362208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : configmap "kube-rbac-proxy" not found
Sep 15 18:51:18.612373 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:18.612351    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-skgjx_35059c7d-0268-4441-aa2d-31c14f50358b/dns-node-resolver/0.log"
Sep 15 18:51:18.848056 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:18.848003    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/1.log"
Sep 15 18:51:18.848347 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:18.848273    2572 scope.go:117] "RemoveContainer" containerID="9cc47aa359747a0f31c7d333cbfd33694dc22fe95c8de0b9f495595858337bd8"
Sep 15 18:51:18.848440 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:18.848401    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-5j4nh_openshift-console-operator(5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3)\"" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podUID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3"
Sep 15 18:51:19.056977 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:19.056957    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:19.613250 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:19.613227    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q4w7m_31a96b62-7d42-46e3-953f-7bf8307c9ce1/node-ca/0.log"
Sep 15 18:51:19.665766 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:19.665739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:19.716975 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:19.716958    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:19.850891 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:19.850873    2572 scope.go:117] "RemoveContainer" containerID="9cc47aa359747a0f31c7d333cbfd33694dc22fe95c8de0b9f495595858337bd8"
Sep 15 18:51:19.851167 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:19.851004    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-5j4nh_openshift-console-operator(5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3)\"" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podUID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3"
Sep 15 18:51:20.012600 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:20.012583    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nk72_01df7f55-d8f9-4e3b-8633-91fa6c8de669/serve-healthcheck-canary/0.log"
Sep 15 18:51:20.454358 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:20.454336    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:20.504747 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:20.504723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:20.504851 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:20.504767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:20.504889 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:20.504862    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 18:51:20.504889 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:20.504866    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:20.504978 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:20.504913    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:24.50489934 +0000 UTC m=+59.453127659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : configmap "kube-rbac-proxy" not found
Sep 15 18:51:20.504978 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:20.504927    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:24.504921047 +0000 UTC m=+59.453149351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:22.657011 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:22.656969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:23.741319 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:23.741292    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzrd5"
Sep 15 18:51:24.111695 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.111618    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:24.380664 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.380595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:24.489607 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.489569    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:24.536001 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.535979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:24.536127 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.536007    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:24.536166 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.536129    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 18:51:24.536201 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.536183    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls podName:a8196193-e95a-4452-81c2-f57e72d7a10f nodeName:}" failed. No retries permitted until 2026-09-15 18:51:40.536169046 +0000 UTC m=+75.484397349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-pgw4v" (UID: "a8196193-e95a-4452-81c2-f57e72d7a10f") : secret "samples-operator-tls" not found
Sep 15 18:51:24.536286 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.536268    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:24.536330 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.536302    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 18:51:24.536330 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.536310    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:24.536400 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.536338    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:24.536400 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.536351    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:32.536335799 +0000 UTC m=+67.484564122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : configmap "kube-rbac-proxy" not found
Sep 15 18:51:24.536400 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.536391    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:32.536377427 +0000 UTC m=+67.484605737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:24.536534 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.536401    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 18:51:24.536534 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.536438    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert podName:bd7bfb06-40d9-4a17-bb64-bb61eb77901b nodeName:}" failed. No retries permitted until 2026-09-15 18:51:40.53643064 +0000 UTC m=+75.484658944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-2zgjc" (UID: "bd7bfb06-40d9-4a17-bb64-bb61eb77901b") : secret "networking-console-plugin-cert" not found
Sep 15 18:51:24.594319 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.594296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:24.636765 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.636716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:24.636866 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.636771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:24.636866 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.636842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:24.636949 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.636874    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:24.636949 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.636920    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:40.636908062 +0000 UTC m=+75.585136366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : configmap references non-existent config key: service-ca.crt
Sep 15 18:51:24.636949 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.636936    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls podName:7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:40.636930669 +0000 UTC m=+75.585158973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-bq8tq" (UID: "7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60") : secret "cluster-monitoring-operator-tls" not found
Sep 15 18:51:24.637079 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.636947    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 18:51:24.637079 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:24.636980    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs podName:af5b55b6-64de-4833-8abe-2a0b0f5ba519 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:40.636971273 +0000 UTC m=+75.585199582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs") pod "router-default-79988fc9d-2hkvw" (UID: "af5b55b6-64de-4833-8abe-2a0b0f5ba519") : secret "router-metrics-certs-default" not found
Sep 15 18:51:24.690362 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.690333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:24.997786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:24.997759    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:25.791662 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:25.791629    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:25.816644 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:25.816620    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:25.816979 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:25.816965    2572 scope.go:117] "RemoveContainer" containerID="9cc47aa359747a0f31c7d333cbfd33694dc22fe95c8de0b9f495595858337bd8"
Sep 15 18:51:25.817117 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:25.817099    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-5j4nh_openshift-console-operator(5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3)\"" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podUID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3"
Sep 15 18:51:26.014326 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:26.014292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:26.190040 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:26.190008    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:26.592082 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:26.592003    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:27.192352 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:27.192320    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:27.435929 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:27.435895    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:27.588538 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:27.588464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:27.790443 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:27.790395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:27.890518 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:27.890462    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:27.994404 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:27.994374    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:28.396636 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:28.396611    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:28.591887 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:28.591862    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:28.651745 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:28.651688    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:29.196509 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:29.196486    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:29.589628 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:29.589566    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:29.792069 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:29.792045    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:30.204271 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:30.204243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:30.293219 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:30.293197    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:30.791952 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:30.791926    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:31.189532 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.189507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:31.292431 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.292400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:51:31.294752 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.294739    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 18:51:31.304923 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.304903    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc04cb5c-5790-4e11-b945-7bbee9ec032f-original-pull-secret\") pod \"global-pull-secret-syncer-krv8r\" (UID: \"dc04cb5c-5790-4e11-b945-7bbee9ec032f\") " pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:51:31.393371 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.393345    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:51:31.395275 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.395260    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 18:51:31.406475 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.406450    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0daf85a6-a551-4ef0-8f17-2d7ab335e1a4-metrics-certs\") pod \"network-metrics-daemon-kdrm2\" (UID: \"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4\") " pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:51:31.463040 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.462989    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krv8r"
Sep 15 18:51:31.493993 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.493967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:51:31.496355 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.496332    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lk7\" (UniqueName: \"kubernetes.io/projected/517c7cd0-f112-4ff3-b3a8-fffaf90d5167-kube-api-access-h2lk7\") pod \"network-check-target-xbnzw\" (UID: \"517c7cd0-f112-4ff3-b3a8-fffaf90d5167\") " pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:51:31.566124 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.566100    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gnvqj\""
Sep 15 18:51:31.574850 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.574834    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kdrm2"
Sep 15 18:51:31.591026 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.591006    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:31.692095 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.692064    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:31.726610 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.726555    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-krv8r"]
Sep 15 18:51:31.769581 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.769563    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4h8bk\""
Sep 15 18:51:31.778102 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.778077    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:51:31.797774 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.797751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:31.799918 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.799896    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"image-registry-86d7f96496-qj6wt\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") " pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:31.859190 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.859167    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kdrm2"]
Sep 15 18:51:31.861348 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:31.861322    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0daf85a6_a551_4ef0_8f17_2d7ab335e1a4.slice/crio-15c5ae85bdc9ca72d986c2e426adfca6db5f3a94724ed2e39ef4a94e097d8959 WatchSource:0}: Error finding container 15c5ae85bdc9ca72d986c2e426adfca6db5f3a94724ed2e39ef4a94e097d8959: Status 404 returned error can't find the container with id 15c5ae85bdc9ca72d986c2e426adfca6db5f3a94724ed2e39ef4a94e097d8959
Sep 15 18:51:31.883856 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.883829    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-krv8r" event={"ID":"dc04cb5c-5790-4e11-b945-7bbee9ec032f","Type":"ContainerStarted","Data":"cb4f8c04ff4fbff8931d3a9cff114975822476e839e1e9581f4e99f585893b11"}
Sep 15 18:51:31.884862 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.884842    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kdrm2" event={"ID":"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4","Type":"ContainerStarted","Data":"15c5ae85bdc9ca72d986c2e426adfca6db5f3a94724ed2e39ef4a94e097d8959"}
Sep 15 18:51:31.989859 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:31.989799    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:32.017811 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.017793    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nk7cf\""
Sep 15 18:51:32.025852 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.025839    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:32.047571 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.047544    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xbnzw"]
Sep 15 18:51:32.052292 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:32.052270    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517c7cd0_f112_4ff3_b3a8_fffaf90d5167.slice/crio-8c9ffee9dc09ff466f0a05c38a28dece0ba676764bc620c90aef15cfdb247ae8 WatchSource:0}: Error finding container 8c9ffee9dc09ff466f0a05c38a28dece0ba676764bc620c90aef15cfdb247ae8: Status 404 returned error can't find the container with id 8c9ffee9dc09ff466f0a05c38a28dece0ba676764bc620c90aef15cfdb247ae8
Sep 15 18:51:32.099308 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.099282    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:32.101282 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.101261    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a7de796-7968-4885-a149-1b9fdcb8ead3-metrics-tls\") pod \"dns-default-pntg8\" (UID: \"8a7de796-7968-4885-a149-1b9fdcb8ead3\") " pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:32.194074 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.194048    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:32.294324 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.294265    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86d7f96496-qj6wt"]
Sep 15 18:51:32.296746 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:32.296724    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d6f33e_4c4f_469b_93de_6cbd3c6e2c06.slice/crio-2ad8eb297c8a7b978595796db1af2c0e7757dc9c4e64f19eb05c099caa1236b3 WatchSource:0}: Error finding container 2ad8eb297c8a7b978595796db1af2c0e7757dc9c4e64f19eb05c099caa1236b3: Status 404 returned error can't find the container with id 2ad8eb297c8a7b978595796db1af2c0e7757dc9c4e64f19eb05c099caa1236b3
Sep 15 18:51:32.328290 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.328274    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vcddk\""
Sep 15 18:51:32.337328 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.337313    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:32.589043 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.588911    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:32.604106 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.604075    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:32.604338 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.604213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:32.604426 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:32.604359    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:32.604426 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:32.604424    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls podName:02baeeee-715d-447a-b611-0cb7ff968801 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:48.604405516 +0000 UTC m=+83.552633825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b65x6" (UID: "02baeeee-715d-447a-b611-0cb7ff968801") : secret "insights-runtime-extractor-tls" not found
Sep 15 18:51:32.604674 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.604650    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02baeeee-715d-447a-b611-0cb7ff968801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:32.615724 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.615698    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pntg8"]
Sep 15 18:51:32.620136 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:32.620109    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7de796_7968_4885_a149_1b9fdcb8ead3.slice/crio-8310a1fbc55890186afbd9720ef8b196c549b1f4b77e77e6bd8e1e26646e6fc6 WatchSource:0}: Error finding container 8310a1fbc55890186afbd9720ef8b196c549b1f4b77e77e6bd8e1e26646e6fc6: Status 404 returned error can't find the container with id 8310a1fbc55890186afbd9720ef8b196c549b1f4b77e77e6bd8e1e26646e6fc6
Sep 15 18:51:32.890360 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.890286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt" event={"ID":"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06","Type":"ContainerStarted","Data":"7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2"}
Sep 15 18:51:32.890360 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.890340    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt" event={"ID":"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06","Type":"ContainerStarted","Data":"2ad8eb297c8a7b978595796db1af2c0e7757dc9c4e64f19eb05c099caa1236b3"}
Sep 15 18:51:32.890875 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.890399    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:32.891792 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.891763    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pntg8" event={"ID":"8a7de796-7968-4885-a149-1b9fdcb8ead3","Type":"ContainerStarted","Data":"8310a1fbc55890186afbd9720ef8b196c549b1f4b77e77e6bd8e1e26646e6fc6"}
Sep 15 18:51:32.893582 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.893561    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xbnzw" event={"ID":"517c7cd0-f112-4ff3-b3a8-fffaf90d5167","Type":"ContainerStarted","Data":"a62499f2f6b95f56646af2165db17ce67bd6899979c257299c38ff1408a95e46"}
Sep 15 18:51:32.893692 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.893597    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xbnzw" event={"ID":"517c7cd0-f112-4ff3-b3a8-fffaf90d5167","Type":"ContainerStarted","Data":"8c9ffee9dc09ff466f0a05c38a28dece0ba676764bc620c90aef15cfdb247ae8"}
Sep 15 18:51:32.893692 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.893678    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:51:32.910081 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.910028    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt" podStartSLOduration=65.910014819 podStartE2EDuration="1m5.910014819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:32.908687619 +0000 UTC m=+67.856915945" watchObservedRunningTime="2026-09-15 18:51:32.910014819 +0000 UTC m=+67.858243183"
Sep 15 18:51:32.926628 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:32.926587    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xbnzw" podStartSLOduration=66.926572049 podStartE2EDuration="1m6.926572049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:32.92573581 +0000 UTC m=+67.873964137" watchObservedRunningTime="2026-09-15 18:51:32.926572049 +0000 UTC m=+67.874800390"
Sep 15 18:51:33.665526 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:33.665481    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:33.795233 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:33.795201    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:33.899966 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:33.899933    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kdrm2" event={"ID":"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4","Type":"ContainerStarted","Data":"2679fe9dc8aa101e1fb4f561e1c758d2702c4c6efe087b6609f869868c57b2f4"}
Sep 15 18:51:33.900415 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:33.899998    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kdrm2" event={"ID":"0daf85a6-a551-4ef0-8f17-2d7ab335e1a4","Type":"ContainerStarted","Data":"d67b9d08a8da1eef5dea228a4de02f0c2f305018ff586efef3641ae3972fe1eb"}
Sep 15 18:51:33.914799 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:33.914751    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kdrm2" podStartSLOduration=66.851650285 podStartE2EDuration="1m7.914733865s" totalImagesPullingTime="1.06308358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:33.913888589 +0000 UTC m=+68.862116917" watchObservedRunningTime="2026-09-15 18:51:33.914733865 +0000 UTC m=+68.862962190"
Sep 15 18:51:34.227062 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:34.227025    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:34.385315 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:34.385283    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:34.438131 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:34.438094    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:35.174908 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:35.174878    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:35.911526 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:35.911490    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pntg8" event={"ID":"8a7de796-7968-4885-a149-1b9fdcb8ead3","Type":"ContainerStarted","Data":"ab18dc75a4d00b06bb6aeabe78e5780c6a163923106b8f5988f51ef84b15e5e3"}
Sep 15 18:51:35.911704 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:35.911552    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pntg8" event={"ID":"8a7de796-7968-4885-a149-1b9fdcb8ead3","Type":"ContainerStarted","Data":"40b5e4e91a8e38943480cd8fe0060ddea85a9b137c3b1e4c1d731769948b0cdc"}
Sep 15 18:51:35.911704 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:35.911594    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:35.927912 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:35.927858    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pntg8" podStartSLOduration=33.575456839 podStartE2EDuration="35.927842796s" totalImagesPullingTime="2.352385957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:35.925743932 +0000 UTC m=+70.873972256" watchObservedRunningTime="2026-09-15 18:51:35.927842796 +0000 UTC m=+70.876071118"
Sep 15 18:51:37.918192 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:37.918160    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-krv8r" event={"ID":"dc04cb5c-5790-4e11-b945-7bbee9ec032f","Type":"ContainerStarted","Data":"a4ae8d3547d2d0612a42caf833f1cc89a7851bb45a33a8a788e710373d1707d2"}
Sep 15 18:51:37.932328 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:37.932288    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-krv8r" podStartSLOduration=66.587474237 podStartE2EDuration="1m11.932273961s" totalImagesPullingTime="5.344799724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:37.931672271 +0000 UTC m=+72.879900598" watchObservedRunningTime="2026-09-15 18:51:37.932273961 +0000 UTC m=+72.880502287"
Sep 15 18:51:39.000820 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.000772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:39.054672 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.054648    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:39.521575 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.521543    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:39.551607 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.551575    2572 scope.go:117] "RemoveContainer" containerID="9cc47aa359747a0f31c7d333cbfd33694dc22fe95c8de0b9f495595858337bd8"
Sep 15 18:51:39.603544 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.603478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:39.702657 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.702620    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:39.926119 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.926092    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 18:51:39.926527 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.926512    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/1.log"
Sep 15 18:51:39.926573 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.926544    2572 generic.go:356] "Generic (PLEG): container finished" podID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3" containerID="36879ecaa0519d451d748d663d6e6ceb9d916abbc53610bc9b01bfe15b7b50b4" exitCode=255
Sep 15 18:51:39.926624 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.926609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" event={"ID":"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3","Type":"ContainerDied","Data":"36879ecaa0519d451d748d663d6e6ceb9d916abbc53610bc9b01bfe15b7b50b4"}
Sep 15 18:51:39.926693 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.926682    2572 scope.go:117] "RemoveContainer" containerID="9cc47aa359747a0f31c7d333cbfd33694dc22fe95c8de0b9f495595858337bd8"
Sep 15 18:51:39.927056 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:39.927034    2572 scope.go:117] "RemoveContainer" containerID="36879ecaa0519d451d748d663d6e6ceb9d916abbc53610bc9b01bfe15b7b50b4"
Sep 15 18:51:39.927234 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:39.927214    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-5j4nh_openshift-console-operator(5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3)\"" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podUID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3"
Sep 15 18:51:40.099934 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.099902    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:40.572541 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.572496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:40.572541 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.572543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:40.575167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.575124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd7bfb06-40d9-4a17-bb64-bb61eb77901b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-2zgjc\" (UID: \"bd7bfb06-40d9-4a17-bb64-bb61eb77901b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:40.575324 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.575124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8196193-e95a-4452-81c2-f57e72d7a10f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-pgw4v\" (UID: \"a8196193-e95a-4452-81c2-f57e72d7a10f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:40.673179 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.673138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:40.673383 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.673227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:40.673383 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.673280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:40.673792 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.673768    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af5b55b6-64de-4833-8abe-2a0b0f5ba519-service-ca-bundle\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:40.675663 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.675638    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-bq8tq\" (UID: \"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:40.675764 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.675750    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5b55b6-64de-4833-8abe-2a0b0f5ba519-metrics-certs\") pod \"router-default-79988fc9d-2hkvw\" (UID: \"af5b55b6-64de-4833-8abe-2a0b0f5ba519\") " pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:40.771985 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.771948    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mggnz\""
Sep 15 18:51:40.780549 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.780519    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"
Sep 15 18:51:40.809915 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.809884    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2zgqm\""
Sep 15 18:51:40.818519 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.818482    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"
Sep 15 18:51:40.833370 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.833338    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-blkh6\""
Sep 15 18:51:40.841453 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.841388    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"
Sep 15 18:51:40.882963 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.882931    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ct7sj\""
Sep 15 18:51:40.890831 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.890779    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:40.932161 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:40.932084    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 18:51:41.047793 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.047764    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v"]
Sep 15 18:51:41.113007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.112976    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc"]
Sep 15 18:51:41.115694 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:41.115671    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd7bfb06_40d9_4a17_bb64_bb61eb77901b.slice/crio-f382836003f0d341a27654737ccee05d427bc1f9121c1c34953fa07e37f5b82c WatchSource:0}: Error finding container f382836003f0d341a27654737ccee05d427bc1f9121c1c34953fa07e37f5b82c: Status 404 returned error can't find the container with id f382836003f0d341a27654737ccee05d427bc1f9121c1c34953fa07e37f5b82c
Sep 15 18:51:41.134592 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.134483    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq"]
Sep 15 18:51:41.137033 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:41.137003    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5b5d43_1a3b_46a1_ba33_acd3a6f0ad60.slice/crio-c6625c28398f1371b1238e0fe99600ecf9cba043eb0bff16ab337ea8c30e6b37 WatchSource:0}: Error finding container c6625c28398f1371b1238e0fe99600ecf9cba043eb0bff16ab337ea8c30e6b37: Status 404 returned error can't find the container with id c6625c28398f1371b1238e0fe99600ecf9cba043eb0bff16ab337ea8c30e6b37
Sep 15 18:51:41.169108 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.169077    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79988fc9d-2hkvw"]
Sep 15 18:51:41.172897 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:41.172870    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf5b55b6_64de_4833_8abe_2a0b0f5ba519.slice/crio-62386d18c575d3d0bb67c929099e6b89bf0a64ef1fc5991db331645b8488f510 WatchSource:0}: Error finding container 62386d18c575d3d0bb67c929099e6b89bf0a64ef1fc5991db331645b8488f510: Status 404 returned error can't find the container with id 62386d18c575d3d0bb67c929099e6b89bf0a64ef1fc5991db331645b8488f510
Sep 15 18:51:41.939186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.939077    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79988fc9d-2hkvw" event={"ID":"af5b55b6-64de-4833-8abe-2a0b0f5ba519","Type":"ContainerStarted","Data":"9b316d5c423565d66355b152d3a8f9665898c71918b8efaa8aa1d6da81a88686"}
Sep 15 18:51:41.939186 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.939143    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79988fc9d-2hkvw" event={"ID":"af5b55b6-64de-4833-8abe-2a0b0f5ba519","Type":"ContainerStarted","Data":"62386d18c575d3d0bb67c929099e6b89bf0a64ef1fc5991db331645b8488f510"}
Sep 15 18:51:41.940765 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.940732    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc" event={"ID":"bd7bfb06-40d9-4a17-bb64-bb61eb77901b","Type":"ContainerStarted","Data":"f382836003f0d341a27654737ccee05d427bc1f9121c1c34953fa07e37f5b82c"}
Sep 15 18:51:41.942408 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.942375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq" event={"ID":"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60","Type":"ContainerStarted","Data":"c6625c28398f1371b1238e0fe99600ecf9cba043eb0bff16ab337ea8c30e6b37"}
Sep 15 18:51:41.944012 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.943983    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v" event={"ID":"a8196193-e95a-4452-81c2-f57e72d7a10f","Type":"ContainerStarted","Data":"83eb534bf8bd420ea7e3a4803ec1157189bb365b99742efc50604ebaee26b2fb"}
Sep 15 18:51:41.959051 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:41.958983    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79988fc9d-2hkvw" podStartSLOduration=33.958957363 podStartE2EDuration="33.958957363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:41.958005556 +0000 UTC m=+76.906233911" watchObservedRunningTime="2026-09-15 18:51:41.958957363 +0000 UTC m=+76.907185690"
Sep 15 18:51:42.891406 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:42.891361    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:42.895381 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:42.895342    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:42.948570 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:42.948539    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:42.949903 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:42.949877    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79988fc9d-2hkvw"
Sep 15 18:51:43.719365 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.719326    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:43.850645 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.850608    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"]
Sep 15 18:51:43.853825 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.853793    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"
Sep 15 18:51:43.855716 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.855692    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 18:51:43.855872 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.855734    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2cthf\""
Sep 15 18:51:43.861078 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.860903    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"]
Sep 15 18:51:43.953088 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.953046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc" event={"ID":"bd7bfb06-40d9-4a17-bb64-bb61eb77901b","Type":"ContainerStarted","Data":"4196765cfa0831deb11b380cc66a9f4b7cbc75216cb0ab4148c07bec3521cdcc"}
Sep 15 18:51:43.954836 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.954789    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq" event={"ID":"7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60","Type":"ContainerStarted","Data":"11d588da89e84a75450f9df466a22c1dbd14019ebf706779c272c1d00360e31a"}
Sep 15 18:51:43.956781 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.956756    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v" event={"ID":"a8196193-e95a-4452-81c2-f57e72d7a10f","Type":"ContainerStarted","Data":"64c4b5923d3a61e6515ca3d6f6eef442af127dabde0aa72ed7e3ddb2c7006ac2"}
Sep 15 18:51:43.956896 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.956819    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v" event={"ID":"a8196193-e95a-4452-81c2-f57e72d7a10f","Type":"ContainerStarted","Data":"a87818dcbceb3a57c72fa34749ec8ac3e69ba5bd66de6cd2eff35765abd3178a"}
Sep 15 18:51:43.968339 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.968291    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-2zgjc" podStartSLOduration=33.756873112 podStartE2EDuration="35.968274611s" totalImagesPullingTime="2.211401499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:43.967402941 +0000 UTC m=+78.915631267" watchObservedRunningTime="2026-09-15 18:51:43.968274611 +0000 UTC m=+78.916502978"
Sep 15 18:51:43.982148 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.982043    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-bq8tq" podStartSLOduration=33.786616087 podStartE2EDuration="35.982028492s" totalImagesPullingTime="2.195412405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:43.981079405 +0000 UTC m=+78.929307732" watchObservedRunningTime="2026-09-15 18:51:43.982028492 +0000 UTC m=+78.930256812"
Sep 15 18:51:43.995337 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:43.995278    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-pgw4v" podStartSLOduration=33.748117366 podStartE2EDuration="35.99526509s" totalImagesPullingTime="2.247147724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:43.994798447 +0000 UTC m=+78.943026772" watchObservedRunningTime="2026-09-15 18:51:43.99526509 +0000 UTC m=+78.943493415"
Sep 15 18:51:44.004061 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.004027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c754dc23-0268-4a6a-b2fc-6e69edce5a70-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-djvk7\" (UID: \"c754dc23-0268-4a6a-b2fc-6e69edce5a70\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"
Sep 15 18:51:44.095335 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.095299    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:44.104463 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.104426    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c754dc23-0268-4a6a-b2fc-6e69edce5a70-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-djvk7\" (UID: \"c754dc23-0268-4a6a-b2fc-6e69edce5a70\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"
Sep 15 18:51:44.104630 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:44.104570    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 18:51:44.104695 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:44.104640    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c754dc23-0268-4a6a-b2fc-6e69edce5a70-tls-certificates podName:c754dc23-0268-4a6a-b2fc-6e69edce5a70 nodeName:}" failed. No retries permitted until 2026-09-15 18:51:44.604621207 +0000 UTC m=+79.552849512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c754dc23-0268-4a6a-b2fc-6e69edce5a70-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-djvk7" (UID: "c754dc23-0268-4a6a-b2fc-6e69edce5a70") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 18:51:44.195511 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.195427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:44.298831 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.298732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:44.436862 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.436770    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:44.493946 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.493915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:44.608874 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.608765    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c754dc23-0268-4a6a-b2fc-6e69edce5a70-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-djvk7\" (UID: \"c754dc23-0268-4a6a-b2fc-6e69edce5a70\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"
Sep 15 18:51:44.611174 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.611145    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c754dc23-0268-4a6a-b2fc-6e69edce5a70-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-djvk7\" (UID: \"c754dc23-0268-4a6a-b2fc-6e69edce5a70\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"
Sep 15 18:51:44.764320 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:44.764281    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"
Sep 15 18:51:45.032600 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:45.032563    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"]
Sep 15 18:51:45.035732 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:45.035707    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc754dc23_0268_4a6a_b2fc_6e69edce5a70.slice/crio-0b540e5f9c4133d6d22b0fbe64d02902c88b40dacfd1911c03acf3413458898e WatchSource:0}: Error finding container 0b540e5f9c4133d6d22b0fbe64d02902c88b40dacfd1911c03acf3413458898e: Status 404 returned error can't find the container with id 0b540e5f9c4133d6d22b0fbe64d02902c88b40dacfd1911c03acf3413458898e
Sep 15 18:51:45.816734 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:45.816686    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:45.817158 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:45.817141    2572 scope.go:117] "RemoveContainer" containerID="36879ecaa0519d451d748d663d6e6ceb9d916abbc53610bc9b01bfe15b7b50b4"
Sep 15 18:51:45.817339 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:45.817319    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-5j4nh_openshift-console-operator(5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3)\"" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podUID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3"
Sep 15 18:51:45.917056 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:45.917023    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pntg8"
Sep 15 18:51:45.965994 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:45.965960    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7" event={"ID":"c754dc23-0268-4a6a-b2fc-6e69edce5a70","Type":"ContainerStarted","Data":"0b540e5f9c4133d6d22b0fbe64d02902c88b40dacfd1911c03acf3413458898e"}
Sep 15 18:51:46.970745 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:46.970710    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7" event={"ID":"c754dc23-0268-4a6a-b2fc-6e69edce5a70","Type":"ContainerStarted","Data":"8446f12841eec3f89bc1facaf023069635522170972137abeb4b41381668e9cb"}
Sep 15 18:51:46.971153 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:46.970927    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"
Sep 15 18:51:46.975760 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:46.975737    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7"
Sep 15 18:51:46.984740 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:46.984690    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-djvk7" podStartSLOduration=2.464299852 podStartE2EDuration="3.984677384s" totalImagesPullingTime="1.520377532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:46.983373748 +0000 UTC m=+81.931602089" watchObservedRunningTime="2026-09-15 18:51:46.984677384 +0000 UTC m=+81.932905730"
Sep 15 18:51:47.875516 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:47.875481    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:47.975711 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:47.975599    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:48.229513 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:48.229465    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:48.640670 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:48.640582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:48.642975 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:48.642951    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02baeeee-715d-447a-b611-0cb7ff968801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b65x6\" (UID: \"02baeeee-715d-447a-b611-0cb7ff968801\") " pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:48.668095 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:48.668061    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pj5l2\""
Sep 15 18:51:48.676746 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:48.676716    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b65x6"
Sep 15 18:51:48.970557 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:48.970520    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b65x6"]
Sep 15 18:51:48.974480 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:48.974447    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02baeeee_715d_447a_b611_0cb7ff968801.slice/crio-417b123fc07c52d498559fe9dc45cd6afadc393cf6eea3da5d03f624b663975e WatchSource:0}: Error finding container 417b123fc07c52d498559fe9dc45cd6afadc393cf6eea3da5d03f624b663975e: Status 404 returned error can't find the container with id 417b123fc07c52d498559fe9dc45cd6afadc393cf6eea3da5d03f624b663975e
Sep 15 18:51:49.056387 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:49.056349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:51:49.056907 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:49.056889    2572 scope.go:117] "RemoveContainer" containerID="36879ecaa0519d451d748d663d6e6ceb9d916abbc53610bc9b01bfe15b7b50b4"
Sep 15 18:51:49.057105 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:49.057084    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-5j4nh_openshift-console-operator(5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3)\"" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" podUID="5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3"
Sep 15 18:51:49.982902 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:49.982864    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b65x6" event={"ID":"02baeeee-715d-447a-b611-0cb7ff968801","Type":"ContainerStarted","Data":"c873dc8dffa72dd35e3a78e92765cbcf5ed44021c48cb41a1b76f8ab6c216048"}
Sep 15 18:51:49.983109 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:49.982925    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b65x6" event={"ID":"02baeeee-715d-447a-b611-0cb7ff968801","Type":"ContainerStarted","Data":"417b123fc07c52d498559fe9dc45cd6afadc393cf6eea3da5d03f624b663975e"}
Sep 15 18:51:50.990394 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:50.990355    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b65x6" event={"ID":"02baeeee-715d-447a-b611-0cb7ff968801","Type":"ContainerStarted","Data":"fc9ae34d1e4433d1adb948d8b772469d9e4759a1de64bcb84d03304e025d657e"}
Sep 15 18:51:51.682060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:51.681958    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:51.996081 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:51.995991    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b65x6" event={"ID":"02baeeee-715d-447a-b611-0cb7ff968801","Type":"ContainerStarted","Data":"71e80a4c0e2c61385249d8502208510d0e5d8f52c67283132871aec74a3fe788"}
Sep 15 18:51:52.013718 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:52.013662    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b65x6" podStartSLOduration=33.74006414 podStartE2EDuration="36.013644551s" totalImagesPullingTime="2.273580411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 18:51:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:52.012463543 +0000 UTC m=+86.960691868" watchObservedRunningTime="2026-09-15 18:51:52.013644551 +0000 UTC m=+86.961872874"
Sep 15 18:51:52.030649 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:52.030616    2572 patch_prober.go:28] interesting pod/image-registry-86d7f96496-qj6wt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 18:51:52.030838 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:52.030666    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt" podUID="64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 18:51:52.804033 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:52.803989    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:52.860958 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:52.860915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:53.577350 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:53.577305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:53.631623 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:53.631583    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:53.904899 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:53.904816    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:51:54.019775 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.019721    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:54.116891 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.116854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:54.216855 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.216793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:54.274259 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.274223    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2wz5c"]
Sep 15 18:51:54.277962 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.277940    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.280567 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.280546    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 18:51:54.281017 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.281001    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n5z5v\""
Sep 15 18:51:54.281153 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.281130    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 18:51:54.281210 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.281175    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 18:51:54.281493 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.281480    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 18:51:54.302654 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.302620    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:54.362760 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.362711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:54.392093 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-sys\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.392276 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392110    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-wtmp\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.392276 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-tls\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.392276 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ff6b82-6462-4527-96bd-98038fd999aa-metrics-client-ca\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.392276 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392236    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82k8n\" (UniqueName: \"kubernetes.io/projected/90ff6b82-6462-4527-96bd-98038fd999aa-kube-api-access-82k8n\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.392491 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392300    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-textfile\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.392491 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.392491 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.392491 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.392450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-root\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.489548 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.489455    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:54.493585 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.493736 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-root\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.493736 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493631    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-sys\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.493736 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-wtmp\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.493736 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493695    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-root\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.493736 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-tls\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493758    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ff6b82-6462-4527-96bd-98038fd999aa-metrics-client-ca\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493767    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-sys\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493782    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82k8n\" (UniqueName: \"kubernetes.io/projected/90ff6b82-6462-4527-96bd-98038fd999aa-kube-api-access-82k8n\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-textfile\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494007 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:54.493890    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 18:51:54.494007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494007 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:51:54.493953    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-tls podName:90ff6b82-6462-4527-96bd-98038fd999aa nodeName:}" failed. No retries permitted until 2026-09-15 18:51:54.993932169 +0000 UTC m=+89.942160493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-tls") pod "node-exporter-2wz5c" (UID: "90ff6b82-6462-4527-96bd-98038fd999aa") : secret "node-exporter-tls" not found
Sep 15 18:51:54.494317 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.493873    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-wtmp\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494317 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.494236    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494317 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.494257    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-textfile\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.494423 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.494336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ff6b82-6462-4527-96bd-98038fd999aa-metrics-client-ca\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.496652 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.496624    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.506362 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.506335    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82k8n\" (UniqueName: \"kubernetes.io/projected/90ff6b82-6462-4527-96bd-98038fd999aa-kube-api-access-82k8n\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:54.587546 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.587497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:54.687450 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.687411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:54.998857 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:54.998792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-tls\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:55.001100 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:55.001077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90ff6b82-6462-4527-96bd-98038fd999aa-node-exporter-tls\") pod \"node-exporter-2wz5c\" (UID: \"90ff6b82-6462-4527-96bd-98038fd999aa\") " pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:55.152796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:55.152760    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:55.186792 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:55.186753    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wz5c"
Sep 15 18:51:55.199573 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:51:55.199535    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ff6b82_6462_4527_96bd_98038fd999aa.slice/crio-6c37534ae7d6404354a36e06d63b7d5304d7725fac746c040fc1a6ded8090d22 WatchSource:0}: Error finding container 6c37534ae7d6404354a36e06d63b7d5304d7725fac746c040fc1a6ded8090d22: Status 404 returned error can't find the container with id 6c37534ae7d6404354a36e06d63b7d5304d7725fac746c040fc1a6ded8090d22
Sep 15 18:51:55.252797 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:55.252719    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:55.325560 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:55.325524    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:55.431238 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:55.431189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:55.558173 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:55.558066    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:56.015573 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:56.015532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wz5c" event={"ID":"90ff6b82-6462-4527-96bd-98038fd999aa","Type":"ContainerStarted","Data":"6c37534ae7d6404354a36e06d63b7d5304d7725fac746c040fc1a6ded8090d22"}
Sep 15 18:51:57.020602 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:57.020565    2572 generic.go:356] "Generic (PLEG): container finished" podID="90ff6b82-6462-4527-96bd-98038fd999aa" containerID="7daf19ccff1923e4609c6c79e4fc3878165df3d5a391c5f7e7a17983d5df3636" exitCode=0
Sep 15 18:51:57.020997 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:57.020644    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wz5c" event={"ID":"90ff6b82-6462-4527-96bd-98038fd999aa","Type":"ContainerDied","Data":"7daf19ccff1923e4609c6c79e4fc3878165df3d5a391c5f7e7a17983d5df3636"}
Sep 15 18:51:57.223154 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:57.223114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:57.322696 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:57.322597    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:57.396504 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:57.396468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:58.026585 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:58.026552    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wz5c" event={"ID":"90ff6b82-6462-4527-96bd-98038fd999aa","Type":"ContainerStarted","Data":"e12fe28cab6db8eebee3cc6bcc903f0046ad08108b2e67d3ff1449cf45be14e7"}
Sep 15 18:51:58.027007 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:58.026602    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wz5c" event={"ID":"90ff6b82-6462-4527-96bd-98038fd999aa","Type":"ContainerStarted","Data":"38b1320483a3dc8d5e88e9c0595734c459be6b948969b7be0ff8cb09090d0579"}
Sep 15 18:51:58.043301 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:58.043248    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2wz5c" podStartSLOduration=2.866813048 podStartE2EDuration="4.043232462s" totalImagesPullingTime="1.114120401s" totalInitContainerRuntime="62.299013ms" isStatefulPod=true podCreationTimestamp="2026-09-15 18:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:51:58.041766172 +0000 UTC m=+92.989994498" watchObservedRunningTime="2026-09-15 18:51:58.043232462 +0000 UTC m=+92.991460795"
Sep 15 18:51:59.038465 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:59.038433    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:59.300402 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:59.300309    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:59.399739 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:59.399702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:51:59.499838 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:51:59.499786    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:00.507764 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:00.507722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:01.552025 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:01.551995    2572 scope.go:117] "RemoveContainer" containerID="36879ecaa0519d451d748d663d6e6ceb9d916abbc53610bc9b01bfe15b7b50b4"
Sep 15 18:52:01.665406 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:01.665370    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86d7f96496-qj6wt"]
Sep 15 18:52:01.746831 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:01.746771    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:01.848364 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:01.848273    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:01.949494 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:01.949458    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:02.044201 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.044175    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 18:52:02.044375 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.044228    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh" event={"ID":"5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3","Type":"ContainerStarted","Data":"1b706ae5dd34d49eb8b2b8079e1304290274ff8ca66ce5966138156118202028"}
Sep 15 18:52:02.044520 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.044502    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:52:02.049176 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.049148    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-5j4nh"
Sep 15 18:52:02.119264 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.119189    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-52pt2"]
Sep 15 18:52:02.122433 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.122411    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-52pt2"
Sep 15 18:52:02.124624 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.124598    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 18:52:02.124756 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.124684    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-k4ztf\""
Sep 15 18:52:02.124756 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.124684    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 18:52:02.131097 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.131070    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-52pt2"]
Sep 15 18:52:02.150535 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.150504    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7lcm\" (UniqueName: \"kubernetes.io/projected/8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a-kube-api-access-z7lcm\") pod \"downloads-76f99584f4-52pt2\" (UID: \"8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a\") " pod="openshift-console/downloads-76f99584f4-52pt2"
Sep 15 18:52:02.156447 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.156419    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:02.251925 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.251869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7lcm\" (UniqueName: \"kubernetes.io/projected/8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a-kube-api-access-z7lcm\") pod \"downloads-76f99584f4-52pt2\" (UID: \"8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a\") " pod="openshift-console/downloads-76f99584f4-52pt2"
Sep 15 18:52:02.256983 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.256951    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:02.259455 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.259429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7lcm\" (UniqueName: \"kubernetes.io/projected/8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a-kube-api-access-z7lcm\") pod \"downloads-76f99584f4-52pt2\" (UID: \"8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a\") " pod="openshift-console/downloads-76f99584f4-52pt2"
Sep 15 18:52:02.309914 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.309877    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:02.419276 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.419246    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:02.432371 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.432343    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-52pt2"
Sep 15 18:52:02.588491 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.588452    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:02.703052 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:02.702971    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-52pt2"]
Sep 15 18:52:02.706403 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:52:02.706369    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3dabb2_1e7e_4e1d_9d3d_47d75d6b874a.slice/crio-c8cd8a4632815fd730448af3485aa410e4ac90c53fba7d9ec4fcb460a32b01c3 WatchSource:0}: Error finding container c8cd8a4632815fd730448af3485aa410e4ac90c53fba7d9ec4fcb460a32b01c3: Status 404 returned error can't find the container with id c8cd8a4632815fd730448af3485aa410e4ac90c53fba7d9ec4fcb460a32b01c3
Sep 15 18:52:03.021370 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:03.021341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:03.048891 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:03.048849    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-52pt2" event={"ID":"8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a","Type":"ContainerStarted","Data":"c8cd8a4632815fd730448af3485aa410e4ac90c53fba7d9ec4fcb460a32b01c3"}
Sep 15 18:52:03.078422 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:03.078384    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:03.760842 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:03.760783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:03.861985 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:03.861949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:03.903062 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:03.903031    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xbnzw"
Sep 15 18:52:04.000488 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:04.000433    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:04.296014 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:04.295972    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:05.818566 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:05.818529    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:05.870277 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:05.870247    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:07.491854 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:07.491794    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:07.554733 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:07.554681    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:08.412274 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.412234    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f9d69db8-m2fl5"]
Sep 15 18:52:08.415162 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.415134    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.417576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.417547    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 18:52:08.418434 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.418123    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 18:52:08.418434 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.418221    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 18:52:08.418434 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.418267    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 18:52:08.418434 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.418378    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rj6np\""
Sep 15 18:52:08.418751 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.418654    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 18:52:08.424647 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.424590    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f9d69db8-m2fl5"]
Sep 15 18:52:08.510547 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.510507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-config\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.511015 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.510566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-oauth-config\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.511015 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.510682    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-oauth-serving-cert\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.511015 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.510720    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-service-ca\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.511015 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.510758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-serving-cert\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.511015 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.510778    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfnks\" (UniqueName: \"kubernetes.io/projected/0c966a6a-9646-48c3-bf0e-46ac164d770e-kube-api-access-zfnks\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.611985 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.611946    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-oauth-serving-cert\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.612170 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.611998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-service-ca\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.612170 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.612033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-serving-cert\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.612170 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.612060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnks\" (UniqueName: \"kubernetes.io/projected/0c966a6a-9646-48c3-bf0e-46ac164d770e-kube-api-access-zfnks\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.612170 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.612113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-config\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.612170 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.612145    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-oauth-config\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.612942 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.612862    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-service-ca\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.612942 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.612877    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-oauth-serving-cert\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.613107 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.612950    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-config\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.615000 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.614974    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-serving-cert\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.615000 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.614988    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-oauth-config\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.619745 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.619723    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfnks\" (UniqueName: \"kubernetes.io/projected/0c966a6a-9646-48c3-bf0e-46ac164d770e-kube-api-access-zfnks\") pod \"console-76f9d69db8-m2fl5\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") " pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:08.726947 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:08.726863    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:09.007146 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:09.007069    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f9d69db8-m2fl5"]
Sep 15 18:52:09.010740 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:52:09.010701    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c966a6a_9646_48c3_bf0e_46ac164d770e.slice/crio-e8653a725960d888e4650b22d6096f33e536e1f4a70b46b38f0333f6e79149ac WatchSource:0}: Error finding container e8653a725960d888e4650b22d6096f33e536e1f4a70b46b38f0333f6e79149ac: Status 404 returned error can't find the container with id e8653a725960d888e4650b22d6096f33e536e1f4a70b46b38f0333f6e79149ac
Sep 15 18:52:09.074815 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:09.074762    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f9d69db8-m2fl5" event={"ID":"0c966a6a-9646-48c3-bf0e-46ac164d770e","Type":"ContainerStarted","Data":"e8653a725960d888e4650b22d6096f33e536e1f4a70b46b38f0333f6e79149ac"}
Sep 15 18:52:09.392095 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:09.392010    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:09.502067 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:09.502033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:12.129582 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:12.129546    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:12.229740 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:12.229573    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:15.845486 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:15.845437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:15.942892 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:15.942853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:16.466789 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:16.466752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:16.524384 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:16.524346    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:19.018895 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.018862    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d8ffdbd7f-c2889"]
Sep 15 18:52:19.023849 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.023374    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.033245 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.033220    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 18:52:19.038195 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.038168    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8ffdbd7f-c2889"]
Sep 15 18:52:19.109794 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.109761    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-config\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.109952 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.109857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-trusted-ca-bundle\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.109952 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.109893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-oauth-serving-cert\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.109952 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.109917    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-serving-cert\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.109952 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.109938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-service-ca\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.110133 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.110048    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-oauth-config\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.110133 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.110072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8cr5\" (UniqueName: \"kubernetes.io/projected/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-kube-api-access-m8cr5\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.211181 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.211147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-oauth-config\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.211181 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.211187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8cr5\" (UniqueName: \"kubernetes.io/projected/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-kube-api-access-m8cr5\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.211476 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.211232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-config\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.211476 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.211263    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-trusted-ca-bundle\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.211476 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.211277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-oauth-serving-cert\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.211476 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.211353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-serving-cert\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.211476 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.211409    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-service-ca\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.212235 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.212211    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-oauth-serving-cert\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.212349 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.212199    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-config\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.212349 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.212262    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-trusted-ca-bundle\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.212449 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.212336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-service-ca\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.213832 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.213792    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-oauth-config\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.214105 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.214083    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-serving-cert\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.218681 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.218658    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8cr5\" (UniqueName: \"kubernetes.io/projected/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-kube-api-access-m8cr5\") pod \"console-5d8ffdbd7f-c2889\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") " pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.250433 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.250404    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:19.305507 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.305449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:19.336672 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.336647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:19.615624 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:19.615511    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8ffdbd7f-c2889"]
Sep 15 18:52:19.619037 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:52:19.619005    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3d4951_0d0d_440c_8b0d_54fd2b19b7d1.slice/crio-fea433da2e92c5a9d9d5de2d375cd6f1062f70c7320f334b4b620b0a87b77fb6 WatchSource:0}: Error finding container fea433da2e92c5a9d9d5de2d375cd6f1062f70c7320f334b4b620b0a87b77fb6: Status 404 returned error can't find the container with id fea433da2e92c5a9d9d5de2d375cd6f1062f70c7320f334b4b620b0a87b77fb6
Sep 15 18:52:20.124147 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:20.123855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-52pt2" event={"ID":"8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a","Type":"ContainerStarted","Data":"011307c3b41d01aa31293518602fe36733b107d8ed4cd8bce24ac570bce99d4c"}
Sep 15 18:52:20.124147 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:20.124063    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-52pt2"
Sep 15 18:52:20.126444 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:20.126377    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f9d69db8-m2fl5" event={"ID":"0c966a6a-9646-48c3-bf0e-46ac164d770e","Type":"ContainerStarted","Data":"497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605"}
Sep 15 18:52:20.128184 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:20.128161    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8ffdbd7f-c2889" event={"ID":"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1","Type":"ContainerStarted","Data":"cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6"}
Sep 15 18:52:20.128296 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:20.128199    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8ffdbd7f-c2889" event={"ID":"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1","Type":"ContainerStarted","Data":"fea433da2e92c5a9d9d5de2d375cd6f1062f70c7320f334b4b620b0a87b77fb6"}
Sep 15 18:52:20.130436 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:20.130413    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-52pt2"
Sep 15 18:52:20.140681 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:20.140638    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-52pt2" podStartSLOduration=1.450876854 podStartE2EDuration="18.140623066s" totalImagesPullingTime="16.689746212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:52:20.139023489 +0000 UTC m=+115.087251815" watchObservedRunningTime="2026-09-15 18:52:20.140623066 +0000 UTC m=+115.088851389"
Sep 15 18:52:20.154504 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:20.154143    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d8ffdbd7f-c2889" podStartSLOduration=1.154124321 podStartE2EDuration="1.154124321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:52:20.153664921 +0000 UTC m=+115.101893249" watchObservedRunningTime="2026-09-15 18:52:20.154124321 +0000 UTC m=+115.102352648"
Sep 15 18:52:22.139372 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:22.139337    2572 generic.go:356] "Generic (PLEG): container finished" podID="d894b34b-bb7a-410e-b2d4-a575f914a913" containerID="6d0c603d82876e4328b8d8a8f811108fce52d51dcac130c3bbd5fe4dd18afcf6" exitCode=0
Sep 15 18:52:22.139825 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:22.139419    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t" event={"ID":"d894b34b-bb7a-410e-b2d4-a575f914a913","Type":"ContainerDied","Data":"6d0c603d82876e4328b8d8a8f811108fce52d51dcac130c3bbd5fe4dd18afcf6"}
Sep 15 18:52:22.139903 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:22.139833    2572 scope.go:117] "RemoveContainer" containerID="6d0c603d82876e4328b8d8a8f811108fce52d51dcac130c3bbd5fe4dd18afcf6"
Sep 15 18:52:22.141297 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:22.141274    2572 generic.go:356] "Generic (PLEG): container finished" podID="f5880853-f8ef-48cc-af5a-47ed879d1cbf" containerID="c13ee21149b574395281effa99f05a579e253577d798bbde914957b6deb6b5b0" exitCode=0
Sep 15 18:52:22.141419 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:22.141354    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-b7x59" event={"ID":"f5880853-f8ef-48cc-af5a-47ed879d1cbf","Type":"ContainerDied","Data":"c13ee21149b574395281effa99f05a579e253577d798bbde914957b6deb6b5b0"}
Sep 15 18:52:22.142062 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:22.142040    2572 scope.go:117] "RemoveContainer" containerID="c13ee21149b574395281effa99f05a579e253577d798bbde914957b6deb6b5b0"
Sep 15 18:52:22.160666 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:22.160620    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76f9d69db8-m2fl5" podStartSLOduration=3.819938235 podStartE2EDuration="14.160604222s" totalImagesPullingTime="10.340665987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:52:20.189192703 +0000 UTC m=+115.137421030" watchObservedRunningTime="2026-09-15 18:52:22.160604222 +0000 UTC m=+117.108832547"
Sep 15 18:52:23.118156 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:23.118119    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79988fc9d-2hkvw_af5b55b6-64de-4833-8abe-2a0b0f5ba519/router/0.log"
Sep 15 18:52:23.131948 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:23.131851    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nk72_01df7f55-d8f9-4e3b-8633-91fa6c8de669/serve-healthcheck-canary/0.log"
Sep 15 18:52:23.148104 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:23.148071    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-2pj2t" event={"ID":"d894b34b-bb7a-410e-b2d4-a575f914a913","Type":"ContainerStarted","Data":"a00f619ccb623dc823f7f8d0087d3d9100b514bf9789d6498725060eab19bd9b"}
Sep 15 18:52:23.150463 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:23.150434    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-b7x59" event={"ID":"f5880853-f8ef-48cc-af5a-47ed879d1cbf","Type":"ContainerStarted","Data":"3aa4359fd052e48c8102dd2555f631b06c66b346669f8fc994fb1e7b2c705ba0"}
Sep 15 18:52:23.627032 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:23.626993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:24.043205 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:24.043173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:24.097577 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:24.097546    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:26.685226 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:26.685183    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt" podUID="64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" containerName="registry" containerID="cri-o://7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2" gracePeriod=30
Sep 15 18:52:26.984116 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:26.984087    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:52:27.081308 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081272    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-image-registry-private-configuration\") pod \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") "
Sep 15 18:52:27.081468 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081317    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-installation-pull-secrets\") pod \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") "
Sep 15 18:52:27.081468 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081344    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-certificates\") pod \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") "
Sep 15 18:52:27.081468 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081370    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-ca-trust-extracted\") pod \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") "
Sep 15 18:52:27.081468 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081401    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz6wh\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-kube-api-access-sz6wh\") pod \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") "
Sep 15 18:52:27.081742 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081711    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:52:27.081863 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081832    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-bound-sa-token\") pod \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") "
Sep 15 18:52:27.081932 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081882    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") pod \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") "
Sep 15 18:52:27.081932 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.081910    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-trusted-ca\") pod \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\" (UID: \"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06\") "
Sep 15 18:52:27.082387 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.082165    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-certificates\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:27.082521 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.082489    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:52:27.084380 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.084332    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-kube-api-access-sz6wh" (OuterVolumeSpecName: "kube-api-access-sz6wh") pod "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06"). InnerVolumeSpecName "kube-api-access-sz6wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:52:27.084630 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.084598    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:52:27.085094 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.085059    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:52:27.085094 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.085078    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:52:27.085537 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.085511    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:52:27.092336 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.092314    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" (UID: "64d6f33e-4c4f-469b-93de-6cbd3c6e2c06"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:52:27.169656 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.169628    2572 generic.go:356] "Generic (PLEG): container finished" podID="64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" containerID="7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2" exitCode=0
Sep 15 18:52:27.169762 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.169690    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt"
Sep 15 18:52:27.169762 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.169691    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt" event={"ID":"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06","Type":"ContainerDied","Data":"7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2"}
Sep 15 18:52:27.169762 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.169757    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86d7f96496-qj6wt" event={"ID":"64d6f33e-4c4f-469b-93de-6cbd3c6e2c06","Type":"ContainerDied","Data":"2ad8eb297c8a7b978595796db1af2c0e7757dc9c4e64f19eb05c099caa1236b3"}
Sep 15 18:52:27.169975 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.169790    2572 scope.go:117] "RemoveContainer" containerID="7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2"
Sep 15 18:52:27.172358 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.172333    2572 generic.go:356] "Generic (PLEG): container finished" podID="d35fd842-e79c-413f-a16a-5d3c762a540e" containerID="8a871e7578c841e7adc5fa3e97ed6346a0f30a7439b8b71d821426c07a343b0e" exitCode=0
Sep 15 18:52:27.172454 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.172407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw" event={"ID":"d35fd842-e79c-413f-a16a-5d3c762a540e","Type":"ContainerDied","Data":"8a871e7578c841e7adc5fa3e97ed6346a0f30a7439b8b71d821426c07a343b0e"}
Sep 15 18:52:27.172759 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.172735    2572 scope.go:117] "RemoveContainer" containerID="8a871e7578c841e7adc5fa3e97ed6346a0f30a7439b8b71d821426c07a343b0e"
Sep 15 18:52:27.180240 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.180219    2572 scope.go:117] "RemoveContainer" containerID="7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2"
Sep 15 18:52:27.180684 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:52:27.180568    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2\": container with ID starting with 7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2 not found: ID does not exist" containerID="7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2"
Sep 15 18:52:27.180684 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.180601    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2"} err="failed to get container status \"7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2\": rpc error: code = NotFound desc = could not find container \"7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2\": container with ID starting with 7a0951e0eb9d30d7ac94ea06d8e1d19c00a1db9497e4d0079b0a47c486de6ca2 not found: ID does not exist"
Sep 15 18:52:27.182551 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.182527    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz6wh\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-kube-api-access-sz6wh\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:27.182651 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.182556    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-bound-sa-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:27.182651 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.182571    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-registry-tls\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:27.182651 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.182583    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-trusted-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:27.182651 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.182598    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-image-registry-private-configuration\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:27.182651 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.182612    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-installation-pull-secrets\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:27.182651 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.182626    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06-ca-trust-extracted\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:27.202297 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.202270    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86d7f96496-qj6wt"]
Sep 15 18:52:27.207295 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.207272    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86d7f96496-qj6wt"]
Sep 15 18:52:27.562191 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:27.562112    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" path="/var/lib/kubelet/pods/64d6f33e-4c4f-469b-93de-6cbd3c6e2c06/volumes"
Sep 15 18:52:28.181357 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:28.181309    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-kfxkw" event={"ID":"d35fd842-e79c-413f-a16a-5d3c762a540e","Type":"ContainerStarted","Data":"5f1343ffb4dc5b101060650686e236eea19d3b8a9878fd729292ed7b1030fe3b"}
Sep 15 18:52:28.727200 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:28.727169    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:28.727347 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:28.727216    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:28.731981 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:28.731942    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:29.189534 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:29.189508    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:29.337667 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:29.337630    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:29.337867 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:29.337716    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:29.342619 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:29.342596    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:30.193523 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:30.193475    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:52:30.236532 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:30.236503    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f9d69db8-m2fl5"]
Sep 15 18:52:30.790360 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:30.790325    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:30.844316 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:30.844287    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:33.023779 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:33.023743    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:33.085279 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:33.085238    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:34.237054 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:34.236994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:34.342251 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:34.342209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:34.694763 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:34.694733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:35.795445 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:35.795406    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:39.007324 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:39.007291    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:39.463420 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:39.463388    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:45.629013 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:45.628978    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:45.681350 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:45.681324    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:52:56.212823 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.212768    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76f9d69db8-m2fl5" podUID="0c966a6a-9646-48c3-bf0e-46ac164d770e" containerName="console" containerID="cri-o://497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605" gracePeriod=15
Sep 15 18:52:56.504876 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.504853    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:56.603212 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603179    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-oauth-serving-cert\") pod \"0c966a6a-9646-48c3-bf0e-46ac164d770e\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") "
Sep 15 18:52:56.603362 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603223    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-oauth-config\") pod \"0c966a6a-9646-48c3-bf0e-46ac164d770e\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") "
Sep 15 18:52:56.603362 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603264    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-config\") pod \"0c966a6a-9646-48c3-bf0e-46ac164d770e\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") "
Sep 15 18:52:56.603362 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603285    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfnks\" (UniqueName: \"kubernetes.io/projected/0c966a6a-9646-48c3-bf0e-46ac164d770e-kube-api-access-zfnks\") pod \"0c966a6a-9646-48c3-bf0e-46ac164d770e\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") "
Sep 15 18:52:56.603362 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603327    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-service-ca\") pod \"0c966a6a-9646-48c3-bf0e-46ac164d770e\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") "
Sep 15 18:52:56.603362 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603353    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-serving-cert\") pod \"0c966a6a-9646-48c3-bf0e-46ac164d770e\" (UID: \"0c966a6a-9646-48c3-bf0e-46ac164d770e\") "
Sep 15 18:52:56.603613 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603540    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c966a6a-9646-48c3-bf0e-46ac164d770e" (UID: "0c966a6a-9646-48c3-bf0e-46ac164d770e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:52:56.603768 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603740    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c966a6a-9646-48c3-bf0e-46ac164d770e" (UID: "0c966a6a-9646-48c3-bf0e-46ac164d770e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:52:56.603768 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.603736    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-config" (OuterVolumeSpecName: "console-config") pod "0c966a6a-9646-48c3-bf0e-46ac164d770e" (UID: "0c966a6a-9646-48c3-bf0e-46ac164d770e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:52:56.605565 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.605543    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c966a6a-9646-48c3-bf0e-46ac164d770e" (UID: "0c966a6a-9646-48c3-bf0e-46ac164d770e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:52:56.605676 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.605580    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c966a6a-9646-48c3-bf0e-46ac164d770e" (UID: "0c966a6a-9646-48c3-bf0e-46ac164d770e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:52:56.605676 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.605596    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c966a6a-9646-48c3-bf0e-46ac164d770e-kube-api-access-zfnks" (OuterVolumeSpecName: "kube-api-access-zfnks") pod "0c966a6a-9646-48c3-bf0e-46ac164d770e" (UID: "0c966a6a-9646-48c3-bf0e-46ac164d770e"). InnerVolumeSpecName "kube-api-access-zfnks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:52:56.704052 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.704032    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-config\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:56.704052 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.704051    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfnks\" (UniqueName: \"kubernetes.io/projected/0c966a6a-9646-48c3-bf0e-46ac164d770e-kube-api-access-zfnks\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:56.704177 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.704061    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:56.704177 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.704070    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-serving-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:56.704177 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.704079    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c966a6a-9646-48c3-bf0e-46ac164d770e-oauth-serving-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:56.704177 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:56.704087    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c966a6a-9646-48c3-bf0e-46ac164d770e-console-oauth-config\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:52:57.298716 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.298686    2572 generic.go:356] "Generic (PLEG): container finished" podID="0c966a6a-9646-48c3-bf0e-46ac164d770e" containerID="497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605" exitCode=0
Sep 15 18:52:57.299188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.298747    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f9d69db8-m2fl5"
Sep 15 18:52:57.299188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.298751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f9d69db8-m2fl5" event={"ID":"0c966a6a-9646-48c3-bf0e-46ac164d770e","Type":"ContainerDied","Data":"497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605"}
Sep 15 18:52:57.299188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.298866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f9d69db8-m2fl5" event={"ID":"0c966a6a-9646-48c3-bf0e-46ac164d770e","Type":"ContainerDied","Data":"e8653a725960d888e4650b22d6096f33e536e1f4a70b46b38f0333f6e79149ac"}
Sep 15 18:52:57.299188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.298906    2572 scope.go:117] "RemoveContainer" containerID="497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605"
Sep 15 18:52:57.316588 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.316569    2572 scope.go:117] "RemoveContainer" containerID="497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605"
Sep 15 18:52:57.316903 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:52:57.316875    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605\": container with ID starting with 497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605 not found: ID does not exist" containerID="497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605"
Sep 15 18:52:57.317013 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.316913    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605"} err="failed to get container status \"497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605\": rpc error: code = NotFound desc = could not find container \"497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605\": container with ID starting with 497ef36f0813f6b50c942101ef17996c20f1deb54979949c9053e2ceb75ed605 not found: ID does not exist"
Sep 15 18:52:57.318421 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.318401    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f9d69db8-m2fl5"]
Sep 15 18:52:57.322090 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.322072    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76f9d69db8-m2fl5"]
Sep 15 18:52:57.555970 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:52:57.555922    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c966a6a-9646-48c3-bf0e-46ac164d770e" path="/var/lib/kubelet/pods/0c966a6a-9646-48c3-bf0e-46ac164d770e/volumes"
Sep 15 18:53:13.424092 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:13.424055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:13.626269 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:13.626231    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:21.915948 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.915857    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-699f88d49-g2xdt"]
Sep 15 18:53:21.916422 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.916125    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" containerName="registry"
Sep 15 18:53:21.916422 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.916136    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" containerName="registry"
Sep 15 18:53:21.916422 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.916148    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c966a6a-9646-48c3-bf0e-46ac164d770e" containerName="console"
Sep 15 18:53:21.916422 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.916153    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c966a6a-9646-48c3-bf0e-46ac164d770e" containerName="console"
Sep 15 18:53:21.916422 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.916209    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="64d6f33e-4c4f-469b-93de-6cbd3c6e2c06" containerName="registry"
Sep 15 18:53:21.916422 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.916219    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c966a6a-9646-48c3-bf0e-46ac164d770e" containerName="console"
Sep 15 18:53:21.918099 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.918077    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:21.928551 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.928523    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699f88d49-g2xdt"]
Sep 15 18:53:21.967858 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.967830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:21.973791 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.973767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-trusted-ca-bundle\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:21.973904 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.973797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-config\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:21.973904 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.973830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-oauth-config\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:21.973904 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.973847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-oauth-serving-cert\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:21.973904 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.973892    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lf7l\" (UniqueName: \"kubernetes.io/projected/aa88fae4-2541-4ab2-8567-8d791fc907ae-kube-api-access-8lf7l\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:21.974081 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.973907    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-service-ca\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:21.974081 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:21.973963    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-serving-cert\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.023322 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.023292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:22.075135 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-serving-cert\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.075223 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075156    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-trusted-ca-bundle\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.075223 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075173    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-config\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.075312 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075292    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-oauth-config\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.075353 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075323    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-oauth-serving-cert\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.075353 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075347    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lf7l\" (UniqueName: \"kubernetes.io/projected/aa88fae4-2541-4ab2-8567-8d791fc907ae-kube-api-access-8lf7l\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.075448 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-service-ca\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.075958 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-trusted-ca-bundle\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.076064 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.075943    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-config\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.076127 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.076064    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-service-ca\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.076127 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.076064    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-oauth-serving-cert\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.077866 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.077844    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-oauth-config\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.078018 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.077983    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-serving-cert\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.082942 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.082922    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lf7l\" (UniqueName: \"kubernetes.io/projected/aa88fae4-2541-4ab2-8567-8d791fc907ae-kube-api-access-8lf7l\") pod \"console-699f88d49-g2xdt\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") " pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.114139 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.114117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:22.161884 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.161857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:22.229704 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.229654    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:22.499136 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.499109    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699f88d49-g2xdt"]
Sep 15 18:53:22.501407 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:53:22.501381    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa88fae4_2541_4ab2_8567_8d791fc907ae.slice/crio-2342a9d4131985694ae425d8a44652d9c0f49e383ffa129f0b7a4019db40afd9 WatchSource:0}: Error finding container 2342a9d4131985694ae425d8a44652d9c0f49e383ffa129f0b7a4019db40afd9: Status 404 returned error can't find the container with id 2342a9d4131985694ae425d8a44652d9c0f49e383ffa129f0b7a4019db40afd9
Sep 15 18:53:22.780795 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.780705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:22.881432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:22.881401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:23.404273 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:23.404240    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699f88d49-g2xdt" event={"ID":"aa88fae4-2541-4ab2-8567-8d791fc907ae","Type":"ContainerStarted","Data":"72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27"}
Sep 15 18:53:23.404652 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:23.404302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699f88d49-g2xdt" event={"ID":"aa88fae4-2541-4ab2-8567-8d791fc907ae","Type":"ContainerStarted","Data":"2342a9d4131985694ae425d8a44652d9c0f49e383ffa129f0b7a4019db40afd9"}
Sep 15 18:53:23.420529 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:23.420472    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-699f88d49-g2xdt" podStartSLOduration=2.420455837 podStartE2EDuration="2.420455837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:53:23.41921645 +0000 UTC m=+178.367444775" watchObservedRunningTime="2026-09-15 18:53:23.420455837 +0000 UTC m=+178.368684163"
Sep 15 18:53:32.230310 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:32.230276    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:32.230762 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:32.230325    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:32.234694 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:32.234671    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:32.444195 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:32.444165    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:53:32.486575 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:32.486503    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8ffdbd7f-c2889"]
Sep 15 18:53:32.598895 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:32.598861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:32.650659 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:32.650631    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:53.409158 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:53.409121    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:53.460568 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:53.460541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:53:57.509308 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.509243    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d8ffdbd7f-c2889" podUID="ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" containerName="console" containerID="cri-o://cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6" gracePeriod=15
Sep 15 18:53:57.750690 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.750666    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:53:57.824193 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824127    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-trusted-ca-bundle\") pod \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") "
Sep 15 18:53:57.824193 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824171    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-config\") pod \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") "
Sep 15 18:53:57.824379 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824194    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-serving-cert\") pod \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") "
Sep 15 18:53:57.824379 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824223    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8cr5\" (UniqueName: \"kubernetes.io/projected/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-kube-api-access-m8cr5\") pod \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") "
Sep 15 18:53:57.824379 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824247    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-oauth-serving-cert\") pod \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") "
Sep 15 18:53:57.824379 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824294    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-service-ca\") pod \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") "
Sep 15 18:53:57.824379 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824322    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-oauth-config\") pod \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\" (UID: \"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1\") "
Sep 15 18:53:57.824697 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824542    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" (UID: "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:53:57.824697 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824562    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-config" (OuterVolumeSpecName: "console-config") pod "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" (UID: "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:53:57.824697 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824666    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" (UID: "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:53:57.824697 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.824686    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" (UID: "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:53:57.826331 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.826309    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" (UID: "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:53:57.826415 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.826327    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" (UID: "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:53:57.826415 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.826354    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-kube-api-access-m8cr5" (OuterVolumeSpecName: "kube-api-access-m8cr5") pod "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" (UID: "ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1"). InnerVolumeSpecName "kube-api-access-m8cr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:53:57.925729 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.925704    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:53:57.925729 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.925727    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-oauth-config\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:53:57.925894 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.925736    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-trusted-ca-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:53:57.925894 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.925746    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-config\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:53:57.925894 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.925754    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-console-serving-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:53:57.925894 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.925762    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8cr5\" (UniqueName: \"kubernetes.io/projected/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-kube-api-access-m8cr5\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:53:57.925894 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:57.925771    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1-oauth-serving-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:53:58.534546 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.534519    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" containerID="cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6" exitCode=0
Sep 15 18:53:58.534893 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.534562    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8ffdbd7f-c2889"
Sep 15 18:53:58.534893 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.534600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8ffdbd7f-c2889" event={"ID":"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1","Type":"ContainerDied","Data":"cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6"}
Sep 15 18:53:58.534893 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.534652    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8ffdbd7f-c2889" event={"ID":"ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1","Type":"ContainerDied","Data":"fea433da2e92c5a9d9d5de2d375cd6f1062f70c7320f334b4b620b0a87b77fb6"}
Sep 15 18:53:58.534893 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.534673    2572 scope.go:117] "RemoveContainer" containerID="cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6"
Sep 15 18:53:58.543118 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.543101    2572 scope.go:117] "RemoveContainer" containerID="cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6"
Sep 15 18:53:58.543373 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:53:58.543354    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6\": container with ID starting with cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6 not found: ID does not exist" containerID="cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6"
Sep 15 18:53:58.543438 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.543385    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6"} err="failed to get container status \"cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6\": rpc error: code = NotFound desc = could not find container \"cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6\": container with ID starting with cf03d53c0eeba1b81f2dbb96f3611a101a4077d00a0223c6f9d6086c2a8d3eb6 not found: ID does not exist"
Sep 15 18:53:58.552577 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.552558    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8ffdbd7f-c2889"]
Sep 15 18:53:58.555902 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:58.555880    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d8ffdbd7f-c2889"]
Sep 15 18:53:59.555916 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:53:59.555880    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" path="/var/lib/kubelet/pods/ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1/volumes"
Sep 15 18:54:28.621409 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:28.621375    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:28.678085 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:28.678052    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:31.900161 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:31.900126    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b9b64c8f-2mv9x"]
Sep 15 18:54:31.900623 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:31.900433    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" containerName="console"
Sep 15 18:54:31.900623 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:31.900447    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" containerName="console"
Sep 15 18:54:31.900623 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:31.900512    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed3d4951-0d0d-440c-8b0d-54fd2b19b7d1" containerName="console"
Sep 15 18:54:31.905050 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:31.905027    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:31.914373 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:31.914349    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b9b64c8f-2mv9x"]
Sep 15 18:54:31.958371 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:31.958336    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:32.062188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.062154    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-config\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.062188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.062194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bd4\" (UniqueName: \"kubernetes.io/projected/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-kube-api-access-k9bd4\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.062380 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.062211    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-oauth-serving-cert\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.062380 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.062297    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-trusted-ca-bundle\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.062380 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.062327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-service-ca\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.062380 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.062357    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-serving-cert\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.062507 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.062413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-oauth-config\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.163124 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.163094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-trusted-ca-bundle\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.163282 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.163131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-service-ca\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.163282 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.163160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-serving-cert\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.163282 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.163218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-oauth-config\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.163282 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.163273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-config\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.163487 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.163311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bd4\" (UniqueName: \"kubernetes.io/projected/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-kube-api-access-k9bd4\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.163487 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.163401    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-oauth-serving-cert\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.163918 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.163893    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-service-ca\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.164070 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.164043    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-config\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.164164 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.164069    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-oauth-serving-cert\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.164384 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.164363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-trusted-ca-bundle\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.165701 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.165678    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-oauth-config\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.165899 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.165882    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-serving-cert\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.170390 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.170371    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bd4\" (UniqueName: \"kubernetes.io/projected/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-kube-api-access-k9bd4\") pod \"console-8b9b64c8f-2mv9x\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") " pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.215387 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.215352    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:32.486396 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.486306    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b9b64c8f-2mv9x"]
Sep 15 18:54:32.493733 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:54:32.493702    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9b2392_82fd_4e9d_8d40_5691dfb731e7.slice/crio-fbb6094ef136f2943939095886f9109fdc032c1661b7c0a18b582fdf03958bf7 WatchSource:0}: Error finding container fbb6094ef136f2943939095886f9109fdc032c1661b7c0a18b582fdf03958bf7: Status 404 returned error can't find the container with id fbb6094ef136f2943939095886f9109fdc032c1661b7c0a18b582fdf03958bf7
Sep 15 18:54:32.657083 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.657046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b9b64c8f-2mv9x" event={"ID":"2b9b2392-82fd-4e9d-8d40-5691dfb731e7","Type":"ContainerStarted","Data":"7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6"}
Sep 15 18:54:32.657257 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.657096    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b9b64c8f-2mv9x" event={"ID":"2b9b2392-82fd-4e9d-8d40-5691dfb731e7","Type":"ContainerStarted","Data":"fbb6094ef136f2943939095886f9109fdc032c1661b7c0a18b582fdf03958bf7"}
Sep 15 18:54:32.671428 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:32.671385    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b9b64c8f-2mv9x" podStartSLOduration=1.671371523 podStartE2EDuration="1.671371523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:54:32.671068139 +0000 UTC m=+247.619296465" watchObservedRunningTime="2026-09-15 18:54:32.671371523 +0000 UTC m=+247.619599848"
Sep 15 18:54:37.032671 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:37.032638    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:37.084317 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:37.084292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:40.600772 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:40.600734    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:40.701920 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:40.701892    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:42.216163 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:42.216131    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:42.216504 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:42.216194    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:42.220796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:42.220773    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:42.698099 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:42.698069    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:54:42.741672 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:42.741644    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699f88d49-g2xdt"]
Sep 15 18:54:42.833248 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:42.833206    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:42.935084 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:42.935053    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:43.036841 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:43.036751    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:54.028164 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:54.028088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:54.129733 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:54.129699    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:54:54.291113 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:54:54.291047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:55:07.763319 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:07.763272    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-699f88d49-g2xdt" podUID="aa88fae4-2541-4ab2-8567-8d791fc907ae" containerName="console" containerID="cri-o://72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27" gracePeriod=15
Sep 15 18:55:08.000205 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.000176    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:55:08.107721 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.107641    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-trusted-ca-bundle\") pod \"aa88fae4-2541-4ab2-8567-8d791fc907ae\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") "
Sep 15 18:55:08.107721 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.107682    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-oauth-config\") pod \"aa88fae4-2541-4ab2-8567-8d791fc907ae\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") "
Sep 15 18:55:08.107721 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.107704    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-config\") pod \"aa88fae4-2541-4ab2-8567-8d791fc907ae\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") "
Sep 15 18:55:08.107721 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.107723    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-oauth-serving-cert\") pod \"aa88fae4-2541-4ab2-8567-8d791fc907ae\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") "
Sep 15 18:55:08.108055 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.107757    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-service-ca\") pod \"aa88fae4-2541-4ab2-8567-8d791fc907ae\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") "
Sep 15 18:55:08.108055 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.107781    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lf7l\" (UniqueName: \"kubernetes.io/projected/aa88fae4-2541-4ab2-8567-8d791fc907ae-kube-api-access-8lf7l\") pod \"aa88fae4-2541-4ab2-8567-8d791fc907ae\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") "
Sep 15 18:55:08.108055 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.107798    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-serving-cert\") pod \"aa88fae4-2541-4ab2-8567-8d791fc907ae\" (UID: \"aa88fae4-2541-4ab2-8567-8d791fc907ae\") "
Sep 15 18:55:08.108259 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.108224    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-config" (OuterVolumeSpecName: "console-config") pod "aa88fae4-2541-4ab2-8567-8d791fc907ae" (UID: "aa88fae4-2541-4ab2-8567-8d791fc907ae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:55:08.108371 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.108240    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aa88fae4-2541-4ab2-8567-8d791fc907ae" (UID: "aa88fae4-2541-4ab2-8567-8d791fc907ae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:55:08.108371 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.108355    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa88fae4-2541-4ab2-8567-8d791fc907ae" (UID: "aa88fae4-2541-4ab2-8567-8d791fc907ae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:55:08.108483 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.108379    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa88fae4-2541-4ab2-8567-8d791fc907ae" (UID: "aa88fae4-2541-4ab2-8567-8d791fc907ae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:55:08.110018 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.109991    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa88fae4-2541-4ab2-8567-8d791fc907ae" (UID: "aa88fae4-2541-4ab2-8567-8d791fc907ae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:55:08.110098 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.110012    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa88fae4-2541-4ab2-8567-8d791fc907ae-kube-api-access-8lf7l" (OuterVolumeSpecName: "kube-api-access-8lf7l") pod "aa88fae4-2541-4ab2-8567-8d791fc907ae" (UID: "aa88fae4-2541-4ab2-8567-8d791fc907ae"). InnerVolumeSpecName "kube-api-access-8lf7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:55:08.110141 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.110091    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa88fae4-2541-4ab2-8567-8d791fc907ae" (UID: "aa88fae4-2541-4ab2-8567-8d791fc907ae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:55:08.209312 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.209259    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-trusted-ca-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:08.209312 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.209306    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-oauth-config\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:08.209312 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.209316    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-config\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:08.209312 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.209325    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-oauth-serving-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:08.209582 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.209333    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa88fae4-2541-4ab2-8567-8d791fc907ae-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:08.209582 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.209343    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lf7l\" (UniqueName: \"kubernetes.io/projected/aa88fae4-2541-4ab2-8567-8d791fc907ae-kube-api-access-8lf7l\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:08.209582 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.209351    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa88fae4-2541-4ab2-8567-8d791fc907ae-console-serving-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:08.788556 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.788522    2572 generic.go:356] "Generic (PLEG): container finished" podID="aa88fae4-2541-4ab2-8567-8d791fc907ae" containerID="72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27" exitCode=0
Sep 15 18:55:08.789004 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.788570    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699f88d49-g2xdt"
Sep 15 18:55:08.789004 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.788578    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699f88d49-g2xdt" event={"ID":"aa88fae4-2541-4ab2-8567-8d791fc907ae","Type":"ContainerDied","Data":"72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27"}
Sep 15 18:55:08.789004 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.788621    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699f88d49-g2xdt" event={"ID":"aa88fae4-2541-4ab2-8567-8d791fc907ae","Type":"ContainerDied","Data":"2342a9d4131985694ae425d8a44652d9c0f49e383ffa129f0b7a4019db40afd9"}
Sep 15 18:55:08.789004 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.788642    2572 scope.go:117] "RemoveContainer" containerID="72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27"
Sep 15 18:55:08.797329 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.797310    2572 scope.go:117] "RemoveContainer" containerID="72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27"
Sep 15 18:55:08.797649 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:55:08.797628    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27\": container with ID starting with 72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27 not found: ID does not exist" containerID="72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27"
Sep 15 18:55:08.797693 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.797658    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27"} err="failed to get container status \"72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27\": rpc error: code = NotFound desc = could not find container \"72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27\": container with ID starting with 72fe524dcde347ae3284f554f31cf6a9543d792b5066c06184f3cf86a51d9b27 not found: ID does not exist"
Sep 15 18:55:08.807495 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.807460    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699f88d49-g2xdt"]
Sep 15 18:55:08.809768 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:08.809740    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-699f88d49-g2xdt"]
Sep 15 18:55:09.558447 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:09.558406    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa88fae4-2541-4ab2-8567-8d791fc907ae" path="/var/lib/kubelet/pods/aa88fae4-2541-4ab2-8567-8d791fc907ae/volumes"
Sep 15 18:55:25.461998 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:25.461970    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 18:55:25.467969 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:25.467946    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 18:55:25.472315 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:25.472294    2572 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 18:55:33.923935 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:33.923896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:55:34.545048 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.545010    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"]
Sep 15 18:55:34.545326 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.545311    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa88fae4-2541-4ab2-8567-8d791fc907ae" containerName="console"
Sep 15 18:55:34.545372 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.545327    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa88fae4-2541-4ab2-8567-8d791fc907ae" containerName="console"
Sep 15 18:55:34.545408 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.545393    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa88fae4-2541-4ab2-8567-8d791fc907ae" containerName="console"
Sep 15 18:55:34.548453 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.548433    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.550727 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.550695    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 18:55:34.551378 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.551355    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 18:55:34.551465 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.551432    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jkbvv\""
Sep 15 18:55:34.557786 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.557756    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"]
Sep 15 18:55:34.609167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.609145    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.609272 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.609180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.609272 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.609216    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbc5r\" (UniqueName: \"kubernetes.io/projected/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-kube-api-access-hbc5r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.709857 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.709822    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.709957 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.709862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.709957 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.709890    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbc5r\" (UniqueName: \"kubernetes.io/projected/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-kube-api-access-hbc5r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.710231 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.710212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.710268 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.710257    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.717944 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.717918    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbc5r\" (UniqueName: \"kubernetes.io/projected/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-kube-api-access-hbc5r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:34.858867 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:34.858796    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:35.128362 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:35.128184    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"]
Sep 15 18:55:35.130832 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:55:35.130788    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5e844e_3539_4ef4_b2ad_6c3702cbde8c.slice/crio-6d5bb241e499cdf9db21d97f1c9ce30b4aae2f7a20144ef32b4fea6038c2bc99 WatchSource:0}: Error finding container 6d5bb241e499cdf9db21d97f1c9ce30b4aae2f7a20144ef32b4fea6038c2bc99: Status 404 returned error can't find the container with id 6d5bb241e499cdf9db21d97f1c9ce30b4aae2f7a20144ef32b4fea6038c2bc99
Sep 15 18:55:35.132848 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:35.132830    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 18:55:35.901848 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:35.901787    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s" event={"ID":"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c","Type":"ContainerStarted","Data":"6d5bb241e499cdf9db21d97f1c9ce30b4aae2f7a20144ef32b4fea6038c2bc99"}
Sep 15 18:55:36.810555 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:36.810514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:55:42.931242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:42.931208    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerID="6b193fddea067669a3d546a7977779b2518bd0be3400e9d3ed9793fce17da5b1" exitCode=0
Sep 15 18:55:42.931672 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:42.931296    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s" event={"ID":"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c","Type":"ContainerDied","Data":"6b193fddea067669a3d546a7977779b2518bd0be3400e9d3ed9793fce17da5b1"}
Sep 15 18:55:45.945774 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:45.945731    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerID="2338f387867d0dd5426f385c6ef2a4992f37de60777a0e4904ce95e98458d495" exitCode=0
Sep 15 18:55:45.946180 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:45.945830    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s" event={"ID":"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c","Type":"ContainerDied","Data":"2338f387867d0dd5426f385c6ef2a4992f37de60777a0e4904ce95e98458d495"}
Sep 15 18:55:53.979770 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:53.979740    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerID="429c29973c80ed12a5d7b6b80749651a0126592dabc661a979cf8f52d31b2907" exitCode=0
Sep 15 18:55:53.980138 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:53.979835    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s" event={"ID":"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c","Type":"ContainerDied","Data":"429c29973c80ed12a5d7b6b80749651a0126592dabc661a979cf8f52d31b2907"}
Sep 15 18:55:55.150839 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.150792    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:55.272102 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.272049    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-util\") pod \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") "
Sep 15 18:55:55.272102 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.272091    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-bundle\") pod \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") "
Sep 15 18:55:55.272287 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.272110    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbc5r\" (UniqueName: \"kubernetes.io/projected/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-kube-api-access-hbc5r\") pod \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\" (UID: \"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c\") "
Sep 15 18:55:55.272720 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.272695    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-bundle" (OuterVolumeSpecName: "bundle") pod "cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" (UID: "cb5e844e-3539-4ef4-b2ad-6c3702cbde8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:55:55.274219 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.274196    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-kube-api-access-hbc5r" (OuterVolumeSpecName: "kube-api-access-hbc5r") pod "cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" (UID: "cb5e844e-3539-4ef4-b2ad-6c3702cbde8c"). InnerVolumeSpecName "kube-api-access-hbc5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:55:55.276447 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.276426    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-util" (OuterVolumeSpecName: "util") pod "cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" (UID: "cb5e844e-3539-4ef4-b2ad-6c3702cbde8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:55:55.372757 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.372734    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:55.372757 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.372755    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbc5r\" (UniqueName: \"kubernetes.io/projected/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-kube-api-access-hbc5r\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:55.372897 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.372765    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb5e844e-3539-4ef4-b2ad-6c3702cbde8c-util\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:55:55.989022 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.988998    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s"
Sep 15 18:55:55.989200 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.988993    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnf7s" event={"ID":"cb5e844e-3539-4ef4-b2ad-6c3702cbde8c","Type":"ContainerDied","Data":"6d5bb241e499cdf9db21d97f1c9ce30b4aae2f7a20144ef32b4fea6038c2bc99"}
Sep 15 18:55:55.989200 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:55:55.989114    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d5bb241e499cdf9db21d97f1c9ce30b4aae2f7a20144ef32b4fea6038c2bc99"
Sep 15 18:56:00.703857 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:00.703821    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:01.498451 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:01.498415    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:02.674058 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.674024    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"]
Sep 15 18:56:02.674432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.674307    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerName="extract"
Sep 15 18:56:02.674432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.674319    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerName="extract"
Sep 15 18:56:02.674432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.674331    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerName="pull"
Sep 15 18:56:02.674432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.674336    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerName="pull"
Sep 15 18:56:02.674432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.674344    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerName="util"
Sep 15 18:56:02.674432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.674350    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerName="util"
Sep 15 18:56:02.674432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.674398    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb5e844e-3539-4ef4-b2ad-6c3702cbde8c" containerName="extract"
Sep 15 18:56:02.676255 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.676238    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"
Sep 15 18:56:02.678512 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.678482    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 15 18:56:02.678643 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.678521    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dzll4\""
Sep 15 18:56:02.678643 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.678597    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:56:02.688720 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.688697    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"]
Sep 15 18:56:02.826178 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.826145    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64hhl\" (UniqueName: \"kubernetes.io/projected/78025177-9964-449f-9f9e-ded94bb2bd6b-kube-api-access-64hhl\") pod \"cert-manager-operator-controller-manager-55c444bf86-54wjv\" (UID: \"78025177-9964-449f-9f9e-ded94bb2bd6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"
Sep 15 18:56:02.826318 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.826208    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78025177-9964-449f-9f9e-ded94bb2bd6b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-54wjv\" (UID: \"78025177-9964-449f-9f9e-ded94bb2bd6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"
Sep 15 18:56:02.926717 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.926652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64hhl\" (UniqueName: \"kubernetes.io/projected/78025177-9964-449f-9f9e-ded94bb2bd6b-kube-api-access-64hhl\") pod \"cert-manager-operator-controller-manager-55c444bf86-54wjv\" (UID: \"78025177-9964-449f-9f9e-ded94bb2bd6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"
Sep 15 18:56:02.926717 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.926691    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78025177-9964-449f-9f9e-ded94bb2bd6b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-54wjv\" (UID: \"78025177-9964-449f-9f9e-ded94bb2bd6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"
Sep 15 18:56:02.927035 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.927017    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78025177-9964-449f-9f9e-ded94bb2bd6b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-54wjv\" (UID: \"78025177-9964-449f-9f9e-ded94bb2bd6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"
Sep 15 18:56:02.934189 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.934168    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64hhl\" (UniqueName: \"kubernetes.io/projected/78025177-9964-449f-9f9e-ded94bb2bd6b-kube-api-access-64hhl\") pod \"cert-manager-operator-controller-manager-55c444bf86-54wjv\" (UID: \"78025177-9964-449f-9f9e-ded94bb2bd6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"
Sep 15 18:56:02.985159 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:02.985136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"
Sep 15 18:56:03.257376 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:03.257352    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv"]
Sep 15 18:56:03.259751 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:56:03.259725    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78025177_9964_449f_9f9e_ded94bb2bd6b.slice/crio-13bd29880cdc67654cc40d6af2ee08c62d5073526bcf00e2b97750a98c6d7edc WatchSource:0}: Error finding container 13bd29880cdc67654cc40d6af2ee08c62d5073526bcf00e2b97750a98c6d7edc: Status 404 returned error can't find the container with id 13bd29880cdc67654cc40d6af2ee08c62d5073526bcf00e2b97750a98c6d7edc
Sep 15 18:56:04.020580 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:04.020548    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv" event={"ID":"78025177-9964-449f-9f9e-ded94bb2bd6b","Type":"ContainerStarted","Data":"13bd29880cdc67654cc40d6af2ee08c62d5073526bcf00e2b97750a98c6d7edc"}
Sep 15 18:56:04.291243 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:04.291163    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:04.391330 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:04.391301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:05.837897 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:05.837866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:05.938105 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:05.938073    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:06.031265 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.031235    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv" event={"ID":"78025177-9964-449f-9f9e-ded94bb2bd6b","Type":"ContainerStarted","Data":"ff0bec20dfdbd975192307a40b612667e2072dfe425a7a841b476d9971557e56"}
Sep 15 18:56:06.049241 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.049199    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54wjv" podStartSLOduration=2.25966774 podStartE2EDuration="4.049181462s" totalImagesPullingTime="1.789513722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:56:06.047908329 +0000 UTC m=+340.996136656" watchObservedRunningTime="2026-09-15 18:56:06.049181462 +0000 UTC m=+340.997409787"
Sep 15 18:56:06.726117 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.726084    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:06.811431 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.811410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:06.912603 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.912580    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"]
Sep 15 18:56:06.914792 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.914776    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:06.917278 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.917251    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 18:56:06.917935 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.917919    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jkbvv\""
Sep 15 18:56:06.918015 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.917925    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 18:56:06.924903 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.924882    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"]
Sep 15 18:56:06.958732 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.958711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:06.958854 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.958748    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mst6d\" (UniqueName: \"kubernetes.io/projected/9924254c-5bff-45df-8138-e13462ce9f99-kube-api-access-mst6d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:06.958930 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:06.958884    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:07.059188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:07.059127    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:07.059188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:07.059160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:07.059188 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:07.059180    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mst6d\" (UniqueName: \"kubernetes.io/projected/9924254c-5bff-45df-8138-e13462ce9f99-kube-api-access-mst6d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:07.059487 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:07.059465    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:07.059562 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:07.059518    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:07.066697 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:07.066681    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mst6d\" (UniqueName: \"kubernetes.io/projected/9924254c-5bff-45df-8138-e13462ce9f99-kube-api-access-mst6d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:07.224743 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:07.224718    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:07.495012 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:07.494989    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"]
Sep 15 18:56:07.497289 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:56:07.497263    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9924254c_5bff_45df_8138_e13462ce9f99.slice/crio-54fbfbf0ce3cc57e5feb78ed24b8cd6ae946d32985a342cd3f5914bf20c7da87 WatchSource:0}: Error finding container 54fbfbf0ce3cc57e5feb78ed24b8cd6ae946d32985a342cd3f5914bf20c7da87: Status 404 returned error can't find the container with id 54fbfbf0ce3cc57e5feb78ed24b8cd6ae946d32985a342cd3f5914bf20c7da87
Sep 15 18:56:08.038816 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.038783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:08.044204 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.044178    2572 generic.go:356] "Generic (PLEG): container finished" podID="9924254c-5bff-45df-8138-e13462ce9f99" containerID="3070f34eb3dfd2c789d16ffd91767ef02d8dcecea4e59d8e0bef5342d2f9c7bb" exitCode=0
Sep 15 18:56:08.044315 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.044222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc" event={"ID":"9924254c-5bff-45df-8138-e13462ce9f99","Type":"ContainerDied","Data":"3070f34eb3dfd2c789d16ffd91767ef02d8dcecea4e59d8e0bef5342d2f9c7bb"}
Sep 15 18:56:08.044315 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.044256    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc" event={"ID":"9924254c-5bff-45df-8138-e13462ce9f99","Type":"ContainerStarted","Data":"54fbfbf0ce3cc57e5feb78ed24b8cd6ae946d32985a342cd3f5914bf20c7da87"}
Sep 15 18:56:08.219153 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.219125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:08.397917 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.397852    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"]
Sep 15 18:56:08.399918 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.399903    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"
Sep 15 18:56:08.402250 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.402228    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-v4hnz\""
Sep 15 18:56:08.402250 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.402246    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 18:56:08.402537 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.402253    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 18:56:08.408934 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.408912    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"]
Sep 15 18:56:08.470409 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.470388    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d529cd74-38fa-4954-8586-65a965762049-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-csrxm\" (UID: \"d529cd74-38fa-4954-8586-65a965762049\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"
Sep 15 18:56:08.470512 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.470413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pws2c\" (UniqueName: \"kubernetes.io/projected/d529cd74-38fa-4954-8586-65a965762049-kube-api-access-pws2c\") pod \"cert-manager-cainjector-559cdd8c87-csrxm\" (UID: \"d529cd74-38fa-4954-8586-65a965762049\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"
Sep 15 18:56:08.571178 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.571158    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d529cd74-38fa-4954-8586-65a965762049-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-csrxm\" (UID: \"d529cd74-38fa-4954-8586-65a965762049\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"
Sep 15 18:56:08.571271 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.571183    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pws2c\" (UniqueName: \"kubernetes.io/projected/d529cd74-38fa-4954-8586-65a965762049-kube-api-access-pws2c\") pod \"cert-manager-cainjector-559cdd8c87-csrxm\" (UID: \"d529cd74-38fa-4954-8586-65a965762049\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"
Sep 15 18:56:08.578465 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.578430    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d529cd74-38fa-4954-8586-65a965762049-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-csrxm\" (UID: \"d529cd74-38fa-4954-8586-65a965762049\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"
Sep 15 18:56:08.578686 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.578661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pws2c\" (UniqueName: \"kubernetes.io/projected/d529cd74-38fa-4954-8586-65a965762049-kube-api-access-pws2c\") pod \"cert-manager-cainjector-559cdd8c87-csrxm\" (UID: \"d529cd74-38fa-4954-8586-65a965762049\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"
Sep 15 18:56:08.716882 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.716859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"
Sep 15 18:56:08.986219 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:08.986197    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-csrxm"]
Sep 15 18:56:08.988712 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:56:08.988668    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd529cd74_38fa_4954_8586_65a965762049.slice/crio-c116fb7e012566db4e526d895893cbf2eb947dc2edb21301ca5cc77bcc9ffdeb WatchSource:0}: Error finding container c116fb7e012566db4e526d895893cbf2eb947dc2edb21301ca5cc77bcc9ffdeb: Status 404 returned error can't find the container with id c116fb7e012566db4e526d895893cbf2eb947dc2edb21301ca5cc77bcc9ffdeb
Sep 15 18:56:09.049679 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:09.049649    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm" event={"ID":"d529cd74-38fa-4954-8586-65a965762049","Type":"ContainerStarted","Data":"c116fb7e012566db4e526d895893cbf2eb947dc2edb21301ca5cc77bcc9ffdeb"}
Sep 15 18:56:11.060509 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:11.060478    2572 generic.go:356] "Generic (PLEG): container finished" podID="9924254c-5bff-45df-8138-e13462ce9f99" containerID="9d840495c6592a67825b928b54d8cf1b8185d9894b0bcda5eaf2f8ca88ea0ede" exitCode=0
Sep 15 18:56:11.060921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:11.060540    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc" event={"ID":"9924254c-5bff-45df-8138-e13462ce9f99","Type":"ContainerDied","Data":"9d840495c6592a67825b928b54d8cf1b8185d9894b0bcda5eaf2f8ca88ea0ede"}
Sep 15 18:56:11.083247 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:11.083223    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:11.141508 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:11.141482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:12.068159 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:12.068122    2572 generic.go:356] "Generic (PLEG): container finished" podID="9924254c-5bff-45df-8138-e13462ce9f99" containerID="c494ccc5c28087779437885697c4ca680fe538794e59edd5f24648165ebf290d" exitCode=0
Sep 15 18:56:12.068599 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:12.068246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc" event={"ID":"9924254c-5bff-45df-8138-e13462ce9f99","Type":"ContainerDied","Data":"c494ccc5c28087779437885697c4ca680fe538794e59edd5f24648165ebf290d"}
Sep 15 18:56:13.600768 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.600744    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:13.601134 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.601010    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mst6d\" (UniqueName: \"kubernetes.io/projected/9924254c-5bff-45df-8138-e13462ce9f99-kube-api-access-mst6d\") pod \"9924254c-5bff-45df-8138-e13462ce9f99\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") "
Sep 15 18:56:13.601134 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.601067    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-util\") pod \"9924254c-5bff-45df-8138-e13462ce9f99\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") "
Sep 15 18:56:13.601134 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.601101    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-bundle\") pod \"9924254c-5bff-45df-8138-e13462ce9f99\" (UID: \"9924254c-5bff-45df-8138-e13462ce9f99\") "
Sep 15 18:56:13.601490 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.601465    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-bundle" (OuterVolumeSpecName: "bundle") pod "9924254c-5bff-45df-8138-e13462ce9f99" (UID: "9924254c-5bff-45df-8138-e13462ce9f99"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:56:13.603218 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.603190    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9924254c-5bff-45df-8138-e13462ce9f99-kube-api-access-mst6d" (OuterVolumeSpecName: "kube-api-access-mst6d") pod "9924254c-5bff-45df-8138-e13462ce9f99" (UID: "9924254c-5bff-45df-8138-e13462ce9f99"). InnerVolumeSpecName "kube-api-access-mst6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:56:13.605713 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.605693    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-util" (OuterVolumeSpecName: "util") pod "9924254c-5bff-45df-8138-e13462ce9f99" (UID: "9924254c-5bff-45df-8138-e13462ce9f99"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:56:13.701707 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.701684    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-util\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:13.701830 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.701709    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9924254c-5bff-45df-8138-e13462ce9f99-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:13.701830 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:13.701723    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mst6d\" (UniqueName: \"kubernetes.io/projected/9924254c-5bff-45df-8138-e13462ce9f99-kube-api-access-mst6d\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:14.087511 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:14.087481    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc"
Sep 15 18:56:14.087678 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:14.087485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xzjc" event={"ID":"9924254c-5bff-45df-8138-e13462ce9f99","Type":"ContainerDied","Data":"54fbfbf0ce3cc57e5feb78ed24b8cd6ae946d32985a342cd3f5914bf20c7da87"}
Sep 15 18:56:14.087678 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:14.087611    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54fbfbf0ce3cc57e5feb78ed24b8cd6ae946d32985a342cd3f5914bf20c7da87"
Sep 15 18:56:14.089075 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:14.089050    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm" event={"ID":"d529cd74-38fa-4954-8586-65a965762049","Type":"ContainerStarted","Data":"1dd3d5f51f263706112ddb812acdef2ec167b79426f1f1a768d44985c95b4a78"}
Sep 15 18:56:14.103940 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:14.103770    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-csrxm" podStartSLOduration=1.4779497990000001 podStartE2EDuration="6.103752702s" totalImagesPullingTime="4.625802903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:56:14.102902883 +0000 UTC m=+349.051131211" watchObservedRunningTime="2026-09-15 18:56:14.103752702 +0000 UTC m=+349.051981029"
Sep 15 18:56:16.201826 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:16.201775    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:16.303247 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:16.303216    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:16.432996 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:16.432972    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:17.962330 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.962228    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xzlkl"]
Sep 15 18:56:17.962841 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.962700    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9924254c-5bff-45df-8138-e13462ce9f99" containerName="extract"
Sep 15 18:56:17.962841 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.962723    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9924254c-5bff-45df-8138-e13462ce9f99" containerName="extract"
Sep 15 18:56:17.962841 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.962738    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9924254c-5bff-45df-8138-e13462ce9f99" containerName="util"
Sep 15 18:56:17.962841 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.962746    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9924254c-5bff-45df-8138-e13462ce9f99" containerName="util"
Sep 15 18:56:17.962841 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.962772    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9924254c-5bff-45df-8138-e13462ce9f99" containerName="pull"
Sep 15 18:56:17.962841 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.962780    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9924254c-5bff-45df-8138-e13462ce9f99" containerName="pull"
Sep 15 18:56:17.963153 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.962885    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9924254c-5bff-45df-8138-e13462ce9f99" containerName="extract"
Sep 15 18:56:17.964963 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.964935    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xzlkl"
Sep 15 18:56:17.967041 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.967013    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tp7l4\""
Sep 15 18:56:17.974850 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:17.974823    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xzlkl"]
Sep 15 18:56:18.030964 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:18.030934    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t2cc\" (UniqueName: \"kubernetes.io/projected/b4d8fc08-6aef-474b-af91-4bd991106b48-kube-api-access-2t2cc\") pod \"cert-manager-55b4d954d5-xzlkl\" (UID: \"b4d8fc08-6aef-474b-af91-4bd991106b48\") " pod="cert-manager/cert-manager-55b4d954d5-xzlkl"
Sep 15 18:56:18.031060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:18.030973    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4d8fc08-6aef-474b-af91-4bd991106b48-bound-sa-token\") pod \"cert-manager-55b4d954d5-xzlkl\" (UID: \"b4d8fc08-6aef-474b-af91-4bd991106b48\") " pod="cert-manager/cert-manager-55b4d954d5-xzlkl"
Sep 15 18:56:18.132032 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:18.132009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4d8fc08-6aef-474b-af91-4bd991106b48-bound-sa-token\") pod \"cert-manager-55b4d954d5-xzlkl\" (UID: \"b4d8fc08-6aef-474b-af91-4bd991106b48\") " pod="cert-manager/cert-manager-55b4d954d5-xzlkl"
Sep 15 18:56:18.132131 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:18.132071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t2cc\" (UniqueName: \"kubernetes.io/projected/b4d8fc08-6aef-474b-af91-4bd991106b48-kube-api-access-2t2cc\") pod \"cert-manager-55b4d954d5-xzlkl\" (UID: \"b4d8fc08-6aef-474b-af91-4bd991106b48\") " pod="cert-manager/cert-manager-55b4d954d5-xzlkl"
Sep 15 18:56:18.139772 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:18.139746    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4d8fc08-6aef-474b-af91-4bd991106b48-bound-sa-token\") pod \"cert-manager-55b4d954d5-xzlkl\" (UID: \"b4d8fc08-6aef-474b-af91-4bd991106b48\") " pod="cert-manager/cert-manager-55b4d954d5-xzlkl"
Sep 15 18:56:18.139916 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:18.139896    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t2cc\" (UniqueName: \"kubernetes.io/projected/b4d8fc08-6aef-474b-af91-4bd991106b48-kube-api-access-2t2cc\") pod \"cert-manager-55b4d954d5-xzlkl\" (UID: \"b4d8fc08-6aef-474b-af91-4bd991106b48\") " pod="cert-manager/cert-manager-55b4d954d5-xzlkl"
Sep 15 18:56:18.275886 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:18.275833    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xzlkl"
Sep 15 18:56:18.542474 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:18.542410    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xzlkl"]
Sep 15 18:56:18.546157 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:56:18.546125    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4d8fc08_6aef_474b_af91_4bd991106b48.slice/crio-06cbde2f88a253134de1e0933c77eaad3494706ae0c7220e2ed667444e3e0cec WatchSource:0}: Error finding container 06cbde2f88a253134de1e0933c77eaad3494706ae0c7220e2ed667444e3e0cec: Status 404 returned error can't find the container with id 06cbde2f88a253134de1e0933c77eaad3494706ae0c7220e2ed667444e3e0cec
Sep 15 18:56:19.112742 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:19.112709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xzlkl" event={"ID":"b4d8fc08-6aef-474b-af91-4bd991106b48","Type":"ContainerStarted","Data":"ee03340174002fb0e75fbae64867b70981e61c3f4b9b8452ac8a73dd39ec6745"}
Sep 15 18:56:19.113120 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:19.112751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xzlkl" event={"ID":"b4d8fc08-6aef-474b-af91-4bd991106b48","Type":"ContainerStarted","Data":"06cbde2f88a253134de1e0933c77eaad3494706ae0c7220e2ed667444e3e0cec"}
Sep 15 18:56:22.697240 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:22.697205    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:22.797968 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:22.797938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:29.289245 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:29.289210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:29.339437 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:29.339407    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:31.203273 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:31.203240    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:32.285884 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.285831    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xzlkl" podStartSLOduration=15.285800698 podStartE2EDuration="15.285800698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:56:19.127552349 +0000 UTC m=+354.075780676" watchObservedRunningTime="2026-09-15 18:56:32.285800698 +0000 UTC m=+367.234029023"
Sep 15 18:56:32.286546 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.286529    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"]
Sep 15 18:56:32.290885 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.290866    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.292991 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.292962    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 18:56:32.293131 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.292994    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jkbvv\""
Sep 15 18:56:32.293562 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.293542    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 18:56:32.297211 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.297187    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"]
Sep 15 18:56:32.338021 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.338001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.338143 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.338033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8x5x\" (UniqueName: \"kubernetes.io/projected/8275ac58-7a7d-4427-97db-eaa1eee532dd-kube-api-access-c8x5x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.338143 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.338073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.438571 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.438536    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.438680 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.438579    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8x5x\" (UniqueName: \"kubernetes.io/projected/8275ac58-7a7d-4427-97db-eaa1eee532dd-kube-api-access-c8x5x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.438680 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.438620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.438869 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.438852    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.438987 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.438969    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.446044 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.446026    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8x5x\" (UniqueName: \"kubernetes.io/projected/8275ac58-7a7d-4427-97db-eaa1eee532dd-kube-api-access-c8x5x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.600698 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.600646    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:32.866698 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:32.866670    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"]
Sep 15 18:56:32.868875 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:56:32.868844    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8275ac58_7a7d_4427_97db_eaa1eee532dd.slice/crio-4534ab62b39b85c4fab2fa07119c16c94c492ffd7ef0a8f7723f36034c41721d WatchSource:0}: Error finding container 4534ab62b39b85c4fab2fa07119c16c94c492ffd7ef0a8f7723f36034c41721d: Status 404 returned error can't find the container with id 4534ab62b39b85c4fab2fa07119c16c94c492ffd7ef0a8f7723f36034c41721d
Sep 15 18:56:33.173857 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:33.173826    2572 generic.go:356] "Generic (PLEG): container finished" podID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerID="4e80d773e75571f1a51d23bbb96dc5701d03f05fc04a82644383d12dc573113d" exitCode=0
Sep 15 18:56:33.173981 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:33.173871    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw" event={"ID":"8275ac58-7a7d-4427-97db-eaa1eee532dd","Type":"ContainerDied","Data":"4e80d773e75571f1a51d23bbb96dc5701d03f05fc04a82644383d12dc573113d"}
Sep 15 18:56:33.173981 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:33.173909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw" event={"ID":"8275ac58-7a7d-4427-97db-eaa1eee532dd","Type":"ContainerStarted","Data":"4534ab62b39b85c4fab2fa07119c16c94c492ffd7ef0a8f7723f36034c41721d"}
Sep 15 18:56:34.180488 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:34.180460    2572 generic.go:356] "Generic (PLEG): container finished" podID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerID="ec2933cda60b3dde9871370ae2d4e439383f05bf06a0795f210d4607fa02f26f" exitCode=0
Sep 15 18:56:34.180819 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:34.180539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw" event={"ID":"8275ac58-7a7d-4427-97db-eaa1eee532dd","Type":"ContainerDied","Data":"ec2933cda60b3dde9871370ae2d4e439383f05bf06a0795f210d4607fa02f26f"}
Sep 15 18:56:35.188288 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:35.188256    2572 generic.go:356] "Generic (PLEG): container finished" podID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerID="2b3edbc91b11964972d0a25600211baf3b406fe9c7064536ba4dc96fee996317" exitCode=0
Sep 15 18:56:35.188648 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:35.188341    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw" event={"ID":"8275ac58-7a7d-4427-97db-eaa1eee532dd","Type":"ContainerDied","Data":"2b3edbc91b11964972d0a25600211baf3b406fe9c7064536ba4dc96fee996317"}
Sep 15 18:56:36.313865 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.313842    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:36.364511 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.364486    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-util\") pod \"8275ac58-7a7d-4427-97db-eaa1eee532dd\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") "
Sep 15 18:56:36.364625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.364522    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8x5x\" (UniqueName: \"kubernetes.io/projected/8275ac58-7a7d-4427-97db-eaa1eee532dd-kube-api-access-c8x5x\") pod \"8275ac58-7a7d-4427-97db-eaa1eee532dd\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") "
Sep 15 18:56:36.364625 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.364555    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-bundle\") pod \"8275ac58-7a7d-4427-97db-eaa1eee532dd\" (UID: \"8275ac58-7a7d-4427-97db-eaa1eee532dd\") "
Sep 15 18:56:36.365358 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.365333    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-bundle" (OuterVolumeSpecName: "bundle") pod "8275ac58-7a7d-4427-97db-eaa1eee532dd" (UID: "8275ac58-7a7d-4427-97db-eaa1eee532dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:56:36.366492 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.366463    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8275ac58-7a7d-4427-97db-eaa1eee532dd-kube-api-access-c8x5x" (OuterVolumeSpecName: "kube-api-access-c8x5x") pod "8275ac58-7a7d-4427-97db-eaa1eee532dd" (UID: "8275ac58-7a7d-4427-97db-eaa1eee532dd"). InnerVolumeSpecName "kube-api-access-c8x5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:56:36.369778 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.369751    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-util" (OuterVolumeSpecName: "util") pod "8275ac58-7a7d-4427-97db-eaa1eee532dd" (UID: "8275ac58-7a7d-4427-97db-eaa1eee532dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:56:36.465199 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.465154    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-util\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:36.465199 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.465173    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8x5x\" (UniqueName: \"kubernetes.io/projected/8275ac58-7a7d-4427-97db-eaa1eee532dd-kube-api-access-c8x5x\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:36.465199 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:36.465183    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8275ac58-7a7d-4427-97db-eaa1eee532dd-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:37.198219 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:37.198193    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw"
Sep 15 18:56:37.198363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:37.198221    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5srlw" event={"ID":"8275ac58-7a7d-4427-97db-eaa1eee532dd","Type":"ContainerDied","Data":"4534ab62b39b85c4fab2fa07119c16c94c492ffd7ef0a8f7723f36034c41721d"}
Sep 15 18:56:37.198363 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:37.198258    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4534ab62b39b85c4fab2fa07119c16c94c492ffd7ef0a8f7723f36034c41721d"
Sep 15 18:56:42.694216 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.694184    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"]
Sep 15 18:56:42.694572 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.694510    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerName="extract"
Sep 15 18:56:42.694572 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.694523    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerName="extract"
Sep 15 18:56:42.694572 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.694541    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerName="pull"
Sep 15 18:56:42.694572 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.694547    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerName="pull"
Sep 15 18:56:42.694572 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.694554    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerName="util"
Sep 15 18:56:42.694572 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.694559    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerName="util"
Sep 15 18:56:42.694752 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.694611    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8275ac58-7a7d-4427-97db-eaa1eee532dd" containerName="extract"
Sep 15 18:56:42.696794 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.696775    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.699443 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.699423    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 18:56:42.699578 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.699488    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jkbvv\""
Sep 15 18:56:42.700160 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.700145    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 18:56:42.716933 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.716911    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"]
Sep 15 18:56:42.807025 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.806997    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.807130 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.807043    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.807130 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.807083    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbsfq\" (UniqueName: \"kubernetes.io/projected/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-kube-api-access-rbsfq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.907971 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.907948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.908046 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.907983    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbsfq\" (UniqueName: \"kubernetes.io/projected/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-kube-api-access-rbsfq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.908086 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.908043    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.908370 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.908350    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.908432 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.908350    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:42.915877 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:42.915858    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbsfq\" (UniqueName: \"kubernetes.io/projected/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-kube-api-access-rbsfq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:43.005764 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:43.005702    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:43.272414 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:43.272386    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"]
Sep 15 18:56:43.274824 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:56:43.274784    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ff6ffb_e40a_4ccf_9c3c_f5172e3f652b.slice/crio-984aac3089d2b7c85a7848656c92055a9ecc59b70a0c0a261a08022a569af984 WatchSource:0}: Error finding container 984aac3089d2b7c85a7848656c92055a9ecc59b70a0c0a261a08022a569af984: Status 404 returned error can't find the container with id 984aac3089d2b7c85a7848656c92055a9ecc59b70a0c0a261a08022a569af984
Sep 15 18:56:43.296792 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:43.296754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:43.398318 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:43.398294    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:43.800016 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:43.799979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:43.899973 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:43.899947    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:44.227351 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.227326    2572 generic.go:356] "Generic (PLEG): container finished" podID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerID="d5fc6512b16f0fabd4b50d39f3f8a83f1e47a1927425473dcd191f430e74620c" exitCode=0
Sep 15 18:56:44.227471 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.227411    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf" event={"ID":"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b","Type":"ContainerDied","Data":"d5fc6512b16f0fabd4b50d39f3f8a83f1e47a1927425473dcd191f430e74620c"}
Sep 15 18:56:44.227522 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.227468    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf" event={"ID":"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b","Type":"ContainerStarted","Data":"984aac3089d2b7c85a7848656c92055a9ecc59b70a0c0a261a08022a569af984"}
Sep 15 18:56:44.415062 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.415035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:44.614589 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.614520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:44.714965 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.714938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:44.748892 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.748871    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"]
Sep 15 18:56:44.750957 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.750942    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.752908 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.752889    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h74qm\""
Sep 15 18:56:44.753006 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.752917    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 18:56:44.753006 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.752942    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 18:56:44.753124 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.753032    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 18:56:44.753124 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.753077    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 18:56:44.772962 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.772941    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"]
Sep 15 18:56:44.822729 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.822708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60e32ebd-bf9f-48d6-a2bc-206b75c18165-tmp\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.823065 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.822751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60e32ebd-bf9f-48d6-a2bc-206b75c18165-webhook-cert\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.823065 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.822771    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wlrr\" (UniqueName: \"kubernetes.io/projected/60e32ebd-bf9f-48d6-a2bc-206b75c18165-kube-api-access-4wlrr\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.823065 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.822857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60e32ebd-bf9f-48d6-a2bc-206b75c18165-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.823065 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.822960    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60e32ebd-bf9f-48d6-a2bc-206b75c18165-manifests\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.924134 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.924111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60e32ebd-bf9f-48d6-a2bc-206b75c18165-tmp\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.924235 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.924160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60e32ebd-bf9f-48d6-a2bc-206b75c18165-webhook-cert\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.924235 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.924179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wlrr\" (UniqueName: \"kubernetes.io/projected/60e32ebd-bf9f-48d6-a2bc-206b75c18165-kube-api-access-4wlrr\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.924235 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.924208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60e32ebd-bf9f-48d6-a2bc-206b75c18165-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.924235 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.924227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60e32ebd-bf9f-48d6-a2bc-206b75c18165-manifests\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.924642 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.924620    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60e32ebd-bf9f-48d6-a2bc-206b75c18165-manifests\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.926174 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.926148    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60e32ebd-bf9f-48d6-a2bc-206b75c18165-tmp\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.926519 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.926502    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60e32ebd-bf9f-48d6-a2bc-206b75c18165-webhook-cert\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.926593 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.926508    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60e32ebd-bf9f-48d6-a2bc-206b75c18165-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.938209 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.938185    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wlrr\" (UniqueName: \"kubernetes.io/projected/60e32ebd-bf9f-48d6-a2bc-206b75c18165-kube-api-access-4wlrr\") pod \"opendatahub-operator-controller-manager-7467f6b4cf-tdzbw\" (UID: \"60e32ebd-bf9f-48d6-a2bc-206b75c18165\") " pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:44.981737 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:44.981714    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:45.061031 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.061008    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:45.083228 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.083189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:45.190812 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.190783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:45.232963 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.232938    2572 generic.go:356] "Generic (PLEG): container finished" podID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerID="4d27a7b99bdd70a18f6ee735c07046f8808ee0a36a2187734b835e0e8c4cab6f" exitCode=0
Sep 15 18:56:45.233063 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.233005    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf" event={"ID":"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b","Type":"ContainerDied","Data":"4d27a7b99bdd70a18f6ee735c07046f8808ee0a36a2187734b835e0e8c4cab6f"}
Sep 15 18:56:45.256888 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.256865    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:45.311291 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.311267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:45.332356 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.332332    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"]
Sep 15 18:56:45.354433 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:56:45.354409    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e32ebd_bf9f_48d6_a2bc_206b75c18165.slice/crio-7d2446ba49b09c299550958072d89a61e95288ae883fe0c065ab2d3827405fb0 WatchSource:0}: Error finding container 7d2446ba49b09c299550958072d89a61e95288ae883fe0c065ab2d3827405fb0: Status 404 returned error can't find the container with id 7d2446ba49b09c299550958072d89a61e95288ae883fe0c065ab2d3827405fb0
Sep 15 18:56:45.412117 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:45.412082    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:46.241234 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:46.241196    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw" event={"ID":"60e32ebd-bf9f-48d6-a2bc-206b75c18165","Type":"ContainerStarted","Data":"7d2446ba49b09c299550958072d89a61e95288ae883fe0c065ab2d3827405fb0"}
Sep 15 18:56:46.244000 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:46.243966    2572 generic.go:356] "Generic (PLEG): container finished" podID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerID="d98e4ab9c4ec7e284473c75ef2cf93e6d29d661e3def9f45f9d41b66ab476acd" exitCode=0
Sep 15 18:56:46.244147 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:46.244082    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf" event={"ID":"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b","Type":"ContainerDied","Data":"d98e4ab9c4ec7e284473c75ef2cf93e6d29d661e3def9f45f9d41b66ab476acd"}
Sep 15 18:56:47.177525 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:47.177446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:47.289302 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:47.289268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:48.343129 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.343102    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:48.456714 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.456691    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-util\") pod \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") "
Sep 15 18:56:48.456834 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.456731    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbsfq\" (UniqueName: \"kubernetes.io/projected/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-kube-api-access-rbsfq\") pod \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") "
Sep 15 18:56:48.456834 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.456781    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-bundle\") pod \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\" (UID: \"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b\") "
Sep 15 18:56:48.457409 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.457384    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-bundle" (OuterVolumeSpecName: "bundle") pod "e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" (UID: "e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:56:48.458589 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.458564    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-kube-api-access-rbsfq" (OuterVolumeSpecName: "kube-api-access-rbsfq") pod "e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" (UID: "e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b"). InnerVolumeSpecName "kube-api-access-rbsfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:56:48.558257 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.558234    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbsfq\" (UniqueName: \"kubernetes.io/projected/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-kube-api-access-rbsfq\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:48.558257 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.558256    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:48.581634 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.581577    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-util" (OuterVolumeSpecName: "util") pod "e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" (UID: "e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:56:48.659051 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:48.659029    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b-util\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:56:49.261209 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:49.261172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw" event={"ID":"60e32ebd-bf9f-48d6-a2bc-206b75c18165","Type":"ContainerStarted","Data":"de2d1bb44e51410f1ccb9416a421d737a2641549883c05b91a5d624812ce41b0"}
Sep 15 18:56:49.263157 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:49.263131    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf" event={"ID":"e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b","Type":"ContainerDied","Data":"984aac3089d2b7c85a7848656c92055a9ecc59b70a0c0a261a08022a569af984"}
Sep 15 18:56:49.263280 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:49.263162    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cswdf"
Sep 15 18:56:49.263280 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:49.263169    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="984aac3089d2b7c85a7848656c92055a9ecc59b70a0c0a261a08022a569af984"
Sep 15 18:56:49.477305 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:49.477275    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:49.578031 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:49.577970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:50.268789 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:50.268753    2572 generic.go:356] "Generic (PLEG): container finished" podID="60e32ebd-bf9f-48d6-a2bc-206b75c18165" containerID="de2d1bb44e51410f1ccb9416a421d737a2641549883c05b91a5d624812ce41b0" exitCode=0
Sep 15 18:56:50.268988 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:50.268839    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw" event={"ID":"60e32ebd-bf9f-48d6-a2bc-206b75c18165","Type":"ContainerDied","Data":"de2d1bb44e51410f1ccb9416a421d737a2641549883c05b91a5d624812ce41b0"}
Sep 15 18:56:51.275376 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:51.275308    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw" event={"ID":"60e32ebd-bf9f-48d6-a2bc-206b75c18165","Type":"ContainerStarted","Data":"b36d71df41d110fdedc831ed129cec04ebe18e43612a17554328a64ec38474b7"}
Sep 15 18:56:51.275739 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:51.275455    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:56:51.295223 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:51.295181    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw" podStartSLOduration=2.578526327 podStartE2EDuration="7.295168517s" totalImagesPullingTime="3.670468965s" totalInitContainerRuntime="1.046173225s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:56:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:56:51.29329679 +0000 UTC m=+386.241525115" watchObservedRunningTime="2026-09-15 18:56:51.295168517 +0000 UTC m=+386.243396904"
Sep 15 18:56:55.457177 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:55.457144    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:55.557356 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:55.557329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:55.816138 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:55.816065    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:56:55.916965 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:56:55.916933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:02.284854 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:02.284801    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7467f6b4cf-tdzbw"
Sep 15 18:57:04.029903 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.029867    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"]
Sep 15 18:57:04.030254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.030174    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerName="util"
Sep 15 18:57:04.030254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.030185    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerName="util"
Sep 15 18:57:04.030254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.030193    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerName="pull"
Sep 15 18:57:04.030254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.030199    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerName="pull"
Sep 15 18:57:04.030254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.030206    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerName="extract"
Sep 15 18:57:04.030254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.030211    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerName="extract"
Sep 15 18:57:04.030437 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.030264    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ff6ffb-e40a-4ccf-9c3c-f5172e3f652b" containerName="extract"
Sep 15 18:57:04.038548 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.038524    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.041801 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.041775    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 18:57:04.041959 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.041839    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 18:57:04.042691 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.042670    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z9746\""
Sep 15 18:57:04.042853 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.042675    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 18:57:04.043077 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.043044    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"]
Sep 15 18:57:04.043620 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.043602    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 18:57:04.043788 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.043767    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 18:57:04.181140 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.181084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwdxs\" (UniqueName: \"kubernetes.io/projected/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-kube-api-access-mwdxs\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.181268 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.181152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-manager-config\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.181268 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.181210    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-metrics-cert\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.181268 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.181237    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-cert\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.266199 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.266163    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:04.282101 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.282044    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-metrics-cert\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.282197 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.282100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-cert\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.282197 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.282159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwdxs\" (UniqueName: \"kubernetes.io/projected/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-kube-api-access-mwdxs\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.282197 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.282186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-manager-config\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.282954 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.282934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-manager-config\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.284506 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.284486    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-cert\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.284588 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.284555    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-metrics-cert\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.291037 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.291015    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwdxs\" (UniqueName: \"kubernetes.io/projected/69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2-kube-api-access-mwdxs\") pod \"lws-controller-manager-5cb45c66cf-v9t5c\" (UID: \"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2\") " pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.348245 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.348209    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:04.388672 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.388637    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:04.597350 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.597279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:04.626243 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.626219    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"]
Sep 15 18:57:04.628583 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:57:04.628555    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f1e7dd_0bbd_4565_9ea2_1fff1d5dcca2.slice/crio-527e9dafa7915027fd3224306d2cc0d0b7047de5c196a3e4d75dbd563eb66b99 WatchSource:0}: Error finding container 527e9dafa7915027fd3224306d2cc0d0b7047de5c196a3e4d75dbd563eb66b99: Status 404 returned error can't find the container with id 527e9dafa7915027fd3224306d2cc0d0b7047de5c196a3e4d75dbd563eb66b99
Sep 15 18:57:04.754925 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:04.754900    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:05.341590 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:05.341556    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c" event={"ID":"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2","Type":"ContainerStarted","Data":"527e9dafa7915027fd3224306d2cc0d0b7047de5c196a3e4d75dbd563eb66b99"}
Sep 15 18:57:05.934987 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:05.934953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:05.994863 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:05.994792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:06.347678 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:06.347641    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c" event={"ID":"69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2","Type":"ContainerStarted","Data":"cb0bb961aef026c928a35fdf377905ca1497b77f9153b0759496f5c3e156f560"}
Sep 15 18:57:06.348146 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:06.347766    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:06.364334 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:06.364279    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c" podStartSLOduration=0.818245682 podStartE2EDuration="2.364262401s" totalImagesPullingTime="1.546016719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:57:06.364085607 +0000 UTC m=+401.312313936" watchObservedRunningTime="2026-09-15 18:57:06.364262401 +0000 UTC m=+401.312490729"
Sep 15 18:57:06.989434 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:06.989404    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:08.289165 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.289126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:08.382056 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.382020    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657b8d88f6-xmrsh"]
Sep 15 18:57:08.385867 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.385842    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.398060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.398036    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657b8d88f6-xmrsh"]
Sep 15 18:57:08.479394 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.479367    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:08.518622 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.518590    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-serving-cert\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.518744 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.518629    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-config\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.518744 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.518650    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-service-ca\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.518744 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.518710    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-oauth-config\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.518744 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.518729    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktcg2\" (UniqueName: \"kubernetes.io/projected/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-kube-api-access-ktcg2\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.518907 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.518800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-oauth-serving-cert\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.518907 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.518896    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-trusted-ca-bundle\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.580251 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.580178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:08.619385 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.619357    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-config\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.619517 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.619392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-service-ca\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.619517 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.619419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-oauth-config\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.619517 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.619435    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcg2\" (UniqueName: \"kubernetes.io/projected/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-kube-api-access-ktcg2\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.619517 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.619466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-oauth-serving-cert\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.619740 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.619537    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-trusted-ca-bundle\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.619740 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.619572    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-serving-cert\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.620232 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.620204    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-oauth-serving-cert\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.620232 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.620223    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-service-ca\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.620393 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.620262    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-config\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.620828 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.620788    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-trusted-ca-bundle\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.622088 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.622071    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-oauth-config\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.622218 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.622202    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-console-serving-cert\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.629061 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.629043    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktcg2\" (UniqueName: \"kubernetes.io/projected/b5a54cd6-99e0-417e-99bc-7acf2e2ba71f-kube-api-access-ktcg2\") pod \"console-657b8d88f6-xmrsh\" (UID: \"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f\") " pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.644014 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.643979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:08.696864 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.696842    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:08.978359 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:08.978322    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657b8d88f6-xmrsh"]
Sep 15 18:57:08.981248 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:57:08.981219    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a54cd6_99e0_417e_99bc_7acf2e2ba71f.slice/crio-c3efc98aa86e3f57a3639ff97ec42d65a2b16871c4e485557cbc132bee9ca8f3 WatchSource:0}: Error finding container c3efc98aa86e3f57a3639ff97ec42d65a2b16871c4e485557cbc132bee9ca8f3: Status 404 returned error can't find the container with id c3efc98aa86e3f57a3639ff97ec42d65a2b16871c4e485557cbc132bee9ca8f3
Sep 15 18:57:09.172783 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:09.172746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:09.221568 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:09.221530    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:09.363227 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:09.363135    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b8d88f6-xmrsh" event={"ID":"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f","Type":"ContainerStarted","Data":"bd9dfcde485ff683c045c66fa8ba9acb97841109d0a115b2365e9f7d88952223"}
Sep 15 18:57:09.363227 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:09.363191    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b8d88f6-xmrsh" event={"ID":"b5a54cd6-99e0-417e-99bc-7acf2e2ba71f","Type":"ContainerStarted","Data":"c3efc98aa86e3f57a3639ff97ec42d65a2b16871c4e485557cbc132bee9ca8f3"}
Sep 15 18:57:09.379401 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:09.379353    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657b8d88f6-xmrsh" podStartSLOduration=1.379338113 podStartE2EDuration="1.379338113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:57:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:57:09.378223185 +0000 UTC m=+404.326451523" watchObservedRunningTime="2026-09-15 18:57:09.379338113 +0000 UTC m=+404.327566438"
Sep 15 18:57:11.345839 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.345786    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:11.447536 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.447504    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:11.593127 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.593091    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"]
Sep 15 18:57:11.596938 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.596894    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.598994 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.598970    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 18:57:11.599088 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.598994    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cdpkv\""
Sep 15 18:57:11.607444 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.607421    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"]
Sep 15 18:57:11.624849 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.624826    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:11.746149 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/713773c8-4fb7-4cdc-a907-39774841a097-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.746304 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/713773c8-4fb7-4cdc-a907-39774841a097-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.746304 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.746304 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746252    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.746304 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.746518 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746323    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwqz\" (UniqueName: \"kubernetes.io/projected/713773c8-4fb7-4cdc-a907-39774841a097-kube-api-access-2lwqz\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.746518 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/713773c8-4fb7-4cdc-a907-39774841a097-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.746518 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.746518 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.746490    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847468 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847409    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/713773c8-4fb7-4cdc-a907-39774841a097-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847468 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847439    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847468 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847463    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847691 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847576    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/713773c8-4fb7-4cdc-a907-39774841a097-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847691 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847668    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/713773c8-4fb7-4cdc-a907-39774841a097-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847797 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847892 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847832    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847892 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847839    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847995 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847995 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.847995 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.847938    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwqz\" (UniqueName: \"kubernetes.io/projected/713773c8-4fb7-4cdc-a907-39774841a097-kube-api-access-2lwqz\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.848203 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.848185    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.848265 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.848206    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.848265 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.848248    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/713773c8-4fb7-4cdc-a907-39774841a097-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.849884 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.849863    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/713773c8-4fb7-4cdc-a907-39774841a097-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.850039 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.850020    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/713773c8-4fb7-4cdc-a907-39774841a097-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.854672 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.854651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/713773c8-4fb7-4cdc-a907-39774841a097-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.855380 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.855358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwqz\" (UniqueName: \"kubernetes.io/projected/713773c8-4fb7-4cdc-a907-39774841a097-kube-api-access-2lwqz\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf\" (UID: \"713773c8-4fb7-4cdc-a907-39774841a097\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:11.907610 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:11.907587    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:12.182914 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:12.182889    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"]
Sep 15 18:57:12.184469 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:57:12.184439    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713773c8_4fb7_4cdc_a907_39774841a097.slice/crio-57acfd02e23e08a2972655780ec769eadb42481a5affc0c8493b23190f0b0349 WatchSource:0}: Error finding container 57acfd02e23e08a2972655780ec769eadb42481a5affc0c8493b23190f0b0349: Status 404 returned error can't find the container with id 57acfd02e23e08a2972655780ec769eadb42481a5affc0c8493b23190f0b0349
Sep 15 18:57:12.260743 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:12.260701    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:12.316233 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:12.316194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:12.388097 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:12.388054    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf" event={"ID":"713773c8-4fb7-4cdc-a907-39774841a097","Type":"ContainerStarted","Data":"57acfd02e23e08a2972655780ec769eadb42481a5affc0c8493b23190f0b0349"}
Sep 15 18:57:15.302272 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.302238    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8llcc"]
Sep 15 18:57:15.305954 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.305922    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:15.307833 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.307790    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 15 18:57:15.308002 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.307959    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dntkd\""
Sep 15 18:57:15.315831 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.315787    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8llcc"]
Sep 15 18:57:15.330999 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.330962    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:15.430722 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.430686    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:15.479869 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.479826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r59t2\" (UniqueName: \"kubernetes.io/projected/77aa8897-a755-481f-8588-7bbee6dc57a2-kube-api-access-r59t2\") pod \"odh-model-controller-7998c67dc4-8llcc\" (UID: \"77aa8897-a755-481f-8588-7bbee6dc57a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:15.480037 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.479905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77aa8897-a755-481f-8588-7bbee6dc57a2-cert\") pod \"odh-model-controller-7998c67dc4-8llcc\" (UID: \"77aa8897-a755-481f-8588-7bbee6dc57a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:15.581237 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.581159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77aa8897-a755-481f-8588-7bbee6dc57a2-cert\") pod \"odh-model-controller-7998c67dc4-8llcc\" (UID: \"77aa8897-a755-481f-8588-7bbee6dc57a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:15.581379 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.581261    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r59t2\" (UniqueName: \"kubernetes.io/projected/77aa8897-a755-481f-8588-7bbee6dc57a2-kube-api-access-r59t2\") pod \"odh-model-controller-7998c67dc4-8llcc\" (UID: \"77aa8897-a755-481f-8588-7bbee6dc57a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:15.583798 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.583773    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77aa8897-a755-481f-8588-7bbee6dc57a2-cert\") pod \"odh-model-controller-7998c67dc4-8llcc\" (UID: \"77aa8897-a755-481f-8588-7bbee6dc57a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:15.590113 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.590089    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r59t2\" (UniqueName: \"kubernetes.io/projected/77aa8897-a755-481f-8588-7bbee6dc57a2-kube-api-access-r59t2\") pod \"odh-model-controller-7998c67dc4-8llcc\" (UID: \"77aa8897-a755-481f-8588-7bbee6dc57a2\") " pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:15.622406 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.622286    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:15.791885 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.791845    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:15.892147 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:15.892061    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:16.120331 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:16.120297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:16.594971 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:16.594924    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 18:57:16.595393 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:16.595022    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 18:57:16.595393 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:16.595068    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 18:57:16.792092 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:16.792063    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8llcc"]
Sep 15 18:57:16.794551 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:57:16.794509    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77aa8897_a755_481f_8588_7bbee6dc57a2.slice/crio-6302a6d84f9b824a36d85205c41132237eb0124b2b20749288bd9624c96904cf WatchSource:0}: Error finding container 6302a6d84f9b824a36d85205c41132237eb0124b2b20749288bd9624c96904cf: Status 404 returned error can't find the container with id 6302a6d84f9b824a36d85205c41132237eb0124b2b20749288bd9624c96904cf
Sep 15 18:57:17.354415 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:17.354382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cb45c66cf-v9t5c"
Sep 15 18:57:17.415675 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:17.415640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8llcc" event={"ID":"77aa8897-a755-481f-8588-7bbee6dc57a2","Type":"ContainerStarted","Data":"6302a6d84f9b824a36d85205c41132237eb0124b2b20749288bd9624c96904cf"}
Sep 15 18:57:17.417440 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:17.417405    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf" event={"ID":"713773c8-4fb7-4cdc-a907-39774841a097","Type":"ContainerStarted","Data":"7e98e9ab36de145deec7e0dec1ffa7e4a7a7efafa720323a75e0e5f6ac709242"}
Sep 15 18:57:17.417615 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:17.417548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:17.434938 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:17.434892    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf" podStartSLOduration=2.02696037 podStartE2EDuration="6.43487371s" totalImagesPullingTime="4.40791334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:57:17.433656331 +0000 UTC m=+412.381884659" watchObservedRunningTime="2026-09-15 18:57:17.43487371 +0000 UTC m=+412.383102040"
Sep 15 18:57:17.517842 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:17.517798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:17.908197 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:17.908162    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:17.913910 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:17.913820    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:18.423067 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:18.423028    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:18.424228 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:18.424197    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf"
Sep 15 18:57:18.698048 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:18.697948    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:18.698048 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:18.698015    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:18.703324 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:18.703296    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:19.432996 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:19.432964    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657b8d88f6-xmrsh"
Sep 15 18:57:19.482491 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:19.482457    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b9b64c8f-2mv9x"]
Sep 15 18:57:19.574634 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:19.574600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:19.676164 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:19.676111    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:19.728904 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:19.728800    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:20.435156 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:20.435117    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8llcc" event={"ID":"77aa8897-a755-481f-8588-7bbee6dc57a2","Type":"ContainerStarted","Data":"c643e99aa2be46b0f008dda6200b93fef23524a319f86858679ff1426c92f5f1"}
Sep 15 18:57:20.435587 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:20.435471    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:20.450242 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:20.450191    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-8llcc" podStartSLOduration=2.440992604 podStartE2EDuration="5.450172924s" totalImagesPullingTime="3.00918032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:57:20.449071808 +0000 UTC m=+415.397300135" watchObservedRunningTime="2026-09-15 18:57:20.450172924 +0000 UTC m=+415.398401251"
Sep 15 18:57:22.344019 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.343982    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"]
Sep 15 18:57:22.351130 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.351109    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.353314 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.353288    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 18:57:22.353314 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.353306    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 18:57:22.354071 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.353790    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nznzx\""
Sep 15 18:57:22.354071 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.353790    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 18:57:22.362544 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.362523    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"]
Sep 15 18:57:22.448493 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.448461    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.448493 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.448496    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9rdp\" (UniqueName: \"kubernetes.io/projected/e54897df-1b71-44fa-9e68-0615b1ea8e3f-kube-api-access-n9rdp\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.448731 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.448519    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.448731 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.448572    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.448731 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.448620    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e54897df-1b71-44fa-9e68-0615b1ea8e3f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.448731 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.448669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.448928 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.448744    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.549140 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.549104    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.549140 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.549140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9rdp\" (UniqueName: \"kubernetes.io/projected/e54897df-1b71-44fa-9e68-0615b1ea8e3f-kube-api-access-n9rdp\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.549338 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.549256    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.549338 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.549288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.549338 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.549320    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e54897df-1b71-44fa-9e68-0615b1ea8e3f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.549502 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.549371    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.549502 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.549451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.550071 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.550045    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.551729 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.551702    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.551931 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.551909    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.552004 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.551976    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e54897df-1b71-44fa-9e68-0615b1ea8e3f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.552061 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.552024    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e54897df-1b71-44fa-9e68-0615b1ea8e3f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.559382 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.559358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9rdp\" (UniqueName: \"kubernetes.io/projected/e54897df-1b71-44fa-9e68-0615b1ea8e3f-kube-api-access-n9rdp\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.559479 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.559422    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e54897df-1b71-44fa-9e68-0615b1ea8e3f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mv7q9\" (UID: \"e54897df-1b71-44fa-9e68-0615b1ea8e3f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.668221 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.668197    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:22.946338 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:22.946313    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"]
Sep 15 18:57:22.948245 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:57:22.948220    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54897df_1b71_44fa_9e68_0615b1ea8e3f.slice/crio-18377eacf017390464b3b54b15dbeffc5fa0204fe6b05c312e90357026b6e81d WatchSource:0}: Error finding container 18377eacf017390464b3b54b15dbeffc5fa0204fe6b05c312e90357026b6e81d: Status 404 returned error can't find the container with id 18377eacf017390464b3b54b15dbeffc5fa0204fe6b05c312e90357026b6e81d
Sep 15 18:57:23.449941 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:23.449908    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9" event={"ID":"e54897df-1b71-44fa-9e68-0615b1ea8e3f","Type":"ContainerStarted","Data":"18377eacf017390464b3b54b15dbeffc5fa0204fe6b05c312e90357026b6e81d"}
Sep 15 18:57:24.832013 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:24.831971    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:24.943413 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:24.943380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:25.253341 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:25.253304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:25.346227 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:25.346184    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:25.633348 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:25.633319    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 18:57:25.633429 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:25.633376    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 18:57:26.073139 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:26.073105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:26.136872 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:26.136830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:26.246496 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:26.246459    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:57:26.466722 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:26.466684    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9" event={"ID":"e54897df-1b71-44fa-9e68-0615b1ea8e3f","Type":"ContainerStarted","Data":"4511cf199f15b4f58d1a10bb6f2bbeb7e52a160641ff7edd69e774c1cfcb02cb"}
Sep 15 18:57:26.466910 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:26.466772    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:26.468348 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:26.468319    2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-mv7q9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 18:57:26.468466 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:26.468376    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9" podUID="e54897df-1b71-44fa-9e68-0615b1ea8e3f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 18:57:26.487099 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:26.487055    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9" podStartSLOduration=1.8043145809999999 podStartE2EDuration="4.487041965s" totalImagesPullingTime="2.682727384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:57:26.484700045 +0000 UTC m=+421.432928372" watchObservedRunningTime="2026-09-15 18:57:26.487041965 +0000 UTC m=+421.435270291"
Sep 15 18:57:27.472411 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:27.472382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mv7q9"
Sep 15 18:57:32.446587 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:32.446555    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-8llcc"
Sep 15 18:57:44.507991 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.507944    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8b9b64c8f-2mv9x" podUID="2b9b2392-82fd-4e9d-8d40-5691dfb731e7" containerName="console" containerID="cri-o://7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6" gracePeriod=15
Sep 15 18:57:44.755194 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.755166    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:57:44.830185 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830098    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-oauth-config\") pod \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") "
Sep 15 18:57:44.830185 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830144    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-service-ca\") pod \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") "
Sep 15 18:57:44.830474 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830204    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9bd4\" (UniqueName: \"kubernetes.io/projected/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-kube-api-access-k9bd4\") pod \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") "
Sep 15 18:57:44.830474 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830226    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-serving-cert\") pod \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") "
Sep 15 18:57:44.830474 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830274    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-config\") pod \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") "
Sep 15 18:57:44.830474 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830307    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-oauth-serving-cert\") pod \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") "
Sep 15 18:57:44.830474 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830337    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-trusted-ca-bundle\") pod \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\" (UID: \"2b9b2392-82fd-4e9d-8d40-5691dfb731e7\") "
Sep 15 18:57:44.830850 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830763    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b9b2392-82fd-4e9d-8d40-5691dfb731e7" (UID: "2b9b2392-82fd-4e9d-8d40-5691dfb731e7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:57:44.830850 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830779    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-config" (OuterVolumeSpecName: "console-config") pod "2b9b2392-82fd-4e9d-8d40-5691dfb731e7" (UID: "2b9b2392-82fd-4e9d-8d40-5691dfb731e7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:57:44.830850 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.830792    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b9b2392-82fd-4e9d-8d40-5691dfb731e7" (UID: "2b9b2392-82fd-4e9d-8d40-5691dfb731e7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:57:44.831071 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.831054    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2b9b2392-82fd-4e9d-8d40-5691dfb731e7" (UID: "2b9b2392-82fd-4e9d-8d40-5691dfb731e7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 18:57:44.832374 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.832347    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b9b2392-82fd-4e9d-8d40-5691dfb731e7" (UID: "2b9b2392-82fd-4e9d-8d40-5691dfb731e7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:57:44.832818 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.832781    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b9b2392-82fd-4e9d-8d40-5691dfb731e7" (UID: "2b9b2392-82fd-4e9d-8d40-5691dfb731e7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 18:57:44.832921 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.832796    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-kube-api-access-k9bd4" (OuterVolumeSpecName: "kube-api-access-k9bd4") pod "2b9b2392-82fd-4e9d-8d40-5691dfb731e7" (UID: "2b9b2392-82fd-4e9d-8d40-5691dfb731e7"). InnerVolumeSpecName "kube-api-access-k9bd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:57:44.931539 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.931487    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9bd4\" (UniqueName: \"kubernetes.io/projected/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-kube-api-access-k9bd4\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:57:44.931539 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.931531    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-serving-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:57:44.931539 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.931542    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-config\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:57:44.931539 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.931550    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-oauth-serving-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:57:44.931539 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.931559    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-trusted-ca-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:57:44.931879 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.931568    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-console-oauth-config\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:57:44.931879 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:44.931576    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9b2392-82fd-4e9d-8d40-5691dfb731e7-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:57:45.554865 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.554829    2572 generic.go:356] "Generic (PLEG): container finished" podID="2b9b2392-82fd-4e9d-8d40-5691dfb731e7" containerID="7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6" exitCode=0
Sep 15 18:57:45.555410 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.554905    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b9b64c8f-2mv9x"
Sep 15 18:57:45.556757 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.556730    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b9b64c8f-2mv9x" event={"ID":"2b9b2392-82fd-4e9d-8d40-5691dfb731e7","Type":"ContainerDied","Data":"7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6"}
Sep 15 18:57:45.556882 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.556772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b9b64c8f-2mv9x" event={"ID":"2b9b2392-82fd-4e9d-8d40-5691dfb731e7","Type":"ContainerDied","Data":"fbb6094ef136f2943939095886f9109fdc032c1661b7c0a18b582fdf03958bf7"}
Sep 15 18:57:45.556882 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.556793    2572 scope.go:117] "RemoveContainer" containerID="7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6"
Sep 15 18:57:45.566020 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.565999    2572 scope.go:117] "RemoveContainer" containerID="7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6"
Sep 15 18:57:45.566353 ip-10-0-129-252 kubenswrapper[2572]: E0915 18:57:45.566326    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6\": container with ID starting with 7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6 not found: ID does not exist" containerID="7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6"
Sep 15 18:57:45.566409 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.566375    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6"} err="failed to get container status \"7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6\": rpc error: code = NotFound desc = could not find container \"7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6\": container with ID starting with 7a96524c3d9b51eb50ac862ca2dc3c28d94666344e785ed5ca1fe02183ba63d6 not found: ID does not exist"
Sep 15 18:57:45.578167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.578066    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b9b64c8f-2mv9x"]
Sep 15 18:57:45.584634 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:45.581087    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b9b64c8f-2mv9x"]
Sep 15 18:57:47.557017 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:57:47.556989    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b9b2392-82fd-4e9d-8d40-5691dfb731e7" path="/var/lib/kubelet/pods/2b9b2392-82fd-4e9d-8d40-5691dfb731e7/volumes"
Sep 15 18:58:05.388888 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:05.388854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:16.764648 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:16.764608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:16.833446 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:16.833405    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:20.236969 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.236931    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"]
Sep 15 18:58:20.237345 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.237244    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9b2392-82fd-4e9d-8d40-5691dfb731e7" containerName="console"
Sep 15 18:58:20.237345 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.237256    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9b2392-82fd-4e9d-8d40-5691dfb731e7" containerName="console"
Sep 15 18:58:20.237345 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.237318    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9b2392-82fd-4e9d-8d40-5691dfb731e7" containerName="console"
Sep 15 18:58:20.240493 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.240474    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.242393 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.242367    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 18:58:20.242487 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.242379    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 18:58:20.243049 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.243032    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jkbvv\""
Sep 15 18:58:20.248038 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.248014    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"]
Sep 15 18:58:20.334966 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.334928    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"]
Sep 15 18:58:20.338425 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.338408    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.345126 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.345098    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"]
Sep 15 18:58:20.397478 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.397445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.397615 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.397529    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.397615 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.397547    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4jsh\" (UniqueName: \"kubernetes.io/projected/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-kube-api-access-n4jsh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.435578 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.435552    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"]
Sep 15 18:58:20.438914 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.438899    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.446702 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.446683    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"]
Sep 15 18:58:20.498618 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.498559    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.498618 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.498604    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.498759 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.498623    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jsh\" (UniqueName: \"kubernetes.io/projected/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-kube-api-access-n4jsh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.498759 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.498656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.498759 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.498692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.498759 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.498718    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czlng\" (UniqueName: \"kubernetes.io/projected/bdf84b71-bf1f-4746-a9a8-8773508c021d-kube-api-access-czlng\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.498980 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.498962    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.499018 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.498995    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.505605 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.505582    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jsh\" (UniqueName: \"kubernetes.io/projected/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-kube-api-access-n4jsh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.538562 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.538537    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"]
Sep 15 18:58:20.542134 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.542119    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.549196 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.549171    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"]
Sep 15 18:58:20.550467 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.550448    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:20.599650 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.599622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.599775 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.599656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h4gg\" (UniqueName: \"kubernetes.io/projected/62fe8184-ae7d-44a5-9305-d4281c988e4c-kube-api-access-5h4gg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.599775 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.599716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.599927 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.599784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.599927 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.599844    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czlng\" (UniqueName: \"kubernetes.io/projected/bdf84b71-bf1f-4746-a9a8-8773508c021d-kube-api-access-czlng\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.599927 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.599902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.600243 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.600221    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.600243 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.600233    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.609355 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.609301    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czlng\" (UniqueName: \"kubernetes.io/projected/bdf84b71-bf1f-4746-a9a8-8773508c021d-kube-api-access-czlng\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.648140 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.648110    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:20.700427 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.700393    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s77xt\" (UniqueName: \"kubernetes.io/projected/635d7ee5-5563-4f4f-87ad-5194230e5dcc-kube-api-access-s77xt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.700563 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.700462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.700563 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.700499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.700563 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.700535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.700742 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.700597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.700742 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.700627    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h4gg\" (UniqueName: \"kubernetes.io/projected/62fe8184-ae7d-44a5-9305-d4281c988e4c-kube-api-access-5h4gg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.700876 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.700824    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.701060 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.701038    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.708575 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.708550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h4gg\" (UniqueName: \"kubernetes.io/projected/62fe8184-ae7d-44a5-9305-d4281c988e4c-kube-api-access-5h4gg\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.748256 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.748225    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:20.801464 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.801413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s77xt\" (UniqueName: \"kubernetes.io/projected/635d7ee5-5563-4f4f-87ad-5194230e5dcc-kube-api-access-s77xt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.801591 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.801479    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.801591 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.801533    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.802125 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.802077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.802276 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.802253    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.810065 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.810043    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s77xt\" (UniqueName: \"kubernetes.io/projected/635d7ee5-5563-4f4f-87ad-5194230e5dcc-kube-api-access-s77xt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.822581 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.822537    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"]
Sep 15 18:58:20.826081 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:58:20.826059    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26854ef0_a7b8_4dfc_8a9e_0f40eed14929.slice/crio-ed7175bed4398e51b70ea9c07a9e840623fe158c64bdfd232abf6dc1f5909f03 WatchSource:0}: Error finding container ed7175bed4398e51b70ea9c07a9e840623fe158c64bdfd232abf6dc1f5909f03: Status 404 returned error can't find the container with id ed7175bed4398e51b70ea9c07a9e840623fe158c64bdfd232abf6dc1f5909f03
Sep 15 18:58:20.852637 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.852618    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:20.917925 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:20.917899    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"]
Sep 15 18:58:20.919945 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:58:20.919916    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf84b71_bf1f_4746_a9a8_8773508c021d.slice/crio-cddd5b600f68caba92267ea1f323afbf16d5c10f4748964bd568bb383c194aa4 WatchSource:0}: Error finding container cddd5b600f68caba92267ea1f323afbf16d5c10f4748964bd568bb383c194aa4: Status 404 returned error can't find the container with id cddd5b600f68caba92267ea1f323afbf16d5c10f4748964bd568bb383c194aa4
Sep 15 18:58:21.019057 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:58:21.019021    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62fe8184_ae7d_44a5_9305_d4281c988e4c.slice/crio-eaa2bbcb057f88ba41c5b7443f56f868db71fb1a62cfdd16106594085b4103a7 WatchSource:0}: Error finding container eaa2bbcb057f88ba41c5b7443f56f868db71fb1a62cfdd16106594085b4103a7: Status 404 returned error can't find the container with id eaa2bbcb057f88ba41c5b7443f56f868db71fb1a62cfdd16106594085b4103a7
Sep 15 18:58:21.019253 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.019208    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"]
Sep 15 18:58:21.123238 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.123213    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"]
Sep 15 18:58:21.125950 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:58:21.125926    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635d7ee5_5563_4f4f_87ad_5194230e5dcc.slice/crio-903b1884566b3c6bb47f612e143aa05ce2f62c39321c533b6fe3f7800f7780d7 WatchSource:0}: Error finding container 903b1884566b3c6bb47f612e143aa05ce2f62c39321c533b6fe3f7800f7780d7: Status 404 returned error can't find the container with id 903b1884566b3c6bb47f612e143aa05ce2f62c39321c533b6fe3f7800f7780d7
Sep 15 18:58:21.722517 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.722483    2572 generic.go:356] "Generic (PLEG): container finished" podID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerID="010a8ed6f6b523a83d87b25b00fab16987b541768e59be7f52738bd28cfdf286" exitCode=0
Sep 15 18:58:21.723013 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.722551    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb" event={"ID":"635d7ee5-5563-4f4f-87ad-5194230e5dcc","Type":"ContainerDied","Data":"010a8ed6f6b523a83d87b25b00fab16987b541768e59be7f52738bd28cfdf286"}
Sep 15 18:58:21.723013 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.722589    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb" event={"ID":"635d7ee5-5563-4f4f-87ad-5194230e5dcc","Type":"ContainerStarted","Data":"903b1884566b3c6bb47f612e143aa05ce2f62c39321c533b6fe3f7800f7780d7"}
Sep 15 18:58:21.730328 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.730304    2572 generic.go:356] "Generic (PLEG): container finished" podID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerID="788d20bf12b83e5665d02e7e68939fbfe722e7a61a635bbb4750bec7ba775cec" exitCode=0
Sep 15 18:58:21.730456 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.730386    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq" event={"ID":"bdf84b71-bf1f-4746-a9a8-8773508c021d","Type":"ContainerDied","Data":"788d20bf12b83e5665d02e7e68939fbfe722e7a61a635bbb4750bec7ba775cec"}
Sep 15 18:58:21.730523 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.730480    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq" event={"ID":"bdf84b71-bf1f-4746-a9a8-8773508c021d","Type":"ContainerStarted","Data":"cddd5b600f68caba92267ea1f323afbf16d5c10f4748964bd568bb383c194aa4"}
Sep 15 18:58:21.732354 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.732330    2572 generic.go:356] "Generic (PLEG): container finished" podID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerID="584384d890aa1b59da8e1f4f1f0d3a10e916b7460317d3594ea30a92270bdd3f" exitCode=0
Sep 15 18:58:21.732478 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.732354    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4" event={"ID":"62fe8184-ae7d-44a5-9305-d4281c988e4c","Type":"ContainerDied","Data":"584384d890aa1b59da8e1f4f1f0d3a10e916b7460317d3594ea30a92270bdd3f"}
Sep 15 18:58:21.732478 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.732392    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4" event={"ID":"62fe8184-ae7d-44a5-9305-d4281c988e4c","Type":"ContainerStarted","Data":"eaa2bbcb057f88ba41c5b7443f56f868db71fb1a62cfdd16106594085b4103a7"}
Sep 15 18:58:21.734089 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.734069    2572 generic.go:356] "Generic (PLEG): container finished" podID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerID="0dea635905dfb5c36460116a34600893b169d657133e5ea2affb30aad83b41ac" exitCode=0
Sep 15 18:58:21.734206 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.734099    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr" event={"ID":"26854ef0-a7b8-4dfc-8a9e-0f40eed14929","Type":"ContainerDied","Data":"0dea635905dfb5c36460116a34600893b169d657133e5ea2affb30aad83b41ac"}
Sep 15 18:58:21.734206 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:21.734129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr" event={"ID":"26854ef0-a7b8-4dfc-8a9e-0f40eed14929","Type":"ContainerStarted","Data":"ed7175bed4398e51b70ea9c07a9e840623fe158c64bdfd232abf6dc1f5909f03"}
Sep 15 18:58:23.749667 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:23.749630    2572 generic.go:356] "Generic (PLEG): container finished" podID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerID="719dd153856d0970c5e0743b0ce20b40875cafabad58133133bac1989c365ff1" exitCode=0
Sep 15 18:58:23.750157 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:23.749706    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4" event={"ID":"62fe8184-ae7d-44a5-9305-d4281c988e4c","Type":"ContainerDied","Data":"719dd153856d0970c5e0743b0ce20b40875cafabad58133133bac1989c365ff1"}
Sep 15 18:58:23.751755 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:23.751730    2572 generic.go:356] "Generic (PLEG): container finished" podID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerID="c1e1a1ea1eb10862db01705902d3c64d56c0e9f5d91288da8e9c0d6fc70b08c3" exitCode=0
Sep 15 18:58:23.751856 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:23.751822    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb" event={"ID":"635d7ee5-5563-4f4f-87ad-5194230e5dcc","Type":"ContainerDied","Data":"c1e1a1ea1eb10862db01705902d3c64d56c0e9f5d91288da8e9c0d6fc70b08c3"}
Sep 15 18:58:23.753837 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:23.753799    2572 generic.go:356] "Generic (PLEG): container finished" podID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerID="785f01822378379971b87c39edb26713ae9c7a4236369bb6340e99340b3c90b5" exitCode=0
Sep 15 18:58:23.753944 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:23.753900    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq" event={"ID":"bdf84b71-bf1f-4746-a9a8-8773508c021d","Type":"ContainerDied","Data":"785f01822378379971b87c39edb26713ae9c7a4236369bb6340e99340b3c90b5"}
Sep 15 18:58:24.761954 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:24.761918    2572 generic.go:356] "Generic (PLEG): container finished" podID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerID="1bdf70e0f15d2b11b5278080e42b6baa924b28d268fa910fb4ebc6eeedb01ac1" exitCode=0
Sep 15 18:58:24.762401 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:24.762000    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4" event={"ID":"62fe8184-ae7d-44a5-9305-d4281c988e4c","Type":"ContainerDied","Data":"1bdf70e0f15d2b11b5278080e42b6baa924b28d268fa910fb4ebc6eeedb01ac1"}
Sep 15 18:58:24.763783 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:24.763760    2572 generic.go:356] "Generic (PLEG): container finished" podID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerID="89cf8c87cdfa267445bcba64f4df5a88bbbdb33b099930000b77a7fd50523e5b" exitCode=0
Sep 15 18:58:24.763917 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:24.763841    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr" event={"ID":"26854ef0-a7b8-4dfc-8a9e-0f40eed14929","Type":"ContainerDied","Data":"89cf8c87cdfa267445bcba64f4df5a88bbbdb33b099930000b77a7fd50523e5b"}
Sep 15 18:58:24.766297 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:24.766275    2572 generic.go:356] "Generic (PLEG): container finished" podID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerID="fd5febe1e9a2b688a71178a046d87a7555e2f2e3235d9336efab2fb9c971e33a" exitCode=0
Sep 15 18:58:24.766409 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:24.766343    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb" event={"ID":"635d7ee5-5563-4f4f-87ad-5194230e5dcc","Type":"ContainerDied","Data":"fd5febe1e9a2b688a71178a046d87a7555e2f2e3235d9336efab2fb9c971e33a"}
Sep 15 18:58:24.768533 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:24.768510    2572 generic.go:356] "Generic (PLEG): container finished" podID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerID="f5c2ac67b91520f627b421068a239f3f66b9e07e7ec1078beb96a39cbd6f9a13" exitCode=0
Sep 15 18:58:24.768633 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:24.768545    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq" event={"ID":"bdf84b71-bf1f-4746-a9a8-8773508c021d","Type":"ContainerDied","Data":"f5c2ac67b91520f627b421068a239f3f66b9e07e7ec1078beb96a39cbd6f9a13"}
Sep 15 18:58:25.775987 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.775898    2572 generic.go:356] "Generic (PLEG): container finished" podID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerID="0ab46906a0bd54464dcdf14dceb33cd264efad9715f98a8f09b836032037a77e" exitCode=0
Sep 15 18:58:25.775987 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.775963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr" event={"ID":"26854ef0-a7b8-4dfc-8a9e-0f40eed14929","Type":"ContainerDied","Data":"0ab46906a0bd54464dcdf14dceb33cd264efad9715f98a8f09b836032037a77e"}
Sep 15 18:58:25.924754 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.924722    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:25.949089 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.949062    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s77xt\" (UniqueName: \"kubernetes.io/projected/635d7ee5-5563-4f4f-87ad-5194230e5dcc-kube-api-access-s77xt\") pod \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") "
Sep 15 18:58:25.949204 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.949178    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-util\") pod \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") "
Sep 15 18:58:25.949269 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.949210    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-bundle\") pod \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\" (UID: \"635d7ee5-5563-4f4f-87ad-5194230e5dcc\") "
Sep 15 18:58:25.949989 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.949758    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-bundle" (OuterVolumeSpecName: "bundle") pod "635d7ee5-5563-4f4f-87ad-5194230e5dcc" (UID: "635d7ee5-5563-4f4f-87ad-5194230e5dcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:58:25.951276 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.951246    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/635d7ee5-5563-4f4f-87ad-5194230e5dcc-kube-api-access-s77xt" (OuterVolumeSpecName: "kube-api-access-s77xt") pod "635d7ee5-5563-4f4f-87ad-5194230e5dcc" (UID: "635d7ee5-5563-4f4f-87ad-5194230e5dcc"). InnerVolumeSpecName "kube-api-access-s77xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:58:25.954891 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.954863    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-util" (OuterVolumeSpecName: "util") pod "635d7ee5-5563-4f4f-87ad-5194230e5dcc" (UID: "635d7ee5-5563-4f4f-87ad-5194230e5dcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:58:25.964458 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.964438    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:25.967276 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:25.967255    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:26.050427 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050343    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-util\") pod \"bdf84b71-bf1f-4746-a9a8-8773508c021d\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") "
Sep 15 18:58:26.050427 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050413    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h4gg\" (UniqueName: \"kubernetes.io/projected/62fe8184-ae7d-44a5-9305-d4281c988e4c-kube-api-access-5h4gg\") pod \"62fe8184-ae7d-44a5-9305-d4281c988e4c\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") "
Sep 15 18:58:26.050657 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050452    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-util\") pod \"62fe8184-ae7d-44a5-9305-d4281c988e4c\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") "
Sep 15 18:58:26.050657 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050483    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-bundle\") pod \"bdf84b71-bf1f-4746-a9a8-8773508c021d\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") "
Sep 15 18:58:26.050657 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050499    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-bundle\") pod \"62fe8184-ae7d-44a5-9305-d4281c988e4c\" (UID: \"62fe8184-ae7d-44a5-9305-d4281c988e4c\") "
Sep 15 18:58:26.050657 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050573    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czlng\" (UniqueName: \"kubernetes.io/projected/bdf84b71-bf1f-4746-a9a8-8773508c021d-kube-api-access-czlng\") pod \"bdf84b71-bf1f-4746-a9a8-8773508c021d\" (UID: \"bdf84b71-bf1f-4746-a9a8-8773508c021d\") "
Sep 15 18:58:26.050895 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050850    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-util\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.050895 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050872    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/635d7ee5-5563-4f4f-87ad-5194230e5dcc-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.050895 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.050886    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s77xt\" (UniqueName: \"kubernetes.io/projected/635d7ee5-5563-4f4f-87ad-5194230e5dcc-kube-api-access-s77xt\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.051097 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.051075    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-bundle" (OuterVolumeSpecName: "bundle") pod "62fe8184-ae7d-44a5-9305-d4281c988e4c" (UID: "62fe8184-ae7d-44a5-9305-d4281c988e4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:58:26.051149 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.051072    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-bundle" (OuterVolumeSpecName: "bundle") pod "bdf84b71-bf1f-4746-a9a8-8773508c021d" (UID: "bdf84b71-bf1f-4746-a9a8-8773508c021d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:58:26.052630 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.052607    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdf84b71-bf1f-4746-a9a8-8773508c021d-kube-api-access-czlng" (OuterVolumeSpecName: "kube-api-access-czlng") pod "bdf84b71-bf1f-4746-a9a8-8773508c021d" (UID: "bdf84b71-bf1f-4746-a9a8-8773508c021d"). InnerVolumeSpecName "kube-api-access-czlng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:58:26.052955 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.052932    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62fe8184-ae7d-44a5-9305-d4281c988e4c-kube-api-access-5h4gg" (OuterVolumeSpecName: "kube-api-access-5h4gg") pod "62fe8184-ae7d-44a5-9305-d4281c988e4c" (UID: "62fe8184-ae7d-44a5-9305-d4281c988e4c"). InnerVolumeSpecName "kube-api-access-5h4gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:58:26.056061 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.056026    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-util" (OuterVolumeSpecName: "util") pod "62fe8184-ae7d-44a5-9305-d4281c988e4c" (UID: "62fe8184-ae7d-44a5-9305-d4281c988e4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:58:26.056382 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.056361    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-util" (OuterVolumeSpecName: "util") pod "bdf84b71-bf1f-4746-a9a8-8773508c021d" (UID: "bdf84b71-bf1f-4746-a9a8-8773508c021d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:58:26.151595 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.151564    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-util\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.151595 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.151593    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.151595 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.151601    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62fe8184-ae7d-44a5-9305-d4281c988e4c-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.151840 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.151610    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czlng\" (UniqueName: \"kubernetes.io/projected/bdf84b71-bf1f-4746-a9a8-8773508c021d-kube-api-access-czlng\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.151840 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.151619    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdf84b71-bf1f-4746-a9a8-8773508c021d-util\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.151840 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.151630    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h4gg\" (UniqueName: \"kubernetes.io/projected/62fe8184-ae7d-44a5-9305-d4281c988e4c-kube-api-access-5h4gg\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:26.783172 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.783136    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4" event={"ID":"62fe8184-ae7d-44a5-9305-d4281c988e4c","Type":"ContainerDied","Data":"eaa2bbcb057f88ba41c5b7443f56f868db71fb1a62cfdd16106594085b4103a7"}
Sep 15 18:58:26.783541 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.783218    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaa2bbcb057f88ba41c5b7443f56f868db71fb1a62cfdd16106594085b4103a7"
Sep 15 18:58:26.783541 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.783145    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4csrxv4"
Sep 15 18:58:26.785044 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.785022    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb"
Sep 15 18:58:26.785044 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.785033    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vvxrb" event={"ID":"635d7ee5-5563-4f4f-87ad-5194230e5dcc","Type":"ContainerDied","Data":"903b1884566b3c6bb47f612e143aa05ce2f62c39321c533b6fe3f7800f7780d7"}
Sep 15 18:58:26.785204 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.785073    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="903b1884566b3c6bb47f612e143aa05ce2f62c39321c533b6fe3f7800f7780d7"
Sep 15 18:58:26.787056 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.787035    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq"
Sep 15 18:58:26.787210 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.787076    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79tpqq" event={"ID":"bdf84b71-bf1f-4746-a9a8-8773508c021d","Type":"ContainerDied","Data":"cddd5b600f68caba92267ea1f323afbf16d5c10f4748964bd568bb383c194aa4"}
Sep 15 18:58:26.787210 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.787122    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cddd5b600f68caba92267ea1f323afbf16d5c10f4748964bd568bb383c194aa4"
Sep 15 18:58:26.916289 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.916268    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:26.958298 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.958264    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-bundle\") pod \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") "
Sep 15 18:58:26.958461 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.958308    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4jsh\" (UniqueName: \"kubernetes.io/projected/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-kube-api-access-n4jsh\") pod \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") "
Sep 15 18:58:26.958461 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.958332    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-util\") pod \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\" (UID: \"26854ef0-a7b8-4dfc-8a9e-0f40eed14929\") "
Sep 15 18:58:26.958979 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.958952    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-bundle" (OuterVolumeSpecName: "bundle") pod "26854ef0-a7b8-4dfc-8a9e-0f40eed14929" (UID: "26854ef0-a7b8-4dfc-8a9e-0f40eed14929"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:58:26.960652 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.960622    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-kube-api-access-n4jsh" (OuterVolumeSpecName: "kube-api-access-n4jsh") pod "26854ef0-a7b8-4dfc-8a9e-0f40eed14929" (UID: "26854ef0-a7b8-4dfc-8a9e-0f40eed14929"). InnerVolumeSpecName "kube-api-access-n4jsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 18:58:26.964009 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:26.963980    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-util" (OuterVolumeSpecName: "util") pod "26854ef0-a7b8-4dfc-8a9e-0f40eed14929" (UID: "26854ef0-a7b8-4dfc-8a9e-0f40eed14929"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 18:58:27.059118 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:27.059033    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-bundle\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:27.059118 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:27.059061    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4jsh\" (UniqueName: \"kubernetes.io/projected/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-kube-api-access-n4jsh\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:27.059118 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:27.059074    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26854ef0-a7b8-4dfc-8a9e-0f40eed14929-util\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 18:58:27.794162 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:27.794132    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr"
Sep 15 18:58:27.794162 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:27.794148    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak5lwr" event={"ID":"26854ef0-a7b8-4dfc-8a9e-0f40eed14929","Type":"ContainerDied","Data":"ed7175bed4398e51b70ea9c07a9e840623fe158c64bdfd232abf6dc1f5909f03"}
Sep 15 18:58:27.794637 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:27.794191    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed7175bed4398e51b70ea9c07a9e840623fe158c64bdfd232abf6dc1f5909f03"
Sep 15 18:58:29.394061 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:29.394025    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:30.199245 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:30.199213    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:33.061228 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:33.061183    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:33.163530 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:33.163499    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:34.813001 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:34.812964    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:34.914844 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:34.914786    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:35.649193 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:35.649166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:35.759112 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:35.759080    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:37.458580 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:37.458534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:38.467165 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:38.467124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:39.620660 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:39.620624    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:41.034766 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:41.034733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:42.613423 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:42.613389    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:42.713751 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:42.713721    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:43.005507 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:43.005471    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:43.058633 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:43.058601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:43.781298 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:43.781265    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:45.337647 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:45.337609    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:47.635655 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:47.635625    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:47.733771 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:47.733739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:48.607493 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:48.607454    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:48.664520 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:48.664488    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:49.403005 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:49.402969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:49.468708 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:49.468681    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:54.674388 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:54.674353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:54.772987 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:54.772952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:57.103881 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:57.103841    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:58:57.204337 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:58:57.204305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:02.117017 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:02.116985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:02.217856 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:02.217798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:02.619706 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:02.619674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:02.682576 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:02.682545    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:03.231197 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:03.231165    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:03.348135 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:03.348056    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:07.628985 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:07.628951    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:07.729162 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:07.729124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:08.027251 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:08.027222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:08.125713 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:08.125682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:08.429122 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:08.429090    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:08.492996 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:08.492965    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:14.487156 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:14.487117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:14.590131 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:14.590094    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:16.921156 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:16.921122    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:17.021991 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:17.021962    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:27.926297 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:27.926226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:28.202066 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:28.201994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:32.431790 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:32.431756    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:32.536394 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:32.536358    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:32.636215 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:32.636179    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:33.273332 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:33.273302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:33.378462 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:33.378433    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:48.783664 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:48.783625    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:48.883087 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:48.883052    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:49.245680 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.245646    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"]
Sep 15 18:59:49.246017 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246000    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerName="pull"
Sep 15 18:59:49.246017 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246016    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerName="pull"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246025    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerName="extract"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246031    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerName="extract"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246037    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerName="util"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246043    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerName="util"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246050    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerName="extract"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246056    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerName="extract"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246063    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerName="util"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246068    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerName="util"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246077    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerName="pull"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246082    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerName="pull"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246089    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerName="pull"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246094    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerName="pull"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246105    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerName="util"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246110    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerName="util"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246116    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerName="util"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246121    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerName="util"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246133    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerName="extract"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246138    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerName="extract"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246144    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerName="pull"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246150    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerName="pull"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246156    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerName="extract"
Sep 15 18:59:49.246167 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246161    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerName="extract"
Sep 15 18:59:49.246839 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246210    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="635d7ee5-5563-4f4f-87ad-5194230e5dcc" containerName="extract"
Sep 15 18:59:49.246839 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246218    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="26854ef0-a7b8-4dfc-8a9e-0f40eed14929" containerName="extract"
Sep 15 18:59:49.246839 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246223    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="62fe8184-ae7d-44a5-9305-d4281c988e4c" containerName="extract"
Sep 15 18:59:49.246839 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.246229    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdf84b71-bf1f-4746-a9a8-8773508c021d" containerName="extract"
Sep 15 18:59:49.249449 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.249423    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:49.251799 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.251777    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zkhgs\""
Sep 15 18:59:49.251925 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.251847    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 18:59:49.251925 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.251847    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 18:59:49.252442 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.252426    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 18:59:49.257329 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.257297    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"]
Sep 15 18:59:49.285796 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.285778    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 18:59:49.325529 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.325505    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpc4x\" (UniqueName: \"kubernetes.io/projected/fc761e55-68b5-43a7-80af-a48306aaea3e-kube-api-access-rpc4x\") pod \"postgres-69fb4594cf-qrx4g\" (UID: \"fc761e55-68b5-43a7-80af-a48306aaea3e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:49.325614 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.325537    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc761e55-68b5-43a7-80af-a48306aaea3e-data\") pod \"postgres-69fb4594cf-qrx4g\" (UID: \"fc761e55-68b5-43a7-80af-a48306aaea3e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:49.426254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.426218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpc4x\" (UniqueName: \"kubernetes.io/projected/fc761e55-68b5-43a7-80af-a48306aaea3e-kube-api-access-rpc4x\") pod \"postgres-69fb4594cf-qrx4g\" (UID: \"fc761e55-68b5-43a7-80af-a48306aaea3e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:49.426254 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.426260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc761e55-68b5-43a7-80af-a48306aaea3e-data\") pod \"postgres-69fb4594cf-qrx4g\" (UID: \"fc761e55-68b5-43a7-80af-a48306aaea3e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:49.426569 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.426546    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc761e55-68b5-43a7-80af-a48306aaea3e-data\") pod \"postgres-69fb4594cf-qrx4g\" (UID: \"fc761e55-68b5-43a7-80af-a48306aaea3e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:49.434317 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.434293    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpc4x\" (UniqueName: \"kubernetes.io/projected/fc761e55-68b5-43a7-80af-a48306aaea3e-kube-api-access-rpc4x\") pod \"postgres-69fb4594cf-qrx4g\" (UID: \"fc761e55-68b5-43a7-80af-a48306aaea3e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:49.561212 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.561152    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:49.833095 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:49.833071    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"]
Sep 15 18:59:49.834633 ip-10-0-129-252 kubenswrapper[2572]: W0915 18:59:49.834609    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc761e55_68b5_43a7_80af_a48306aaea3e.slice/crio-06a3e45e510986a840fc511b71d92075998aad2c9f07b842ad8182e193c5c17d WatchSource:0}: Error finding container 06a3e45e510986a840fc511b71d92075998aad2c9f07b842ad8182e193c5c17d: Status 404 returned error can't find the container with id 06a3e45e510986a840fc511b71d92075998aad2c9f07b842ad8182e193c5c17d
Sep 15 18:59:50.195332 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:50.195301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g" event={"ID":"fc761e55-68b5-43a7-80af-a48306aaea3e","Type":"ContainerStarted","Data":"06a3e45e510986a840fc511b71d92075998aad2c9f07b842ad8182e193c5c17d"}
Sep 15 18:59:55.226561 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:55.226525    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g" event={"ID":"fc761e55-68b5-43a7-80af-a48306aaea3e","Type":"ContainerStarted","Data":"ca031bcb127e02770251f21aced76ff54772906bef4d45fd274a0ad3c128a5ff"}
Sep 15 18:59:55.227024 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:55.226585    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 18:59:55.241895 ip-10-0-129-252 kubenswrapper[2572]: I0915 18:59:55.241846    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g" podStartSLOduration=1.76229815 podStartE2EDuration="6.241828916s" totalImagesPullingTime="4.479530766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 18:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 18:59:55.241242198 +0000 UTC m=+570.189470525" watchObservedRunningTime="2026-09-15 18:59:55.241828916 +0000 UTC m=+570.190057239"
Sep 15 19:00:01.261309 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:01.261278    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qrx4g"
Sep 15 19:00:01.636109 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:01.636026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:01.873070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:01.873038    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:08.634451 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:08.634420    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:09.120634 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:09.120569    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:09.178065 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:09.178030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:12.452566 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:12.452532    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:12.559401 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:12.559370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:25.499145 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:25.499114    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:00:25.501848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:25.501816    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:00:41.585789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:41.585748    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:43.078614 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.078585    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:43.178923 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.178896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:43.259764 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.259732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:43.367072 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.367002    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:43.569910 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.569884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:43.675743 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.675711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:43.754587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.754558    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"]
Sep 15 19:00:43.757784 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.757767    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:43.759830 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.759799    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 19:00:43.759830 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.759826    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zkwlt\""
Sep 15 19:00:43.766778 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.766756    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"]
Sep 15 19:00:43.844749 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.844721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pbpd\" (UniqueName: \"kubernetes.io/projected/31a1ba89-f742-4678-8e58-9163be6d7255-kube-api-access-4pbpd\") pod \"payload-pre-processing-59fbc47bf8-cldpb\" (UID: \"31a1ba89-f742-4678-8e58-9163be6d7255\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:43.844903 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.844764    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a1ba89-f742-4678-8e58-9163be6d7255-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-cldpb\" (UID: \"31a1ba89-f742-4678-8e58-9163be6d7255\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:43.945919 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.945860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pbpd\" (UniqueName: \"kubernetes.io/projected/31a1ba89-f742-4678-8e58-9163be6d7255-kube-api-access-4pbpd\") pod \"payload-pre-processing-59fbc47bf8-cldpb\" (UID: \"31a1ba89-f742-4678-8e58-9163be6d7255\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:43.945919 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.945901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a1ba89-f742-4678-8e58-9163be6d7255-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-cldpb\" (UID: \"31a1ba89-f742-4678-8e58-9163be6d7255\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:43.946657 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.946639    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a1ba89-f742-4678-8e58-9163be6d7255-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-cldpb\" (UID: \"31a1ba89-f742-4678-8e58-9163be6d7255\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:43.955649 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:43.955627    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pbpd\" (UniqueName: \"kubernetes.io/projected/31a1ba89-f742-4678-8e58-9163be6d7255-kube-api-access-4pbpd\") pod \"payload-pre-processing-59fbc47bf8-cldpb\" (UID: \"31a1ba89-f742-4678-8e58-9163be6d7255\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:44.068460 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:44.068438    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:44.335615 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:44.335593    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"]
Sep 15 19:00:44.337790 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:00:44.337762    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a1ba89_f742_4678_8e58_9163be6d7255.slice/crio-18d2264567cca5e047caecf718c998004427eb9dec062a0a8a30163f5a2d4fa2 WatchSource:0}: Error finding container 18d2264567cca5e047caecf718c998004427eb9dec062a0a8a30163f5a2d4fa2: Status 404 returned error can't find the container with id 18d2264567cca5e047caecf718c998004427eb9dec062a0a8a30163f5a2d4fa2
Sep 15 19:00:44.339840 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:44.339818    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 19:00:44.474691 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:44.474668    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb" event={"ID":"31a1ba89-f742-4678-8e58-9163be6d7255","Type":"ContainerStarted","Data":"18d2264567cca5e047caecf718c998004427eb9dec062a0a8a30163f5a2d4fa2"}
Sep 15 19:00:48.495913 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:48.495870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb" event={"ID":"31a1ba89-f742-4678-8e58-9163be6d7255","Type":"ContainerStarted","Data":"53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193"}
Sep 15 19:00:48.496326 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:48.495947    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:00:48.513172 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:48.513127    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb" podStartSLOduration=2.068554008 podStartE2EDuration="5.513113337s" totalImagesPullingTime="3.444559329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:00:48.510885508 +0000 UTC m=+623.459113835" watchObservedRunningTime="2026-09-15 19:00:48.513113337 +0000 UTC m=+623.461341660"
Sep 15 19:00:53.649054 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:53.649012    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:53.781274 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:53.781225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:53.893353 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:53.893319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:58.013143 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:58.013101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:58.068309 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:58.068282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:59.299915 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:59.299885    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:00:59.502470 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:00:59.502436    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:01:09.038926 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.038880    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"]
Sep 15 19:01:09.042972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.042946    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.045041 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.045017    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 19:01:09.045158 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.045069    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 19:01:09.045822 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.045785    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w45l4\""
Sep 15 19:01:09.045907 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.045856    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 15 19:01:09.054232 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.054207    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"]
Sep 15 19:01:09.134286 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.134262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.134382 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.134289    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0156f4c-ac31-422c-bf76-3f7816a57c64-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.134382 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.134361    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.134460 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.134405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.134460 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.134442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbw5k\" (UniqueName: \"kubernetes.io/projected/e0156f4c-ac31-422c-bf76-3f7816a57c64-kube-api-access-jbw5k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.134529 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.134466    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.234943 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.234915    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.235070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.234952    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.235070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.234972    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbw5k\" (UniqueName: \"kubernetes.io/projected/e0156f4c-ac31-422c-bf76-3f7816a57c64-kube-api-access-jbw5k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.235070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.234994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.235070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.235047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.235290 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.235082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0156f4c-ac31-422c-bf76-3f7816a57c64-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.235346 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.235312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.235404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.235381    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.235462 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.235408    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.237068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.237042    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0156f4c-ac31-422c-bf76-3f7816a57c64-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.237430 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.237410    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0156f4c-ac31-422c-bf76-3f7816a57c64-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.238205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.238174    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:01:09.241603 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.241575    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbw5k\" (UniqueName: \"kubernetes.io/projected/e0156f4c-ac31-422c-bf76-3f7816a57c64-kube-api-access-jbw5k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vqth5\" (UID: \"e0156f4c-ac31-422c-bf76-3f7816a57c64\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.355003 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.354937    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:09.624685 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:09.624529    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"]
Sep 15 19:01:09.627299 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:01:09.627273    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0156f4c_ac31_422c_bf76_3f7816a57c64.slice/crio-7ef7609c875591edb3441fc5cf389c12105305748e053197bba7381f4e098291 WatchSource:0}: Error finding container 7ef7609c875591edb3441fc5cf389c12105305748e053197bba7381f4e098291: Status 404 returned error can't find the container with id 7ef7609c875591edb3441fc5cf389c12105305748e053197bba7381f4e098291
Sep 15 19:01:10.611024 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:10.610983    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5" event={"ID":"e0156f4c-ac31-422c-bf76-3f7816a57c64","Type":"ContainerStarted","Data":"7ef7609c875591edb3441fc5cf389c12105305748e053197bba7381f4e098291"}
Sep 15 19:01:11.621383 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:11.621341    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5" event={"ID":"e0156f4c-ac31-422c-bf76-3f7816a57c64","Type":"ContainerStarted","Data":"786629b6e49b5d60a2e7c1bc6471721f7518a157dab6fe828a78f335d44f84ce"}
Sep 15 19:01:11.637472 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:11.637414    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5" podStartSLOduration=1.649272833 podStartE2EDuration="2.637398674s" totalImagesPullingTime="988.125841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:01:11.635252325 +0000 UTC m=+646.583480652" watchObservedRunningTime="2026-09-15 19:01:11.637398674 +0000 UTC m=+646.585627000"
Sep 15 19:01:19.355695 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:19.355650    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:19.356232 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:19.355728    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:19.368601 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:19.368570    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:19.674702 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:19.674674    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vqth5"
Sep 15 19:01:24.431058 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.431014    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"]
Sep 15 19:01:24.433492 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.433465    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.435823 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.435780    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 15 19:01:24.442396 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.442372    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"]
Sep 15 19:01:24.452041 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.452013    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.452153 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.452075    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.452153 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.452111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq4sc\" (UniqueName: \"kubernetes.io/projected/5453e8b0-133e-41d9-a95d-6fa632018bf8-kube-api-access-gq4sc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.452279 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.452185    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.452279 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.452223    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5453e8b0-133e-41d9-a95d-6fa632018bf8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.452279 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.452273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.488130 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.488102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:01:24.553485 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.553459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.553607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.553552    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.553607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.553593    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq4sc\" (UniqueName: \"kubernetes.io/projected/5453e8b0-133e-41d9-a95d-6fa632018bf8-kube-api-access-gq4sc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.553732 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.553640    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.553732 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.553666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5453e8b0-133e-41d9-a95d-6fa632018bf8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.553732 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.553715    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.553909 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.553877    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.554186 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.554163    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.554461 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.554438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.556097 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.556071    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5453e8b0-133e-41d9-a95d-6fa632018bf8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.556497 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.556476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5453e8b0-133e-41d9-a95d-6fa632018bf8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.566655 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.566636    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq4sc\" (UniqueName: \"kubernetes.io/projected/5453e8b0-133e-41d9-a95d-6fa632018bf8-kube-api-access-gq4sc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc\" (UID: \"5453e8b0-133e-41d9-a95d-6fa632018bf8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:24.746711 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:24.746644    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:25.015635 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:25.015609    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"]
Sep 15 19:01:25.017510 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:01:25.017483    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5453e8b0_133e_41d9_a95d_6fa632018bf8.slice/crio-98aab4d5baea25bca2f21a087ec5e51252aa7d2132cc4a1c00db250df3256a46 WatchSource:0}: Error finding container 98aab4d5baea25bca2f21a087ec5e51252aa7d2132cc4a1c00db250df3256a46: Status 404 returned error can't find the container with id 98aab4d5baea25bca2f21a087ec5e51252aa7d2132cc4a1c00db250df3256a46
Sep 15 19:01:25.695882 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:25.695847    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc" event={"ID":"5453e8b0-133e-41d9-a95d-6fa632018bf8","Type":"ContainerStarted","Data":"8aa79bfba2eeaa1ee62f9e5a8540dc4346d10d9305f9fb94b256d6489f2e25a6"}
Sep 15 19:01:25.696246 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:25.695916    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc" event={"ID":"5453e8b0-133e-41d9-a95d-6fa632018bf8","Type":"ContainerStarted","Data":"98aab4d5baea25bca2f21a087ec5e51252aa7d2132cc4a1c00db250df3256a46"}
Sep 15 19:01:25.714128 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:25.714082    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc" podStartSLOduration=1.493925381 podStartE2EDuration="1.714067464s" totalImagesPullingTime="220.142083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:01:25.711025299 +0000 UTC m=+660.659253640" watchObservedRunningTime="2026-09-15 19:01:25.714067464 +0000 UTC m=+660.662295789"
Sep 15 19:01:31.880436 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:31.880403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:01:34.747296 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:34.747263    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:34.747690 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:34.747336    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:34.759348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:34.759326    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:35.757239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:35.757213    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-m7smc"
Sep 15 19:01:42.312784 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:42.312745    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:01:53.054790 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:53.054756    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:01:56.343747 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:56.343718    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:01:59.777412 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:59.777379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:01:59.833481 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:01:59.833450    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:02:35.711716 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:02:35.711638    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:02:35.822862 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:02:35.822832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:02:50.105435 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:02:50.105404    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:02:50.609427 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:02:50.609395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:11.789486 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:11.789456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:11.941531 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:11.941498    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"]
Sep 15 19:03:11.941737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:11.941705    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb" podUID="31a1ba89-f742-4678-8e58-9163be6d7255" containerName="payload-pre-processing" containerID="cri-o://53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193" gracePeriod=30
Sep 15 19:03:12.154830 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.154773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:12.180957 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.180934    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:03:12.238038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.238015    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a1ba89-f742-4678-8e58-9163be6d7255-plugins-config-volume\") pod \"31a1ba89-f742-4678-8e58-9163be6d7255\" (UID: \"31a1ba89-f742-4678-8e58-9163be6d7255\") "
Sep 15 19:03:12.238141 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.238110    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pbpd\" (UniqueName: \"kubernetes.io/projected/31a1ba89-f742-4678-8e58-9163be6d7255-kube-api-access-4pbpd\") pod \"31a1ba89-f742-4678-8e58-9163be6d7255\" (UID: \"31a1ba89-f742-4678-8e58-9163be6d7255\") "
Sep 15 19:03:12.238333 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.238312    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a1ba89-f742-4678-8e58-9163be6d7255-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "31a1ba89-f742-4678-8e58-9163be6d7255" (UID: "31a1ba89-f742-4678-8e58-9163be6d7255"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:03:12.240174 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.240153    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31a1ba89-f742-4678-8e58-9163be6d7255-kube-api-access-4pbpd" (OuterVolumeSpecName: "kube-api-access-4pbpd") pod "31a1ba89-f742-4678-8e58-9163be6d7255" (UID: "31a1ba89-f742-4678-8e58-9163be6d7255"). InnerVolumeSpecName "kube-api-access-4pbpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:03:12.245401 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.245374    2572 generic.go:356] "Generic (PLEG): container finished" podID="31a1ba89-f742-4678-8e58-9163be6d7255" containerID="53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193" exitCode=0
Sep 15 19:03:12.245526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.245424    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"
Sep 15 19:03:12.245526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.245438    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb" event={"ID":"31a1ba89-f742-4678-8e58-9163be6d7255","Type":"ContainerDied","Data":"53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193"}
Sep 15 19:03:12.245611 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.245543    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb" event={"ID":"31a1ba89-f742-4678-8e58-9163be6d7255","Type":"ContainerDied","Data":"18d2264567cca5e047caecf718c998004427eb9dec062a0a8a30163f5a2d4fa2"}
Sep 15 19:03:12.245611 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.245574    2572 scope.go:117] "RemoveContainer" containerID="53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193"
Sep 15 19:03:12.254138 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.254114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:12.254448 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.254429    2572 scope.go:117] "RemoveContainer" containerID="53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193"
Sep 15 19:03:12.254731 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:03:12.254711    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193\": container with ID starting with 53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193 not found: ID does not exist" containerID="53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193"
Sep 15 19:03:12.254835 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.254737    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193"} err="failed to get container status \"53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193\": rpc error: code = NotFound desc = could not find container \"53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193\": container with ID starting with 53aa4f57fb98bd56367cf9da60425f4a9fac8d7a57d20dbb5f5964c16a648193 not found: ID does not exist"
Sep 15 19:03:12.268740 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.268719    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"]
Sep 15 19:03:12.272379 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.272356    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-cldpb"]
Sep 15 19:03:12.338762 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.338680    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pbpd\" (UniqueName: \"kubernetes.io/projected/31a1ba89-f742-4678-8e58-9163be6d7255-kube-api-access-4pbpd\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:03:12.338762 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:12.338710    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a1ba89-f742-4678-8e58-9163be6d7255-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:03:13.557335 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:13.557303    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31a1ba89-f742-4678-8e58-9163be6d7255" path="/var/lib/kubelet/pods/31a1ba89-f742-4678-8e58-9163be6d7255/volumes"
Sep 15 19:03:30.545934 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.545901    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-74969cc5f8-tflk8"]
Sep 15 19:03:30.546282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.546263    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a1ba89-f742-4678-8e58-9163be6d7255" containerName="payload-pre-processing"
Sep 15 19:03:30.546282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.546275    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a1ba89-f742-4678-8e58-9163be6d7255" containerName="payload-pre-processing"
Sep 15 19:03:30.546381 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.546370    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="31a1ba89-f742-4678-8e58-9163be6d7255" containerName="payload-pre-processing"
Sep 15 19:03:30.548895 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.548879    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:30.550862 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.550841    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zkwlt\""
Sep 15 19:03:30.550999 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.550846    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 19:03:30.559567 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.559543    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-74969cc5f8-tflk8"]
Sep 15 19:03:30.582110 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.582083    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtrcc\" (UniqueName: \"kubernetes.io/projected/2dca0223-6688-4aed-a5ca-0f22cabeef5d-kube-api-access-xtrcc\") pod \"payload-processing-74969cc5f8-tflk8\" (UID: \"2dca0223-6688-4aed-a5ca-0f22cabeef5d\") " pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:30.582278 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.582131    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dca0223-6688-4aed-a5ca-0f22cabeef5d-plugins-config-volume\") pod \"payload-processing-74969cc5f8-tflk8\" (UID: \"2dca0223-6688-4aed-a5ca-0f22cabeef5d\") " pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:30.584310 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.584290    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-558d9b8847-2lchj"]
Sep 15 19:03:30.586455 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.586428    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:30.586705 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.586690    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:30.596854 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.596824    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-558d9b8847-2lchj"]
Sep 15 19:03:30.652087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.652059    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:30.682707 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.682679    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/918bc418-41b7-453a-b300-e73efce2e434-plugins-config-volume\") pod \"payload-pre-processing-558d9b8847-2lchj\" (UID: \"918bc418-41b7-453a-b300-e73efce2e434\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:30.682863 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.682727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrcc\" (UniqueName: \"kubernetes.io/projected/2dca0223-6688-4aed-a5ca-0f22cabeef5d-kube-api-access-xtrcc\") pod \"payload-processing-74969cc5f8-tflk8\" (UID: \"2dca0223-6688-4aed-a5ca-0f22cabeef5d\") " pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:30.682863 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.682763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dca0223-6688-4aed-a5ca-0f22cabeef5d-plugins-config-volume\") pod \"payload-processing-74969cc5f8-tflk8\" (UID: \"2dca0223-6688-4aed-a5ca-0f22cabeef5d\") " pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:30.682863 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.682840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdnxc\" (UniqueName: \"kubernetes.io/projected/918bc418-41b7-453a-b300-e73efce2e434-kube-api-access-cdnxc\") pod \"payload-pre-processing-558d9b8847-2lchj\" (UID: \"918bc418-41b7-453a-b300-e73efce2e434\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:30.683618 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.683598    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dca0223-6688-4aed-a5ca-0f22cabeef5d-plugins-config-volume\") pod \"payload-processing-74969cc5f8-tflk8\" (UID: \"2dca0223-6688-4aed-a5ca-0f22cabeef5d\") " pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:30.689764 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.689748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtrcc\" (UniqueName: \"kubernetes.io/projected/2dca0223-6688-4aed-a5ca-0f22cabeef5d-kube-api-access-xtrcc\") pod \"payload-processing-74969cc5f8-tflk8\" (UID: \"2dca0223-6688-4aed-a5ca-0f22cabeef5d\") " pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:30.784099 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.784064    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdnxc\" (UniqueName: \"kubernetes.io/projected/918bc418-41b7-453a-b300-e73efce2e434-kube-api-access-cdnxc\") pod \"payload-pre-processing-558d9b8847-2lchj\" (UID: \"918bc418-41b7-453a-b300-e73efce2e434\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:30.784265 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.784134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/918bc418-41b7-453a-b300-e73efce2e434-plugins-config-volume\") pod \"payload-pre-processing-558d9b8847-2lchj\" (UID: \"918bc418-41b7-453a-b300-e73efce2e434\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:30.784945 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.784925    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/918bc418-41b7-453a-b300-e73efce2e434-plugins-config-volume\") pod \"payload-pre-processing-558d9b8847-2lchj\" (UID: \"918bc418-41b7-453a-b300-e73efce2e434\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:30.791133 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.791115    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdnxc\" (UniqueName: \"kubernetes.io/projected/918bc418-41b7-453a-b300-e73efce2e434-kube-api-access-cdnxc\") pod \"payload-pre-processing-558d9b8847-2lchj\" (UID: \"918bc418-41b7-453a-b300-e73efce2e434\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:30.860670 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.860599    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:30.898354 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:30.898328    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:31.129102 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:31.129078    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-74969cc5f8-tflk8"]
Sep 15 19:03:31.131028 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:03:31.130999    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dca0223_6688_4aed_a5ca_0f22cabeef5d.slice/crio-9d3007f6d7e216bcfd009a968b64d57176d9d606d6e89abd468f9e943fbc8869 WatchSource:0}: Error finding container 9d3007f6d7e216bcfd009a968b64d57176d9d606d6e89abd468f9e943fbc8869: Status 404 returned error can't find the container with id 9d3007f6d7e216bcfd009a968b64d57176d9d606d6e89abd468f9e943fbc8869
Sep 15 19:03:31.173577 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:31.173548    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-558d9b8847-2lchj"]
Sep 15 19:03:31.177781 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:03:31.177760    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918bc418_41b7_453a_b300_e73efce2e434.slice/crio-6095f4045e321a684b34ef56b878b88f0b3a6b14e6899f0c2a01431aaf5ef482 WatchSource:0}: Error finding container 6095f4045e321a684b34ef56b878b88f0b3a6b14e6899f0c2a01431aaf5ef482: Status 404 returned error can't find the container with id 6095f4045e321a684b34ef56b878b88f0b3a6b14e6899f0c2a01431aaf5ef482
Sep 15 19:03:31.350163 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:31.350125    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" event={"ID":"2dca0223-6688-4aed-a5ca-0f22cabeef5d","Type":"ContainerStarted","Data":"9d3007f6d7e216bcfd009a968b64d57176d9d606d6e89abd468f9e943fbc8869"}
Sep 15 19:03:31.351341 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:31.351309    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" event={"ID":"918bc418-41b7-453a-b300-e73efce2e434","Type":"ContainerStarted","Data":"6095f4045e321a684b34ef56b878b88f0b3a6b14e6899f0c2a01431aaf5ef482"}
Sep 15 19:03:34.369875 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:34.369839    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" event={"ID":"2dca0223-6688-4aed-a5ca-0f22cabeef5d","Type":"ContainerStarted","Data":"0c7de53922e660abaa0211a61f866138541f9d6d038e10165711d801b367f758"}
Sep 15 19:03:34.370252 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:34.369922    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:34.371408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:34.371384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" event={"ID":"918bc418-41b7-453a-b300-e73efce2e434","Type":"ContainerStarted","Data":"df8162af7c83b9bd8a65ead62514889a03d8b43e9600f9bae00ac13ea5567da5"}
Sep 15 19:03:34.371495 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:34.371479    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:34.384647 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:34.384598    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" podStartSLOduration=1.24977142 podStartE2EDuration="4.384584197s" totalImagesPullingTime="3.134812777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:03:34.382324573 +0000 UTC m=+789.330552902" watchObservedRunningTime="2026-09-15 19:03:34.384584197 +0000 UTC m=+789.332812523"
Sep 15 19:03:34.396669 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:34.396628    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" podStartSLOduration=1.292681417 podStartE2EDuration="4.396614956s" totalImagesPullingTime="3.103933539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:03:34.394440624 +0000 UTC m=+789.342668951" watchObservedRunningTime="2026-09-15 19:03:34.396614956 +0000 UTC m=+789.344843281"
Sep 15 19:03:35.376360 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:35.376328    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:03:35.376799 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:35.376341    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:03:45.378888 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:45.378856    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-74969cc5f8-tflk8"
Sep 15 19:03:45.379386 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:45.378927    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj"
Sep 15 19:03:45.379386 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:45.379246    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:03:45.379386 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:45.379335    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:03:56.011485 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:56.011445    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:56.363668 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:56.363582    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:57.326466 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:57.326431    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:57.431358 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:57.431328    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:58.528963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:58.528927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:03:58.624777 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:03:58.624746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:14.047851 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.047799    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:14.147992 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.147954    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:14.381011 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.380921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:14.405936 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.405892    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"]
Sep 15 19:04:14.414075 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.414045    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.416211 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.416184    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d5559a-openshift-default-dockercfg-j5dtq\""
Sep 15 19:04:14.421164 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.421075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"]
Sep 15 19:04:14.469182 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469141    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llppd\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-kube-api-access-llppd\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.469354 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-certs\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.469354 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469278    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-credential-socket\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.469354 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-envoy\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.469468 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-data\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.469468 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469440    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-socket\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.469579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469494    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-podinfo\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.469579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istiod-ca-cert\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.469579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.469567    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-token\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.479502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.479464    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"]
Sep 15 19:04:14.483295 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.483268    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.485889 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.485864    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-7c96ca-openshift-default-dockercfg-zqgkf\""
Sep 15 19:04:14.489975 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.489945    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:14.495499 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.495472    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"]
Sep 15 19:04:14.565271 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.565235    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:14.570516 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-podinfo\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.570516 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570519    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-envoy\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.570758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llppd\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-kube-api-access-llppd\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.570758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570616    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-certs\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.570758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570662    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-credential-socket\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.570758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570684    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqwkl\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-kube-api-access-zqwkl\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.570758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570706    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istiod-ca-cert\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.570758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-envoy\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571096 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-socket\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.571096 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-certs\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.571096 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570918    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-data\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571096 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570939    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-data\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.571096 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.570958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-credential-socket\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.571096 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-socket\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571096 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571078    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-certs\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571096 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571093    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-token\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.571428 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571095    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-credential-socket\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571428 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571146    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-podinfo\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571428 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571169    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istiod-ca-cert\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571428 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571197    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-token\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571428 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571273    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-data\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571428 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571346    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-socket\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.571870 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.571852    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istiod-ca-cert\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.573262 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.573230    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-envoy\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.573543 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.573526    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-podinfo\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.578751 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.578716    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llppd\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-kube-api-access-llppd\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.579024 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.579002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-token\") pod \"e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") " pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.665312 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.665274    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:14.672493 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-token\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.672666 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672513    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-podinfo\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.672666 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-envoy\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.672781 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqwkl\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-kube-api-access-zqwkl\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.672781 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istiod-ca-cert\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.672781 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-socket\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.673061 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672838    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-certs\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.673061 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-data\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.673061 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.672907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-credential-socket\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.673319 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.673291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-socket\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.673508 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.673348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-credential-socket\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.673508 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.673458    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-certs\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.673655 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.673580    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istiod-ca-cert\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.673723 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.673662    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-data\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.675179 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.675159    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-envoy\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.675482 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.675462    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-podinfo\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.680029 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.679999    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-token\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.680130 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.680027    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqwkl\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-kube-api-access-zqwkl\") pod \"e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") " pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:14.727073 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.727034    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:14.729105 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.729074    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:14.795514 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:14.795233    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:15.012659 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.012459    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"]
Sep 15 19:04:15.015145 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:04:15.015114    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8e22b3_ec83_4fa8_bc44_5bfa11f73c87.slice/crio-17387bbdf1dc30ebd0481890d9a17075c0a72a1fab9f2354f9dd403aa811f22c WatchSource:0}: Error finding container 17387bbdf1dc30ebd0481890d9a17075c0a72a1fab9f2354f9dd403aa811f22c: Status 404 returned error can't find the container with id 17387bbdf1dc30ebd0481890d9a17075c0a72a1fab9f2354f9dd403aa811f22c
Sep 15 19:04:15.018103 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.018066    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:15.018196 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.018138    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:15.018196 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.018164    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:15.078332 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.078302    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"]
Sep 15 19:04:15.080506 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:04:15.080479    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5f211a_cac3_4d6c_98d5_3228fa8cf759.slice/crio-5e3c641759d922ffc3116abf9a793593a77e9875fa4dd657064302f1ab1794db WatchSource:0}: Error finding container 5e3c641759d922ffc3116abf9a793593a77e9875fa4dd657064302f1ab1794db: Status 404 returned error can't find the container with id 5e3c641759d922ffc3116abf9a793593a77e9875fa4dd657064302f1ab1794db
Sep 15 19:04:15.083015 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.082978    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:15.083134 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.083094    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:15.083252 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.083233    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:15.577338 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.577286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:15.594364 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.594318    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" event={"ID":"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87","Type":"ContainerStarted","Data":"b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9"}
Sep 15 19:04:15.594561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.594421    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" event={"ID":"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87","Type":"ContainerStarted","Data":"17387bbdf1dc30ebd0481890d9a17075c0a72a1fab9f2354f9dd403aa811f22c"}
Sep 15 19:04:15.596402 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.596348    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" event={"ID":"4d5f211a-cac3-4d6c-98d5-3228fa8cf759","Type":"ContainerStarted","Data":"34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00"}
Sep 15 19:04:15.596578 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.596422    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" event={"ID":"4d5f211a-cac3-4d6c-98d5-3228fa8cf759","Type":"ContainerStarted","Data":"5e3c641759d922ffc3116abf9a793593a77e9875fa4dd657064302f1ab1794db"}
Sep 15 19:04:15.638456 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.638392    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" podStartSLOduration=1.638375691 podStartE2EDuration="1.638375691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:15.637732851 +0000 UTC m=+830.585961177" watchObservedRunningTime="2026-09-15 19:04:15.638375691 +0000 UTC m=+830.586604017"
Sep 15 19:04:15.685699 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.685640    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podStartSLOduration=1.6856252760000001 podStartE2EDuration="1.685625276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:15.682832323 +0000 UTC m=+830.631060653" watchObservedRunningTime="2026-09-15 19:04:15.685625276 +0000 UTC m=+830.633853602"
Sep 15 19:04:15.713642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.713602    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:15.727146 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.727115    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:15.796542 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:15.796500    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:16.072365 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:16.072329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:16.733233 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:16.733201    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:16.801305 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:16.801273    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:17.610594 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:17.610555    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:17.610789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:17.610614    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:17.611405 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:17.611385    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:17.611465 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:17.611440    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:17.669574 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:17.669533    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:17.783059 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:17.783020    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:17.867949 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:17.867854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:18.898819 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:18.898771    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:19.001397 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.001357    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:19.412360 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.412327    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:19.507895 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.507860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:19.551007 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.550978    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"]
Sep 15 19:04:19.554879 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.554856    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:19.556869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.556845    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-7c96ca-dockercfg-94sm6\""
Sep 15 19:04:19.556977 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.556888    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-7c96ca\""
Sep 15 19:04:19.564940 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.564912    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"]
Sep 15 19:04:19.621363 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.621184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p98tr\" (UniqueName: \"kubernetes.io/projected/0a36cc1c-c175-46a6-ab7e-f757a79de411-kube-api-access-p98tr\") pod \"payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl\" (UID: \"0a36cc1c-c175-46a6-ab7e-f757a79de411\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:19.622037 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.621760    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a36cc1c-c175-46a6-ab7e-f757a79de411-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl\" (UID: \"0a36cc1c-c175-46a6-ab7e-f757a79de411\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:19.722524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.722434    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a36cc1c-c175-46a6-ab7e-f757a79de411-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl\" (UID: \"0a36cc1c-c175-46a6-ab7e-f757a79de411\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:19.722693 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.722630    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p98tr\" (UniqueName: \"kubernetes.io/projected/0a36cc1c-c175-46a6-ab7e-f757a79de411-kube-api-access-p98tr\") pod \"payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl\" (UID: \"0a36cc1c-c175-46a6-ab7e-f757a79de411\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:19.723302 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.723277    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a36cc1c-c175-46a6-ab7e-f757a79de411-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl\" (UID: \"0a36cc1c-c175-46a6-ab7e-f757a79de411\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:19.735409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.735379    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p98tr\" (UniqueName: \"kubernetes.io/projected/0a36cc1c-c175-46a6-ab7e-f757a79de411-kube-api-access-p98tr\") pod \"payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl\" (UID: \"0a36cc1c-c175-46a6-ab7e-f757a79de411\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:19.788816 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.788777    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:19.867637 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.867608    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:19.890739 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:19.890712    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:20.033009 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.032944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:20.138057 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.138029    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"]
Sep 15 19:04:20.139862 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:04:20.139837    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a36cc1c_c175_46a6_ab7e_f757a79de411.slice/crio-3ae310a1abd59aebcd880f026e0261423f5182412c38c6bdb55bc04bdb1de0ef WatchSource:0}: Error finding container 3ae310a1abd59aebcd880f026e0261423f5182412c38c6bdb55bc04bdb1de0ef: Status 404 returned error can't find the container with id 3ae310a1abd59aebcd880f026e0261423f5182412c38c6bdb55bc04bdb1de0ef
Sep 15 19:04:20.336722 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.336639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:20.444086 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.444049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:20.469190 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.469135    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"]
Sep 15 19:04:20.472768 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.472747    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:20.474761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.474743    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-74ef1f-dockercfg-b7gl8\""
Sep 15 19:04:20.474871 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.474743    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-74ef1f\""
Sep 15 19:04:20.483796 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.483425    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"]
Sep 15 19:04:20.530296 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.530258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3809413-dbd8-40d5-8f58-7b186648e880-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp\" (UID: \"e3809413-dbd8-40d5-8f58-7b186648e880\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:20.530473 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.530387    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pbj2\" (UniqueName: \"kubernetes.io/projected/e3809413-dbd8-40d5-8f58-7b186648e880-kube-api-access-7pbj2\") pod \"payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp\" (UID: \"e3809413-dbd8-40d5-8f58-7b186648e880\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:20.631045 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.630971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pbj2\" (UniqueName: \"kubernetes.io/projected/e3809413-dbd8-40d5-8f58-7b186648e880-kube-api-access-7pbj2\") pod \"payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp\" (UID: \"e3809413-dbd8-40d5-8f58-7b186648e880\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:20.631205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.631051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3809413-dbd8-40d5-8f58-7b186648e880-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp\" (UID: \"e3809413-dbd8-40d5-8f58-7b186648e880\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:20.631754 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.631730    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3809413-dbd8-40d5-8f58-7b186648e880-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp\" (UID: \"e3809413-dbd8-40d5-8f58-7b186648e880\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:20.633844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.633794    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl" event={"ID":"0a36cc1c-c175-46a6-ab7e-f757a79de411","Type":"ContainerStarted","Data":"4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272"}
Sep 15 19:04:20.633963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.633877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl" event={"ID":"0a36cc1c-c175-46a6-ab7e-f757a79de411","Type":"ContainerStarted","Data":"3ae310a1abd59aebcd880f026e0261423f5182412c38c6bdb55bc04bdb1de0ef"}
Sep 15 19:04:20.633963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.633908    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:20.640160 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.640140    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pbj2\" (UniqueName: \"kubernetes.io/projected/e3809413-dbd8-40d5-8f58-7b186648e880-kube-api-access-7pbj2\") pod \"payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp\" (UID: \"e3809413-dbd8-40d5-8f58-7b186648e880\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:20.650594 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.650500    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl" podStartSLOduration=1.650484004 podStartE2EDuration="1.650484004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:20.647850485 +0000 UTC m=+835.596078812" watchObservedRunningTime="2026-09-15 19:04:20.650484004 +0000 UTC m=+835.598712331"
Sep 15 19:04:20.784239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.784196    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:20.821277 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.821244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:20.919495 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:20.919437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:21.036382 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.036342    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:21.062000 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.061972    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"]
Sep 15 19:04:21.062792 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:04:21.062764    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3809413_dbd8_40d5_8f58_7b186648e880.slice/crio-f6d383081683e33ffef3f52f2a950e210d4d91c494546792c565bc15cb818c08 WatchSource:0}: Error finding container f6d383081683e33ffef3f52f2a950e210d4d91c494546792c565bc15cb818c08: Status 404 returned error can't find the container with id f6d383081683e33ffef3f52f2a950e210d4d91c494546792c565bc15cb818c08
Sep 15 19:04:21.280800 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.280729    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:21.444168 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.444132    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:21.641548 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.641462    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp" event={"ID":"e3809413-dbd8-40d5-8f58-7b186648e880","Type":"ContainerStarted","Data":"ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b"}
Sep 15 19:04:21.641548 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.641516    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp" event={"ID":"e3809413-dbd8-40d5-8f58-7b186648e880","Type":"ContainerStarted","Data":"f6d383081683e33ffef3f52f2a950e210d4d91c494546792c565bc15cb818c08"}
Sep 15 19:04:21.641770 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.641559    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:21.656971 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.656925    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp" podStartSLOduration=1.656911392 podStartE2EDuration="1.656911392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:21.65519099 +0000 UTC m=+836.603419318" watchObservedRunningTime="2026-09-15 19:04:21.656911392 +0000 UTC m=+836.605139717"
Sep 15 19:04:21.885038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:21.885003    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:22.477714 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:22.477674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:22.577599 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:22.577560    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:22.718726 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:22.718689    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:22.817429 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:22.817341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:23.002656 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.002621    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"]
Sep 15 19:04:23.006930 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.006905    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.009007 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.008984    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4df819e5-openshift-default-dockercfg-w79d7\""
Sep 15 19:04:23.016878 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.016656    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"]
Sep 15 19:04:23.056708 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.056679    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:23.059916 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.059887    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-certs\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.060058 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.059929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-credential-socket\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.060058 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.059962    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-envoy\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.060149 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.060057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-istio-token\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.060149 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.060099    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-data\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.060149 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.060135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v578f\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-kube-api-access-v578f\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.060259 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.060197    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-socket\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.060259 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.060240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94401101-a05b-400d-bc13-fe644b73d225-istiod-ca-cert\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.060347 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.060295    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94401101-a05b-400d-bc13-fe644b73d225-istio-podinfo\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.161557 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161528    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-certs\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.161737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161563    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-credential-socket\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.161737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-envoy\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.161737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161617    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-istio-token\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.161737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161644    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-data\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.161737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161668    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v578f\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-kube-api-access-v578f\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.161737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161715    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-socket\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.162088 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161758    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94401101-a05b-400d-bc13-fe644b73d225-istiod-ca-cert\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.162088 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94401101-a05b-400d-bc13-fe644b73d225-istio-podinfo\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.162088 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.161975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-certs\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.162088 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.162034    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-credential-socket\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.162219 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.162094    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-data\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.162219 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.162121    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-socket\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.162591 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.162570    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94401101-a05b-400d-bc13-fe644b73d225-istiod-ca-cert\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.164123 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.164094    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-envoy\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.164314 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.164297    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94401101-a05b-400d-bc13-fe644b73d225-istio-podinfo\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.168178 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.168153    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-istio-token\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.168507 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.168489    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v578f\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-kube-api-access-v578f\") pod \"e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") " pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.321272 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.321239    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:23.568212 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.568138    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:23.596938 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.596915    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"]
Sep 15 19:04:23.597986 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:04:23.597961    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94401101_a05b_400d_bc13_fe644b73d225.slice/crio-bb0b7f45af016ec4a1ce1dd13fd5229ed761f0496626833ac6a57bfa1ac58dd1 WatchSource:0}: Error finding container bb0b7f45af016ec4a1ce1dd13fd5229ed761f0496626833ac6a57bfa1ac58dd1: Status 404 returned error can't find the container with id bb0b7f45af016ec4a1ce1dd13fd5229ed761f0496626833ac6a57bfa1ac58dd1
Sep 15 19:04:23.600069 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.600039    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:23.600148 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.600103    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:23.600148 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.600129    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:23.654869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.654838    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" event={"ID":"94401101-a05b-400d-bc13-fe644b73d225","Type":"ContainerStarted","Data":"bb0b7f45af016ec4a1ce1dd13fd5229ed761f0496626833ac6a57bfa1ac58dd1"}
Sep 15 19:04:23.988314 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:23.988277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:24.664434 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:24.664390    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" event={"ID":"94401101-a05b-400d-bc13-fe644b73d225","Type":"ContainerStarted","Data":"170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69"}
Sep 15 19:04:24.685156 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:24.685103    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" podStartSLOduration=2.6850892760000002 podStartE2EDuration="2.685089276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:24.681907309 +0000 UTC m=+839.630135635" watchObservedRunningTime="2026-09-15 19:04:24.685089276 +0000 UTC m=+839.633317602"
Sep 15 19:04:25.322446 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:25.322412    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:25.327396 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:25.327372    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:25.435079 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:25.435047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:25.669977 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:25.669944    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:25.671094 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:25.671072    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:26.131628 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:26.131475    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:26.231399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:26.231350    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:26.330468 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:26.330432    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:27.009321 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:27.009281    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:27.987938 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:27.987903    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:28.720492 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:28.720421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:28.784448 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:28.784417    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:29.043281 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.043140    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:29.195481 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.195450    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:29.295773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.295687    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"]
Sep 15 19:04:29.295954 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.295790    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:29.299648 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.299627    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:29.301713 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.301693    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4df819e5\""
Sep 15 19:04:29.302175 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.302163    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4df819e5-dockercfg-9scq9\""
Sep 15 19:04:29.327832 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.321772    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"]
Sep 15 19:04:29.338829 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.332850    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"]
Sep 15 19:04:29.338829 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.337003    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:29.359464 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.359436    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"]
Sep 15 19:04:29.466855 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.465414    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdb9k\" (UniqueName: \"kubernetes.io/projected/0edca827-ea63-4f27-b71a-34389b9a2052-kube-api-access-mdb9k\") pod \"payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz\" (UID: \"0edca827-ea63-4f27-b71a-34389b9a2052\") " pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:29.466855 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.465475    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26ng5\" (UniqueName: \"kubernetes.io/projected/202a5de1-0cb1-4a7f-a799-d419f413df42-kube-api-access-26ng5\") pod \"payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk\" (UID: \"202a5de1-0cb1-4a7f-a799-d419f413df42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:29.466855 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.465562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202a5de1-0cb1-4a7f-a799-d419f413df42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk\" (UID: \"202a5de1-0cb1-4a7f-a799-d419f413df42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:29.466855 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.465593    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0edca827-ea63-4f27-b71a-34389b9a2052-plugins-config-volume\") pod \"payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz\" (UID: \"0edca827-ea63-4f27-b71a-34389b9a2052\") " pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:29.566953 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.566862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdb9k\" (UniqueName: \"kubernetes.io/projected/0edca827-ea63-4f27-b71a-34389b9a2052-kube-api-access-mdb9k\") pod \"payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz\" (UID: \"0edca827-ea63-4f27-b71a-34389b9a2052\") " pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:29.566953 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.566908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26ng5\" (UniqueName: \"kubernetes.io/projected/202a5de1-0cb1-4a7f-a799-d419f413df42-kube-api-access-26ng5\") pod \"payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk\" (UID: \"202a5de1-0cb1-4a7f-a799-d419f413df42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:29.567193 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.566973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202a5de1-0cb1-4a7f-a799-d419f413df42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk\" (UID: \"202a5de1-0cb1-4a7f-a799-d419f413df42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:29.567193 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.567001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0edca827-ea63-4f27-b71a-34389b9a2052-plugins-config-volume\") pod \"payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz\" (UID: \"0edca827-ea63-4f27-b71a-34389b9a2052\") " pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:29.567696 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.567671    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202a5de1-0cb1-4a7f-a799-d419f413df42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk\" (UID: \"202a5de1-0cb1-4a7f-a799-d419f413df42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:29.567793 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.567693    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0edca827-ea63-4f27-b71a-34389b9a2052-plugins-config-volume\") pod \"payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz\" (UID: \"0edca827-ea63-4f27-b71a-34389b9a2052\") " pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:29.574838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.574338    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26ng5\" (UniqueName: \"kubernetes.io/projected/202a5de1-0cb1-4a7f-a799-d419f413df42-kube-api-access-26ng5\") pod \"payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk\" (UID: \"202a5de1-0cb1-4a7f-a799-d419f413df42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:29.574838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.574341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdb9k\" (UniqueName: \"kubernetes.io/projected/0edca827-ea63-4f27-b71a-34389b9a2052-kube-api-access-mdb9k\") pod \"payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz\" (UID: \"0edca827-ea63-4f27-b71a-34389b9a2052\") " pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:29.615216 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.615191    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:29.679607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.679273    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:29.691838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.691816    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:29.967981 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:29.967949    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"]
Sep 15 19:04:30.047336 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.042396    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"]
Sep 15 19:04:30.386844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.386741    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:30.703960 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.703924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk" event={"ID":"202a5de1-0cb1-4a7f-a799-d419f413df42","Type":"ContainerStarted","Data":"af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb"}
Sep 15 19:04:30.704159 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.703988    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk" event={"ID":"202a5de1-0cb1-4a7f-a799-d419f413df42","Type":"ContainerStarted","Data":"ae2531d3cf96f3a7b2dad66bfa43641ada99d0bcab38279fb2d51ebb6f46fcff"}
Sep 15 19:04:30.705484 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.705457    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz" event={"ID":"0edca827-ea63-4f27-b71a-34389b9a2052","Type":"ContainerStarted","Data":"3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1"}
Sep 15 19:04:30.705585 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.705505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz" event={"ID":"0edca827-ea63-4f27-b71a-34389b9a2052","Type":"ContainerStarted","Data":"c07ca0bcc99808ae3d2502c890c95bac8bd141eea8a8aaaf0f2a16b5fd062d43"}
Sep 15 19:04:30.706023 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.706007    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:30.735921 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.735865    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk" podStartSLOduration=1.735844905 podStartE2EDuration="1.735844905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:30.731137901 +0000 UTC m=+845.679366228" watchObservedRunningTime="2026-09-15 19:04:30.735844905 +0000 UTC m=+845.684073236"
Sep 15 19:04:30.770550 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:30.770497    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz" podStartSLOduration=1.770478795 podStartE2EDuration="1.770478795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:30.765204052 +0000 UTC m=+845.713432380" watchObservedRunningTime="2026-09-15 19:04:30.770478795 +0000 UTC m=+845.718707124"
Sep 15 19:04:31.644399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:31.644375    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:04:31.713310 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:31.713243    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:32.649538 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:32.649504    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:04:32.723438 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:32.723406    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:33.005928 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:33.005889    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:33.107253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:33.107216    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:33.652021 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:33.651976    2572 patch_prober.go:28] interesting pod/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 19:04:33.652417 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:33.652063    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 19:04:33.652417 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:33.651976    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 19:04:33.652417 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:33.652145    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 19:04:33.991455 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:33.991415    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:34.141474 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:34.141421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:34.735910 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:34.735873    2572 generic.go:356] "Generic (PLEG): container finished" podID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerID="b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9" exitCode=0
Sep 15 19:04:34.737339 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:34.735946    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" event={"ID":"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87","Type":"ContainerDied","Data":"b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9"}
Sep 15 19:04:34.737339 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:34.736343    2572 scope.go:117] "RemoveContainer" containerID="b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9"
Sep 15 19:04:34.737784 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:34.737449    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:34.737784 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:34.737525    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:34.737784 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:34.737566    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:34.766416 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:34.766389    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:35.749734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:35.748730    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" event={"ID":"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87","Type":"ContainerStarted","Data":"ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18"}
Sep 15 19:04:35.752385 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:35.752348    2572 generic.go:356] "Generic (PLEG): container finished" podID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerID="34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00" exitCode=0
Sep 15 19:04:35.752540 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:35.752437    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" event={"ID":"4d5f211a-cac3-4d6c-98d5-3228fa8cf759","Type":"ContainerDied","Data":"34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00"}
Sep 15 19:04:35.753429 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:35.752948    2572 scope.go:117] "RemoveContainer" containerID="34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00"
Sep 15 19:04:35.754903 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:35.754557    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:35.754903 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:35.754644    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:35.754903 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:35.754688    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:36.728383 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:36.728350    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:36.728794 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:36.728691    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 19:04:36.729015 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:36.728989    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 19:04:36.767559 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:36.767514    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" event={"ID":"4d5f211a-cac3-4d6c-98d5-3228fa8cf759","Type":"ContainerStarted","Data":"47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215"}
Sep 15 19:04:36.796202 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:36.796173    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:36.796396 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:36.796368    2572 patch_prober.go:28] interesting pod/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 15 19:04:36.796453 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:36.796419    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 15 19:04:37.493453 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:37.493396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:37.577747 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:37.577703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:37.728192 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:37.728146    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 19:04:37.728399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:37.728218    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 19:04:37.796542 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:37.796454    2572 patch_prober.go:28] interesting pod/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 15 19:04:37.796542 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:37.796508    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 15 19:04:38.728065 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:38.728019    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 19:04:38.728283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:38.728100    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 19:04:38.797089 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:38.797057    2572 patch_prober.go:28] interesting pod/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 15 19:04:38.797535 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:38.797511    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 15 19:04:39.382040 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:39.381967    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:39.486213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:39.486177    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:39.727486 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:39.727444    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 19:04:39.727786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:39.727754    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 19:04:39.796480 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:39.796449    2572 patch_prober.go:28] interesting pod/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 15 19:04:39.796637 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:39.796503    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 15 19:04:40.002734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:40.002648    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:40.728006 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:40.727963    2572 patch_prober.go:28] interesting pod/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 15 19:04:40.728220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:40.728044    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 15 19:04:40.796261 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:40.796230    2572 patch_prober.go:28] interesting pod/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 15 19:04:40.796441 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:40.796280    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 15 19:04:41.042750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:41.042713    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:41.740287 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:41.740257    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:41.741187 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:41.741164    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:41.741910 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:41.741886    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:04:41.796225 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:41.796183    2572 patch_prober.go:28] interesting pod/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 15 19:04:41.796399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:41.796282    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 15 19:04:41.866840 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:41.866795    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:41.973197 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:41.973163    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:42.065622 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:42.065526    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:42.724020 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:42.723988    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:42.724201 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:42.724184    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:42.800735 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:42.800705    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:42.801135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:42.801106    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:42.801727 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:42.801706    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:04:42.974228 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:42.974149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:43.636594 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:43.636563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:43.742409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:43.742372    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:44.282089 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.282061    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:44.314260 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.314238    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"]
Sep 15 19:04:44.316723 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.316708    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:44.318645 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.318618    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-08e9c4\""
Sep 15 19:04:44.318763 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.318651    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-08e9c4-dockercfg-9qfm8\""
Sep 15 19:04:44.328575 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.328520    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"]
Sep 15 19:04:44.350382 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.350360    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:44.449879 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.449774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj\" (UID: \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:44.450028 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.449916    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft2l6\" (UniqueName: \"kubernetes.io/projected/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-kube-api-access-ft2l6\") pod \"payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj\" (UID: \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:44.550752 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.550726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj\" (UID: \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:44.550909 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.550775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2l6\" (UniqueName: \"kubernetes.io/projected/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-kube-api-access-ft2l6\") pod \"payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj\" (UID: \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:44.551418 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.551401    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj\" (UID: \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:44.557876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.557856    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft2l6\" (UniqueName: \"kubernetes.io/projected/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-kube-api-access-ft2l6\") pod \"payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj\" (UID: \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:44.563761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.563741    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:44.628017 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.627994    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:44.826598 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.826527    2572 generic.go:356] "Generic (PLEG): container finished" podID="94401101-a05b-400d-bc13-fe644b73d225" containerID="170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69" exitCode=0
Sep 15 19:04:44.826598 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.826569    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" event={"ID":"94401101-a05b-400d-bc13-fe644b73d225","Type":"ContainerDied","Data":"170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69"}
Sep 15 19:04:44.827011 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.826949    2572 scope.go:117] "RemoveContainer" containerID="170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69"
Sep 15 19:04:44.828058 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.828033    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:44.828111 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.828098    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:44.828154 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.828130    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:44.899053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:44.899027    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"]
Sep 15 19:04:44.900072 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:04:44.900038    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91215ae3_41a8_40f0_b51f_b6789f4ccb6d.slice/crio-70028ec08222e8f0d4d24c3c9e86c9d42024d0fdc7a347daffcb0865612d4357 WatchSource:0}: Error finding container 70028ec08222e8f0d4d24c3c9e86c9d42024d0fdc7a347daffcb0865612d4357: Status 404 returned error can't find the container with id 70028ec08222e8f0d4d24c3c9e86c9d42024d0fdc7a347daffcb0865612d4357
Sep 15 19:04:45.300651 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:45.300602    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:45.842488 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:45.842446    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" event={"ID":"94401101-a05b-400d-bc13-fe644b73d225","Type":"ContainerStarted","Data":"8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e"}
Sep 15 19:04:45.851876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:45.851845    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj" event={"ID":"91215ae3-41a8-40f0-b51f-b6789f4ccb6d","Type":"ContainerStarted","Data":"5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1"}
Sep 15 19:04:45.852033 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:45.851927    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj" event={"ID":"91215ae3-41a8-40f0-b51f-b6789f4ccb6d","Type":"ContainerStarted","Data":"70028ec08222e8f0d4d24c3c9e86c9d42024d0fdc7a347daffcb0865612d4357"}
Sep 15 19:04:45.852033 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:45.851953    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:45.878137 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:45.878085    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj" podStartSLOduration=1.878071423 podStartE2EDuration="1.878071423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:45.876021087 +0000 UTC m=+860.824249498" watchObservedRunningTime="2026-09-15 19:04:45.878071423 +0000 UTC m=+860.826299747"
Sep 15 19:04:45.996141 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:45.996107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:46.321750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.321665    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:46.322032 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.321999    2572 patch_prober.go:28] interesting pod/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 19:04:46.322235 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.322205    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 19:04:46.632836 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.632738    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"]
Sep 15 19:04:46.636101 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.636080    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"
Sep 15 19:04:46.638053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.638029    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:04:46.645493 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.645471    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"]
Sep 15 19:04:46.773163 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.773129    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ae92f0-9d75-4f73-acc6-7845d21883ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4df819e5-9klzp\" (UID: \"b0ae92f0-9d75-4f73-acc6-7845d21883ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"
Sep 15 19:04:46.788891 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.788858    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:46.873694 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.873658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ae92f0-9d75-4f73-acc6-7845d21883ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4df819e5-9klzp\" (UID: \"b0ae92f0-9d75-4f73-acc6-7845d21883ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"
Sep 15 19:04:46.874322 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.874302    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ae92f0-9d75-4f73-acc6-7845d21883ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4df819e5-9klzp\" (UID: \"b0ae92f0-9d75-4f73-acc6-7845d21883ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"
Sep 15 19:04:46.948816 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:46.948786    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"
Sep 15 19:04:47.225442 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:47.225394    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"]
Sep 15 19:04:47.227043 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:04:47.227019    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ae92f0_9d75_4f73_acc6_7845d21883ec.slice/crio-7e935cbaff1c96b6cba50399e767e182fb06704f9a2fe121d17fc96fc493f838 WatchSource:0}: Error finding container 7e935cbaff1c96b6cba50399e767e182fb06704f9a2fe121d17fc96fc493f838: Status 404 returned error can't find the container with id 7e935cbaff1c96b6cba50399e767e182fb06704f9a2fe121d17fc96fc493f838
Sep 15 19:04:47.322231 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:47.322197    2572 patch_prober.go:28] interesting pod/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 19:04:47.322347 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:47.322253    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 19:04:47.495773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:47.495699    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:47.864299 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:47.864217    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp" event={"ID":"b0ae92f0-9d75-4f73-acc6-7845d21883ec","Type":"ContainerStarted","Data":"7e935cbaff1c96b6cba50399e767e182fb06704f9a2fe121d17fc96fc493f838"}
Sep 15 19:04:48.252312 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:48.252278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:48.322157 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:48.322122    2572 patch_prober.go:28] interesting pod/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 19:04:48.322460 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:48.322420    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 19:04:48.837634 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:48.837595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:49.331960 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:49.331920    2572 patch_prober.go:28] interesting pod/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 19:04:49.332471 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:49.331992    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 19:04:49.585951 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:49.585861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:50.308220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:50.308183    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:50.322761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:50.322625    2572 patch_prober.go:28] interesting pod/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 15 19:04:50.322761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:50.322715    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 15 19:04:50.886353 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:50.886262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp" event={"ID":"b0ae92f0-9d75-4f73-acc6-7845d21883ec","Type":"ContainerStarted","Data":"5792729e2de8b6860711e6c2e192f5ec81bc7dc3d7230384d5d724134fe03e19"}
Sep 15 19:04:50.907256 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:50.907209    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp" podStartSLOduration=2.054652172 podStartE2EDuration="4.907194384s" totalImagesPullingTime="2.852542212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:50.904981488 +0000 UTC m=+865.853209816" watchObservedRunningTime="2026-09-15 19:04:50.907194384 +0000 UTC m=+865.855422710"
Sep 15 19:04:51.094956 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:51.094921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:51.326271 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:51.326243    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:51.326657 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:51.326639    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:51.327306 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:51.327288    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:04:51.892955 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:51.892925    2572 generic.go:356] "Generic (PLEG): container finished" podID="b0ae92f0-9d75-4f73-acc6-7845d21883ec" containerID="5792729e2de8b6860711e6c2e192f5ec81bc7dc3d7230384d5d724134fe03e19" exitCode=0
Sep 15 19:04:51.893370 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:51.893010    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp" event={"ID":"b0ae92f0-9d75-4f73-acc6-7845d21883ec","Type":"ContainerDied","Data":"5792729e2de8b6860711e6c2e192f5ec81bc7dc3d7230384d5d724134fe03e19"}
Sep 15 19:04:53.049203 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.049178    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"
Sep 15 19:04:53.155450 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.155379    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ae92f0-9d75-4f73-acc6-7845d21883ec-maas-api-service-ca\") pod \"b0ae92f0-9d75-4f73-acc6-7845d21883ec\" (UID: \"b0ae92f0-9d75-4f73-acc6-7845d21883ec\") "
Sep 15 19:04:53.155696 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.155673    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ae92f0-9d75-4f73-acc6-7845d21883ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b0ae92f0-9d75-4f73-acc6-7845d21883ec" (UID: "b0ae92f0-9d75-4f73-acc6-7845d21883ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:04:53.256348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.256323    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ae92f0-9d75-4f73-acc6-7845d21883ec-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:04:53.552135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.552106    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:04:53.843276 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.843205    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:53.906361 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.906328    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp" event={"ID":"b0ae92f0-9d75-4f73-acc6-7845d21883ec","Type":"ContainerDied","Data":"7e935cbaff1c96b6cba50399e767e182fb06704f9a2fe121d17fc96fc493f838"}
Sep 15 19:04:53.906486 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.906363    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"
Sep 15 19:04:53.906486 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:53.906377    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e935cbaff1c96b6cba50399e767e182fb06704f9a2fe121d17fc96fc493f838"
Sep 15 19:04:54.551282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:54.551248    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:04:56.859705 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:56.859675    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:04:57.180116 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.180067    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:57.202569 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.202539    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"]
Sep 15 19:04:57.203012 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.202980    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz" podUID="0edca827-ea63-4f27-b71a-34389b9a2052" containerName="payload-processing" containerID="cri-o://3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1" gracePeriod=30
Sep 15 19:04:57.210682 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.210426    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"]
Sep 15 19:04:57.210837 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.210665    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk" podUID="202a5de1-0cb1-4a7f-a799-d419f413df42" containerName="payload-pre-processing" containerID="cri-o://af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb" gracePeriod=30
Sep 15 19:04:57.341356 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.341307    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"]
Sep 15 19:04:57.343895 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.343864    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df819e5-9klzp"]
Sep 15 19:04:57.363248 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.363221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:57.422632 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.422461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:57.485209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.485173    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"]
Sep 15 19:04:57.485913 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.485617    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy" containerID="cri-o://8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e" gracePeriod=30
Sep 15 19:04:57.504835 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.504772    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:57.509144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.509114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:57.530864 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.530836    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:57.560456 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.560420    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ae92f0-9d75-4f73-acc6-7845d21883ec" path="/var/lib/kubelet/pods/b0ae92f0-9d75-4f73-acc6-7845d21883ec/volumes"
Sep 15 19:04:57.593362 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.593321    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0edca827-ea63-4f27-b71a-34389b9a2052-plugins-config-volume\") pod \"0edca827-ea63-4f27-b71a-34389b9a2052\" (UID: \"0edca827-ea63-4f27-b71a-34389b9a2052\") "
Sep 15 19:04:57.593576 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.593405    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdb9k\" (UniqueName: \"kubernetes.io/projected/0edca827-ea63-4f27-b71a-34389b9a2052-kube-api-access-mdb9k\") pod \"0edca827-ea63-4f27-b71a-34389b9a2052\" (UID: \"0edca827-ea63-4f27-b71a-34389b9a2052\") "
Sep 15 19:04:57.594158 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.594130    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0edca827-ea63-4f27-b71a-34389b9a2052-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0edca827-ea63-4f27-b71a-34389b9a2052" (UID: "0edca827-ea63-4f27-b71a-34389b9a2052"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:04:57.596645 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.596487    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0edca827-ea63-4f27-b71a-34389b9a2052-kube-api-access-mdb9k" (OuterVolumeSpecName: "kube-api-access-mdb9k") pod "0edca827-ea63-4f27-b71a-34389b9a2052" (UID: "0edca827-ea63-4f27-b71a-34389b9a2052"). InnerVolumeSpecName "kube-api-access-mdb9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:04:57.694995 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.694960    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26ng5\" (UniqueName: \"kubernetes.io/projected/202a5de1-0cb1-4a7f-a799-d419f413df42-kube-api-access-26ng5\") pod \"202a5de1-0cb1-4a7f-a799-d419f413df42\" (UID: \"202a5de1-0cb1-4a7f-a799-d419f413df42\") "
Sep 15 19:04:57.695176 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.695022    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202a5de1-0cb1-4a7f-a799-d419f413df42-plugins-config-volume\") pod \"202a5de1-0cb1-4a7f-a799-d419f413df42\" (UID: \"202a5de1-0cb1-4a7f-a799-d419f413df42\") "
Sep 15 19:04:57.695252 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.695231    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0edca827-ea63-4f27-b71a-34389b9a2052-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:04:57.695252 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.695243    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdb9k\" (UniqueName: \"kubernetes.io/projected/0edca827-ea63-4f27-b71a-34389b9a2052-kube-api-access-mdb9k\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:04:57.695359 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.695342    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/202a5de1-0cb1-4a7f-a799-d419f413df42-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "202a5de1-0cb1-4a7f-a799-d419f413df42" (UID: "202a5de1-0cb1-4a7f-a799-d419f413df42"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:04:57.696927 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.696904    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/202a5de1-0cb1-4a7f-a799-d419f413df42-kube-api-access-26ng5" (OuterVolumeSpecName: "kube-api-access-26ng5") pod "202a5de1-0cb1-4a7f-a799-d419f413df42" (UID: "202a5de1-0cb1-4a7f-a799-d419f413df42"). InnerVolumeSpecName "kube-api-access-26ng5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:04:57.765312 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.765244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:57.795990 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.795966    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26ng5\" (UniqueName: \"kubernetes.io/projected/202a5de1-0cb1-4a7f-a799-d419f413df42-kube-api-access-26ng5\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:04:57.795990 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.795990    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202a5de1-0cb1-4a7f-a799-d419f413df42-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:04:57.931466 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.931429    2572 generic.go:356] "Generic (PLEG): container finished" podID="202a5de1-0cb1-4a7f-a799-d419f413df42" containerID="af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb" exitCode=0
Sep 15 19:04:57.931942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.931473    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"
Sep 15 19:04:57.931942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.931511    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk" event={"ID":"202a5de1-0cb1-4a7f-a799-d419f413df42","Type":"ContainerDied","Data":"af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb"}
Sep 15 19:04:57.931942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.931573    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk" event={"ID":"202a5de1-0cb1-4a7f-a799-d419f413df42","Type":"ContainerDied","Data":"ae2531d3cf96f3a7b2dad66bfa43641ada99d0bcab38279fb2d51ebb6f46fcff"}
Sep 15 19:04:57.931942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.931609    2572 scope.go:117] "RemoveContainer" containerID="af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb"
Sep 15 19:04:57.933084 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.933064    2572 generic.go:356] "Generic (PLEG): container finished" podID="0edca827-ea63-4f27-b71a-34389b9a2052" containerID="3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1" exitCode=0
Sep 15 19:04:57.933189 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.933106    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz" event={"ID":"0edca827-ea63-4f27-b71a-34389b9a2052","Type":"ContainerDied","Data":"3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1"}
Sep 15 19:04:57.933189 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.933152    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz" event={"ID":"0edca827-ea63-4f27-b71a-34389b9a2052","Type":"ContainerDied","Data":"c07ca0bcc99808ae3d2502c890c95bac8bd141eea8a8aaaf0f2a16b5fd062d43"}
Sep 15 19:04:57.933189 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.933116    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"
Sep 15 19:04:57.942078 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.942055    2572 scope.go:117] "RemoveContainer" containerID="af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb"
Sep 15 19:04:57.942359 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:04:57.942335    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb\": container with ID starting with af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb not found: ID does not exist" containerID="af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb"
Sep 15 19:04:57.942457 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.942369    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb"} err="failed to get container status \"af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb\": rpc error: code = NotFound desc = could not find container \"af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb\": container with ID starting with af52300e1e5d71872354f97497d1fe73ec293a7d86fa447b83628557b67d9abb not found: ID does not exist"
Sep 15 19:04:57.942457 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.942389    2572 scope.go:117] "RemoveContainer" containerID="3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1"
Sep 15 19:04:57.951915 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.951896    2572 scope.go:117] "RemoveContainer" containerID="3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1"
Sep 15 19:04:57.952171 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:04:57.952151    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1\": container with ID starting with 3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1 not found: ID does not exist" containerID="3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1"
Sep 15 19:04:57.952234 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.952178    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1"} err="failed to get container status \"3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1\": rpc error: code = NotFound desc = could not find container \"3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1\": container with ID starting with 3b5883f9af9daeca1d28f93bc33bf76bb272ac60ba544ea559cbb48263d239c1 not found: ID does not exist"
Sep 15 19:04:57.961385 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.961365    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"]
Sep 15 19:04:57.975939 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.975916    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df819e5-58dd877898-544nk"]
Sep 15 19:04:57.989227 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.989199    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:57.995641 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.995618    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"]
Sep 15 19:04:57.997877 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:57.997856    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df819e5-dd8f79879-kjwbz"]
Sep 15 19:04:58.066078 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.066019    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:58.198908 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.198887    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:58.494545 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.494515    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"]
Sep 15 19:04:58.495076 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495047    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ae92f0-9d75-4f73-acc6-7845d21883ec" containerName="revoke-keys"
Sep 15 19:04:58.495076 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495065    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ae92f0-9d75-4f73-acc6-7845d21883ec" containerName="revoke-keys"
Sep 15 19:04:58.495076 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495074    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0edca827-ea63-4f27-b71a-34389b9a2052" containerName="payload-processing"
Sep 15 19:04:58.495076 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495080    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0edca827-ea63-4f27-b71a-34389b9a2052" containerName="payload-processing"
Sep 15 19:04:58.495376 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495112    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="202a5de1-0cb1-4a7f-a799-d419f413df42" containerName="payload-pre-processing"
Sep 15 19:04:58.495376 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495119    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="202a5de1-0cb1-4a7f-a799-d419f413df42" containerName="payload-pre-processing"
Sep 15 19:04:58.495376 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495184    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ae92f0-9d75-4f73-acc6-7845d21883ec" containerName="revoke-keys"
Sep 15 19:04:58.495376 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495192    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0edca827-ea63-4f27-b71a-34389b9a2052" containerName="payload-processing"
Sep 15 19:04:58.495376 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.495200    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="202a5de1-0cb1-4a7f-a799-d419f413df42" containerName="payload-pre-processing"
Sep 15 19:04:58.499576 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.499558    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.502076 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.502052    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-813c61ca-gw-openshift-default-dockercfg-jgjd5\""
Sep 15 19:04:58.510236 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.510195    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:58.511872 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.511850    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"]
Sep 15 19:04:58.603928 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.603896    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm5gn\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-kube-api-access-cm5gn\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.603928 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.603939    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602d802b-0022-49b9-8d1f-6e1243a81674-istio-podinfo\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.604181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.603977    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-envoy\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.604181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.604017    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-data\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.604181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.604035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-socket\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.604181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.604140    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-credential-socket\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.604395 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.604185    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-istio-token\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.604395 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.604245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-certs\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.604395 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.604283    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602d802b-0022-49b9-8d1f-6e1243a81674-istiod-ca-cert\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.609065 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.608990    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:58.705123 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602d802b-0022-49b9-8d1f-6e1243a81674-istio-podinfo\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705275 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705143    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-envoy\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705275 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705209    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-data\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705275 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705246    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-socket\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705303    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-credential-socket\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705494 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705450    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-istio-token\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705548 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-certs\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705602 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602d802b-0022-49b9-8d1f-6e1243a81674-istiod-ca-cert\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705659 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705626    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-credential-socket\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705739 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-socket\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705801 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm5gn\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-kube-api-access-cm5gn\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.705896 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705837    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-certs\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.706018 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.705918    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-data\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.706373 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.706350    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602d802b-0022-49b9-8d1f-6e1243a81674-istiod-ca-cert\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.707521 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.707500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-envoy\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.707623 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.707609    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602d802b-0022-49b9-8d1f-6e1243a81674-istio-podinfo\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.717372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.717339    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-istio-token\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.717481 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.717459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm5gn\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-kube-api-access-cm5gn\") pod \"e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") " pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:58.810890 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:58.810840    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:04:59.031498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.031432    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:04:59.088709 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.088683    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"]
Sep 15 19:04:59.090544 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:04:59.090520    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602d802b_0022_49b9_8d1f_6e1243a81674.slice/crio-43d4472758b427cda46bd443be2112710cf3fff02f015f9a6f09254d2a97b63d WatchSource:0}: Error finding container 43d4472758b427cda46bd443be2112710cf3fff02f015f9a6f09254d2a97b63d: Status 404 returned error can't find the container with id 43d4472758b427cda46bd443be2112710cf3fff02f015f9a6f09254d2a97b63d
Sep 15 19:04:59.092887 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.092854    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:59.092962 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.092920    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:59.092962 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.092948    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:04:59.558682 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.558652    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0edca827-ea63-4f27-b71a-34389b9a2052" path="/var/lib/kubelet/pods/0edca827-ea63-4f27-b71a-34389b9a2052/volumes"
Sep 15 19:04:59.559132 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.559111    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="202a5de1-0cb1-4a7f-a799-d419f413df42" path="/var/lib/kubelet/pods/202a5de1-0cb1-4a7f-a799-d419f413df42/volumes"
Sep 15 19:04:59.948719 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.948686    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" event={"ID":"602d802b-0022-49b9-8d1f-6e1243a81674","Type":"ContainerStarted","Data":"7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03"}
Sep 15 19:04:59.948904 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.948735    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" event={"ID":"602d802b-0022-49b9-8d1f-6e1243a81674","Type":"ContainerStarted","Data":"43d4472758b427cda46bd443be2112710cf3fff02f015f9a6f09254d2a97b63d"}
Sep 15 19:04:59.966532 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:04:59.966490    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" podStartSLOduration=1.966476676 podStartE2EDuration="1.966476676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:04:59.965221318 +0000 UTC m=+874.913449666" watchObservedRunningTime="2026-09-15 19:04:59.966476676 +0000 UTC m=+874.914705066"
Sep 15 19:05:00.811639 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:00.811604    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:00.816400 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:00.816377    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:00.954733 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:00.954702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:00.955459 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:00.955437    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:01.220070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:01.220040    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:01.319860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:01.319798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:01.718587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:01.718555    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:01.818656 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:01.818622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:02.847975 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.847949    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:05:02.944978 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.944952    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v578f\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-kube-api-access-v578f\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945119 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.944986    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-envoy\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945119 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945012    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-data\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945119 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945037    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-credential-socket\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945247 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945162    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-istio-token\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945247 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945219    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94401101-a05b-400d-bc13-fe644b73d225-istiod-ca-cert\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945322 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945268    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-data" (OuterVolumeSpecName: "istio-data") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:02.945322 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945283    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-socket\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945322 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945307    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:02.945483 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945355    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94401101-a05b-400d-bc13-fe644b73d225-istio-podinfo\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945483 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945411    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-certs\") pod \"94401101-a05b-400d-bc13-fe644b73d225\" (UID: \"94401101-a05b-400d-bc13-fe644b73d225\") "
Sep 15 19:05:02.945580 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945481    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:02.945580 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945560    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94401101-a05b-400d-bc13-fe644b73d225-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:05:02.945781 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945762    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:02.945945 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945789    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:02.945945 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945945    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:02.946104 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945956    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94401101-a05b-400d-bc13-fe644b73d225-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:02.946104 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.945965    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:02.947340 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.947311    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94401101-a05b-400d-bc13-fe644b73d225-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:05:02.947340 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.947327    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-kube-api-access-v578f" (OuterVolumeSpecName: "kube-api-access-v578f") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "kube-api-access-v578f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:05:02.947593 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.947572    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:02.947670 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.947597    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-istio-token" (OuterVolumeSpecName: "istio-token") pod "94401101-a05b-400d-bc13-fe644b73d225" (UID: "94401101-a05b-400d-bc13-fe644b73d225"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:05:02.969063 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.969039    2572 generic.go:356] "Generic (PLEG): container finished" podID="94401101-a05b-400d-bc13-fe644b73d225" containerID="8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e" exitCode=0
Sep 15 19:05:02.969144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.969083    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"
Sep 15 19:05:02.969144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.969124    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" event={"ID":"94401101-a05b-400d-bc13-fe644b73d225","Type":"ContainerDied","Data":"8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e"}
Sep 15 19:05:02.969216 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.969179    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db" event={"ID":"94401101-a05b-400d-bc13-fe644b73d225","Type":"ContainerDied","Data":"bb0b7f45af016ec4a1ce1dd13fd5229ed761f0496626833ac6a57bfa1ac58dd1"}
Sep 15 19:05:02.969216 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.969208    2572 scope.go:117] "RemoveContainer" containerID="8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e"
Sep 15 19:05:02.981714 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.981696    2572 scope.go:117] "RemoveContainer" containerID="170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69"
Sep 15 19:05:02.990117 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.990050    2572 scope.go:117] "RemoveContainer" containerID="8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e"
Sep 15 19:05:02.990503 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:05:02.990480    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e\": container with ID starting with 8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e not found: ID does not exist" containerID="8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e"
Sep 15 19:05:02.990579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.990508    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e"} err="failed to get container status \"8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e\": rpc error: code = NotFound desc = could not find container \"8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e\": container with ID starting with 8975b8eece205641080bd3073d3c5a061fd6aca3d1769221d9f37c38830b5e1e not found: ID does not exist"
Sep 15 19:05:02.990579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.990523    2572 scope.go:117] "RemoveContainer" containerID="170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69"
Sep 15 19:05:02.990785 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:05:02.990767    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69\": container with ID starting with 170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69 not found: ID does not exist" containerID="170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69"
Sep 15 19:05:02.990861 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.990793    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69"} err="failed to get container status \"170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69\": rpc error: code = NotFound desc = could not find container \"170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69\": container with ID starting with 170de3427f268e0ef3c72a0b36c516ce87ae79d2dd5961cdc4b12c5efa1e8b69 not found: ID does not exist"
Sep 15 19:05:02.992919 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.992897    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"]
Sep 15 19:05:02.996455 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:02.996436    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4df819e5-openshift-default-6f5df5dbd-rx9db"]
Sep 15 19:05:03.046762 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:03.046742    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94401101-a05b-400d-bc13-fe644b73d225-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:03.046762 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:03.046762    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:03.046905 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:03.046773    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v578f\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-kube-api-access-v578f\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:03.046905 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:03.046782    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94401101-a05b-400d-bc13-fe644b73d225-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:03.046905 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:03.046789    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94401101-a05b-400d-bc13-fe644b73d225-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:03.557983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:03.557945    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94401101-a05b-400d-bc13-fe644b73d225" path="/var/lib/kubelet/pods/94401101-a05b-400d-bc13-fe644b73d225/volumes"
Sep 15 19:05:04.109972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:04.109940    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:04.211019 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:04.210981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:05.010076 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:05.010044    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:05.678402 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:05.678375    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:05.736958 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:05.736928    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:05.884061 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:05.884032    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:06.136877 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.136764    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:06.243995 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.243968    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"]
Sep 15 19:05:06.244363 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.244351    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy"
Sep 15 19:05:06.244409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.244365    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy"
Sep 15 19:05:06.244409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.244380    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy"
Sep 15 19:05:06.244409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.244386    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy"
Sep 15 19:05:06.244505 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.244477    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy"
Sep 15 19:05:06.244505 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.244485    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="94401101-a05b-400d-bc13-fe644b73d225" containerName="istio-proxy"
Sep 15 19:05:06.249033 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.249015    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.251406 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.251385    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-813c61ca-dockercfg-sllzt\""
Sep 15 19:05:06.251553 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.251433    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-813c61ca\""
Sep 15 19:05:06.258260 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.258235    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"]
Sep 15 19:05:06.279737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.279710    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"]
Sep 15 19:05:06.283063 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.283048    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:06.292542 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.292522    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"]
Sep 15 19:05:06.377693 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.377661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6q4h\" (UniqueName: \"kubernetes.io/projected/87d3c89f-f47a-430f-801b-80e3d86d79de-kube-api-access-v6q4h\") pod \"payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt\" (UID: \"87d3c89f-f47a-430f-801b-80e3d86d79de\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.377693 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.377696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r7lp\" (UniqueName: \"kubernetes.io/projected/5ac6b04d-3574-4704-8774-94b9dc07a531-kube-api-access-4r7lp\") pod \"payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk\" (UID: \"5ac6b04d-3574-4704-8774-94b9dc07a531\") " pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:06.377899 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.377727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87d3c89f-f47a-430f-801b-80e3d86d79de-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt\" (UID: \"87d3c89f-f47a-430f-801b-80e3d86d79de\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.377899 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.377818    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac6b04d-3574-4704-8774-94b9dc07a531-plugins-config-volume\") pod \"payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk\" (UID: \"5ac6b04d-3574-4704-8774-94b9dc07a531\") " pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:06.478744 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.478719    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6q4h\" (UniqueName: \"kubernetes.io/projected/87d3c89f-f47a-430f-801b-80e3d86d79de-kube-api-access-v6q4h\") pod \"payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt\" (UID: \"87d3c89f-f47a-430f-801b-80e3d86d79de\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.478890 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.478751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r7lp\" (UniqueName: \"kubernetes.io/projected/5ac6b04d-3574-4704-8774-94b9dc07a531-kube-api-access-4r7lp\") pod \"payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk\" (UID: \"5ac6b04d-3574-4704-8774-94b9dc07a531\") " pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:06.478890 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.478786    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87d3c89f-f47a-430f-801b-80e3d86d79de-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt\" (UID: \"87d3c89f-f47a-430f-801b-80e3d86d79de\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.478890 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.478849    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac6b04d-3574-4704-8774-94b9dc07a531-plugins-config-volume\") pod \"payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk\" (UID: \"5ac6b04d-3574-4704-8774-94b9dc07a531\") " pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:06.479699 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.479679    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac6b04d-3574-4704-8774-94b9dc07a531-plugins-config-volume\") pod \"payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk\" (UID: \"5ac6b04d-3574-4704-8774-94b9dc07a531\") " pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:06.479734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.479682    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87d3c89f-f47a-430f-801b-80e3d86d79de-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt\" (UID: \"87d3c89f-f47a-430f-801b-80e3d86d79de\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.486821 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.486781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6q4h\" (UniqueName: \"kubernetes.io/projected/87d3c89f-f47a-430f-801b-80e3d86d79de-kube-api-access-v6q4h\") pod \"payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt\" (UID: \"87d3c89f-f47a-430f-801b-80e3d86d79de\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.486821 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.486795    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r7lp\" (UniqueName: \"kubernetes.io/projected/5ac6b04d-3574-4704-8774-94b9dc07a531-kube-api-access-4r7lp\") pod \"payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk\" (UID: \"5ac6b04d-3574-4704-8774-94b9dc07a531\") " pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:06.560837 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.560797    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.593087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.593061    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:06.842280 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.842254    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"]
Sep 15 19:05:06.844231 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:05:06.844209    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d3c89f_f47a_430f_801b_80e3d86d79de.slice/crio-318c31de27e9c55da748a5fe20f18e85bed63498077a3ef815c3e36f5a835890 WatchSource:0}: Error finding container 318c31de27e9c55da748a5fe20f18e85bed63498077a3ef815c3e36f5a835890: Status 404 returned error can't find the container with id 318c31de27e9c55da748a5fe20f18e85bed63498077a3ef815c3e36f5a835890
Sep 15 19:05:06.879751 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.879726    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"]
Sep 15 19:05:06.882931 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:05:06.882902    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac6b04d_3574_4704_8774_94b9dc07a531.slice/crio-9681cf2de3fa5720c9cf9c8c0e5daac75652ec7e05175097e7a2fd2574bd7fdc WatchSource:0}: Error finding container 9681cf2de3fa5720c9cf9c8c0e5daac75652ec7e05175097e7a2fd2574bd7fdc: Status 404 returned error can't find the container with id 9681cf2de3fa5720c9cf9c8c0e5daac75652ec7e05175097e7a2fd2574bd7fdc
Sep 15 19:05:06.995145 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.995116    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt" event={"ID":"87d3c89f-f47a-430f-801b-80e3d86d79de","Type":"ContainerStarted","Data":"6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2"}
Sep 15 19:05:06.995283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.995167    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt" event={"ID":"87d3c89f-f47a-430f-801b-80e3d86d79de","Type":"ContainerStarted","Data":"318c31de27e9c55da748a5fe20f18e85bed63498077a3ef815c3e36f5a835890"}
Sep 15 19:05:06.995283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.995211    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:06.996977 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.996917    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk" event={"ID":"5ac6b04d-3574-4704-8774-94b9dc07a531","Type":"ContainerStarted","Data":"efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b"}
Sep 15 19:05:06.996977 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.996956    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk" event={"ID":"5ac6b04d-3574-4704-8774-94b9dc07a531","Type":"ContainerStarted","Data":"9681cf2de3fa5720c9cf9c8c0e5daac75652ec7e05175097e7a2fd2574bd7fdc"}
Sep 15 19:05:06.996977 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:06.996977    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:07.011588 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:07.011538    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt" podStartSLOduration=1.011522811 podStartE2EDuration="1.011522811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:05:07.009557476 +0000 UTC m=+881.957785850" watchObservedRunningTime="2026-09-15 19:05:07.011522811 +0000 UTC m=+881.959751486"
Sep 15 19:05:07.029253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:07.029198    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk" podStartSLOduration=1.029181037 podStartE2EDuration="1.029181037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:05:07.02763646 +0000 UTC m=+881.975864786" watchObservedRunningTime="2026-09-15 19:05:07.029181037 +0000 UTC m=+881.977409366"
Sep 15 19:05:08.608696 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:08.608659    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:08.709381 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:08.709345    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:16.743042 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:16.743010    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:18.005280 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:18.005194    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:18.005694 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:18.005456    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:24.100079 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:24.100049    2572 generic.go:356] "Generic (PLEG): container finished" podID="602d802b-0022-49b9-8d1f-6e1243a81674" containerID="7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03" exitCode=0
Sep 15 19:05:24.100471 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:24.100123    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" event={"ID":"602d802b-0022-49b9-8d1f-6e1243a81674","Type":"ContainerDied","Data":"7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03"}
Sep 15 19:05:24.100514 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:24.100470    2572 scope.go:117] "RemoveContainer" containerID="7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03"
Sep 15 19:05:24.101579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:24.101552    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:05:24.101638 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:24.101617    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:05:24.101674 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:24.101647    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:05:25.108792 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:25.108754    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" event={"ID":"602d802b-0022-49b9-8d1f-6e1243a81674","Type":"ContainerStarted","Data":"9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1"}
Sep 15 19:05:25.558786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:25.558760    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:05:25.558994 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:25.558856    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:05:25.812098 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:25.812007    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:25.812331 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:25.812300    2572 patch_prober.go:28] interesting pod/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 19:05:25.812545 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:25.812518    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 19:05:26.811644 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:26.811608    2572 patch_prober.go:28] interesting pod/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 19:05:26.812218 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:26.812188    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 19:05:27.578083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:27.578040    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:27.811729 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:27.811695    2572 patch_prober.go:28] interesting pod/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 19:05:27.812317 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:27.812284    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 19:05:28.213181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:28.213123    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:28.811491 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:28.811455    2572 patch_prober.go:28] interesting pod/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 19:05:28.811850 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:28.811777    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 19:05:28.846216 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:28.846169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:29.682018 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:29.681976    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:29.811866 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:29.811826    2572 patch_prober.go:28] interesting pod/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 19:05:29.812345 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:29.811909    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 19:05:30.226850 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:30.226793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:30.815640 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:30.815606    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:30.816053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:30.815905    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:30.816529 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:30.816511    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:31.707235 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:31.707201    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"]
Sep 15 19:05:31.711608 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:31.711586    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"
Sep 15 19:05:31.714143 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:31.714121    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:05:31.717029 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:31.717006    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"]
Sep 15 19:05:31.798509 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:31.798473    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/756c68fb-9b1f-4093-a6e6-f04df4f8aa6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j\" (UID: \"756c68fb-9b1f-4093-a6e6-f04df4f8aa6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"
Sep 15 19:05:31.899500 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:31.899477    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/756c68fb-9b1f-4093-a6e6-f04df4f8aa6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j\" (UID: \"756c68fb-9b1f-4093-a6e6-f04df4f8aa6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"
Sep 15 19:05:31.900116 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:31.900096    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/756c68fb-9b1f-4093-a6e6-f04df4f8aa6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j\" (UID: \"756c68fb-9b1f-4093-a6e6-f04df4f8aa6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"
Sep 15 19:05:32.025117 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:32.025061    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"
Sep 15 19:05:32.295371 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:32.295342    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"]
Sep 15 19:05:32.296247 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:05:32.296223    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756c68fb_9b1f_4093_a6e6_f04df4f8aa6c.slice/crio-cccac459e6e06af2ab55d84423c97808ea39903ece4e8b08ef8c484992685fd2 WatchSource:0}: Error finding container cccac459e6e06af2ab55d84423c97808ea39903ece4e8b08ef8c484992685fd2: Status 404 returned error can't find the container with id cccac459e6e06af2ab55d84423c97808ea39903ece4e8b08ef8c484992685fd2
Sep 15 19:05:33.169164 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:33.169126    2572 generic.go:356] "Generic (PLEG): container finished" podID="756c68fb-9b1f-4093-a6e6-f04df4f8aa6c" containerID="23a021c8680ec3bed0a9ab7aef27b7d166afd6d0e3c70461a037b3a68b2b1443" exitCode=0
Sep 15 19:05:33.169520 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:33.169214    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j" event={"ID":"756c68fb-9b1f-4093-a6e6-f04df4f8aa6c","Type":"ContainerDied","Data":"23a021c8680ec3bed0a9ab7aef27b7d166afd6d0e3c70461a037b3a68b2b1443"}
Sep 15 19:05:33.169520 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:33.169292    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j" event={"ID":"756c68fb-9b1f-4093-a6e6-f04df4f8aa6c","Type":"ContainerStarted","Data":"cccac459e6e06af2ab55d84423c97808ea39903ece4e8b08ef8c484992685fd2"}
Sep 15 19:05:33.290059 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:33.289970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:33.390357 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:33.390318    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:33.662203 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:33.662170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:34.317242 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:34.317217    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"
Sep 15 19:05:34.424483 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:34.424454    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/756c68fb-9b1f-4093-a6e6-f04df4f8aa6c-maas-api-service-ca\") pod \"756c68fb-9b1f-4093-a6e6-f04df4f8aa6c\" (UID: \"756c68fb-9b1f-4093-a6e6-f04df4f8aa6c\") "
Sep 15 19:05:34.424843 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:34.424821    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/756c68fb-9b1f-4093-a6e6-f04df4f8aa6c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "756c68fb-9b1f-4093-a6e6-f04df4f8aa6c" (UID: "756c68fb-9b1f-4093-a6e6-f04df4f8aa6c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:05:34.525473 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:34.525408    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/756c68fb-9b1f-4093-a6e6-f04df4f8aa6c-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:35.182982 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:35.182952    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"
Sep 15 19:05:35.183151 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:35.182987    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j" event={"ID":"756c68fb-9b1f-4093-a6e6-f04df4f8aa6c","Type":"ContainerDied","Data":"cccac459e6e06af2ab55d84423c97808ea39903ece4e8b08ef8c484992685fd2"}
Sep 15 19:05:35.183151 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:35.183036    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cccac459e6e06af2ab55d84423c97808ea39903ece4e8b08ef8c484992685fd2"
Sep 15 19:05:36.801762 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:36.801727    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:36.854921 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:36.854892    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:39.466708 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:39.466671    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:43.195446 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.195409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:43.218568 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.218538    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"]
Sep 15 19:05:43.218867 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.218838    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk" podUID="5ac6b04d-3574-4704-8774-94b9dc07a531" containerName="payload-processing" containerID="cri-o://efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b" gracePeriod=30
Sep 15 19:05:43.222643 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.222620    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"]
Sep 15 19:05:43.222912 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.222884    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt" podUID="87d3c89f-f47a-430f-801b-80e3d86d79de" containerName="payload-pre-processing" containerID="cri-o://6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2" gracePeriod=30
Sep 15 19:05:43.367026 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.366967    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"]
Sep 15 19:05:43.371162 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.371134    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-813c61ca-n5n2j"]
Sep 15 19:05:43.507592 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.507560    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"]
Sep 15 19:05:43.508112 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.507771    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy" containerID="cri-o://9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1" gracePeriod=30
Sep 15 19:05:43.516481 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.516457    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:43.540282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.539647    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:43.561291 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.561265    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756c68fb-9b1f-4093-a6e6-f04df4f8aa6c" path="/var/lib/kubelet/pods/756c68fb-9b1f-4093-a6e6-f04df4f8aa6c/volumes"
Sep 15 19:05:43.605213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.605185    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r7lp\" (UniqueName: \"kubernetes.io/projected/5ac6b04d-3574-4704-8774-94b9dc07a531-kube-api-access-4r7lp\") pod \"5ac6b04d-3574-4704-8774-94b9dc07a531\" (UID: \"5ac6b04d-3574-4704-8774-94b9dc07a531\") "
Sep 15 19:05:43.605415 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.605237    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87d3c89f-f47a-430f-801b-80e3d86d79de-plugins-config-volume\") pod \"87d3c89f-f47a-430f-801b-80e3d86d79de\" (UID: \"87d3c89f-f47a-430f-801b-80e3d86d79de\") "
Sep 15 19:05:43.605415 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.605328    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac6b04d-3574-4704-8774-94b9dc07a531-plugins-config-volume\") pod \"5ac6b04d-3574-4704-8774-94b9dc07a531\" (UID: \"5ac6b04d-3574-4704-8774-94b9dc07a531\") "
Sep 15 19:05:43.605415 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.605380    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6q4h\" (UniqueName: \"kubernetes.io/projected/87d3c89f-f47a-430f-801b-80e3d86d79de-kube-api-access-v6q4h\") pod \"87d3c89f-f47a-430f-801b-80e3d86d79de\" (UID: \"87d3c89f-f47a-430f-801b-80e3d86d79de\") "
Sep 15 19:05:43.605863 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.605796    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d3c89f-f47a-430f-801b-80e3d86d79de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87d3c89f-f47a-430f-801b-80e3d86d79de" (UID: "87d3c89f-f47a-430f-801b-80e3d86d79de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:05:43.605972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.605906    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac6b04d-3574-4704-8774-94b9dc07a531-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ac6b04d-3574-4704-8774-94b9dc07a531" (UID: "5ac6b04d-3574-4704-8774-94b9dc07a531"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:05:43.609547 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.609487    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac6b04d-3574-4704-8774-94b9dc07a531-kube-api-access-4r7lp" (OuterVolumeSpecName: "kube-api-access-4r7lp") pod "5ac6b04d-3574-4704-8774-94b9dc07a531" (UID: "5ac6b04d-3574-4704-8774-94b9dc07a531"). InnerVolumeSpecName "kube-api-access-4r7lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:05:43.612014 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.611972    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d3c89f-f47a-430f-801b-80e3d86d79de-kube-api-access-v6q4h" (OuterVolumeSpecName: "kube-api-access-v6q4h") pod "87d3c89f-f47a-430f-801b-80e3d86d79de" (UID: "87d3c89f-f47a-430f-801b-80e3d86d79de"). InnerVolumeSpecName "kube-api-access-v6q4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:05:43.712946 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.712912    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac6b04d-3574-4704-8774-94b9dc07a531-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:43.712946 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.712937    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6q4h\" (UniqueName: \"kubernetes.io/projected/87d3c89f-f47a-430f-801b-80e3d86d79de-kube-api-access-v6q4h\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:43.712946 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.712947    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r7lp\" (UniqueName: \"kubernetes.io/projected/5ac6b04d-3574-4704-8774-94b9dc07a531-kube-api-access-4r7lp\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:43.712946 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:43.712956    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87d3c89f-f47a-430f-801b-80e3d86d79de-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:44.243272 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.243240    2572 generic.go:356] "Generic (PLEG): container finished" podID="87d3c89f-f47a-430f-801b-80e3d86d79de" containerID="6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2" exitCode=0
Sep 15 19:05:44.243640 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.243295    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"
Sep 15 19:05:44.243640 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.243331    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt" event={"ID":"87d3c89f-f47a-430f-801b-80e3d86d79de","Type":"ContainerDied","Data":"6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2"}
Sep 15 19:05:44.243640 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.243417    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt" event={"ID":"87d3c89f-f47a-430f-801b-80e3d86d79de","Type":"ContainerDied","Data":"318c31de27e9c55da748a5fe20f18e85bed63498077a3ef815c3e36f5a835890"}
Sep 15 19:05:44.243640 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.243441    2572 scope.go:117] "RemoveContainer" containerID="6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2"
Sep 15 19:05:44.245005 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.244974    2572 generic.go:356] "Generic (PLEG): container finished" podID="5ac6b04d-3574-4704-8774-94b9dc07a531" containerID="efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b" exitCode=0
Sep 15 19:05:44.245079 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.245028    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"
Sep 15 19:05:44.245125 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.245026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk" event={"ID":"5ac6b04d-3574-4704-8774-94b9dc07a531","Type":"ContainerDied","Data":"efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b"}
Sep 15 19:05:44.245185 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.245163    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk" event={"ID":"5ac6b04d-3574-4704-8774-94b9dc07a531","Type":"ContainerDied","Data":"9681cf2de3fa5720c9cf9c8c0e5daac75652ec7e05175097e7a2fd2574bd7fdc"}
Sep 15 19:05:44.253735 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.253710    2572 scope.go:117] "RemoveContainer" containerID="6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2"
Sep 15 19:05:44.254038 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:05:44.254018    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2\": container with ID starting with 6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2 not found: ID does not exist" containerID="6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2"
Sep 15 19:05:44.254149 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.254049    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2"} err="failed to get container status \"6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2\": rpc error: code = NotFound desc = could not find container \"6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2\": container with ID starting with 6c403345ba92a180c9fabef591128d0e5d9d73c6dbc4a0599511f052faf673f2 not found: ID does not exist"
Sep 15 19:05:44.254149 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.254072    2572 scope.go:117] "RemoveContainer" containerID="efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b"
Sep 15 19:05:44.262403 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.262382    2572 scope.go:117] "RemoveContainer" containerID="efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b"
Sep 15 19:05:44.262681 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:05:44.262663    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b\": container with ID starting with efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b not found: ID does not exist" containerID="efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b"
Sep 15 19:05:44.262736 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.262687    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b"} err="failed to get container status \"efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b\": rpc error: code = NotFound desc = could not find container \"efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b\": container with ID starting with efa377ddfb7327d0dc28877cb929998a354e13f4bec5dabafb25861f4287db8b not found: ID does not exist"
Sep 15 19:05:44.270188 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.270167    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"]
Sep 15 19:05:44.278474 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.278452    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-813c61ca-684cb9f698-2wvnt"]
Sep 15 19:05:44.294091 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.294066    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"]
Sep 15 19:05:44.301495 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.301474    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-813c61ca-6669f485db-sv9mk"]
Sep 15 19:05:44.304547 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.304526    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"]
Sep 15 19:05:44.304929 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.304915    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac6b04d-3574-4704-8774-94b9dc07a531" containerName="payload-processing"
Sep 15 19:05:44.304984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.304931    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac6b04d-3574-4704-8774-94b9dc07a531" containerName="payload-processing"
Sep 15 19:05:44.304984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.304938    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756c68fb-9b1f-4093-a6e6-f04df4f8aa6c" containerName="revoke-keys"
Sep 15 19:05:44.304984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.304944    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="756c68fb-9b1f-4093-a6e6-f04df4f8aa6c" containerName="revoke-keys"
Sep 15 19:05:44.304984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.304952    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d3c89f-f47a-430f-801b-80e3d86d79de" containerName="payload-pre-processing"
Sep 15 19:05:44.304984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.304957    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d3c89f-f47a-430f-801b-80e3d86d79de" containerName="payload-pre-processing"
Sep 15 19:05:44.305135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.305015    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d3c89f-f47a-430f-801b-80e3d86d79de" containerName="payload-pre-processing"
Sep 15 19:05:44.305135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.305023    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac6b04d-3574-4704-8774-94b9dc07a531" containerName="payload-processing"
Sep 15 19:05:44.305135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.305030    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="756c68fb-9b1f-4093-a6e6-f04df4f8aa6c" containerName="revoke-keys"
Sep 15 19:05:44.309583 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.309566    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.311576 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.311560    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e886bcb7-openshift-default-dockercfg-jc8pb\""
Sep 15 19:05:44.318039 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.318019    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"]
Sep 15 19:05:44.419620 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.419471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-data\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.419620 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.419522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istiod-ca-cert\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.419620 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.419582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-token\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.419620 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.419613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-credential-socket\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.419971 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.419721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-certs\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.419971 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.419751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-envoy\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.419971 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.419931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kd79\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-kube-api-access-6kd79\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.420082 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.419971    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-socket\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.420082 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.420006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-podinfo\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.442077 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.442042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:44.521436 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521348    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-data\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521436 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istiod-ca-cert\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521436 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521425    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-token\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521686 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521458    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-credential-socket\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521686 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521529    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-certs\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521686 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521558    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-envoy\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521686 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521668    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kd79\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-kube-api-access-6kd79\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521935 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521697    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-socket\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521935 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521725    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-podinfo\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.521935 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521856    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-data\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.522087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.521956    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-credential-socket\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.522087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.522058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-certs\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.522194 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.522129    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-socket\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.522332 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.522314    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istiod-ca-cert\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.524118 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.524083    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-envoy\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.524231 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.524192    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-podinfo\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.535021 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.535000    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-token\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.536311 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.536291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kd79\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-kube-api-access-6kd79\") pod \"e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") " pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.620974 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.620956    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:44.626212 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.626170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:44.826447 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.826354    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:44.902671 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.902646    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"]
Sep 15 19:05:44.904250 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:05:44.904225    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e934e81_bb11_44aa_8e4f_7c88f83cd917.slice/crio-44d5b18c0a7065bbc7daa6ca7b471209212333b258bd66652b16811cccf3adf4 WatchSource:0}: Error finding container 44d5b18c0a7065bbc7daa6ca7b471209212333b258bd66652b16811cccf3adf4: Status 404 returned error can't find the container with id 44d5b18c0a7065bbc7daa6ca7b471209212333b258bd66652b16811cccf3adf4
Sep 15 19:05:44.906481 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.906453    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:05:44.906545 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.906535    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:05:44.906585 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:44.906565    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:05:45.253145 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.253108    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" event={"ID":"4e934e81-bb11-44aa-8e4f-7c88f83cd917","Type":"ContainerStarted","Data":"d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585"}
Sep 15 19:05:45.253577 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.253173    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" event={"ID":"4e934e81-bb11-44aa-8e4f-7c88f83cd917","Type":"ContainerStarted","Data":"44d5b18c0a7065bbc7daa6ca7b471209212333b258bd66652b16811cccf3adf4"}
Sep 15 19:05:45.257847 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.257824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:45.274238 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.274200    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" podStartSLOduration=1.2741862880000001 podStartE2EDuration="1.274186288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:05:45.272136595 +0000 UTC m=+920.220364924" watchObservedRunningTime="2026-09-15 19:05:45.274186288 +0000 UTC m=+920.222414671"
Sep 15 19:05:45.559205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.559129    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac6b04d-3574-4704-8774-94b9dc07a531" path="/var/lib/kubelet/pods/5ac6b04d-3574-4704-8774-94b9dc07a531/volumes"
Sep 15 19:05:45.559488 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.559476    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d3c89f-f47a-430f-801b-80e3d86d79de" path="/var/lib/kubelet/pods/87d3c89f-f47a-430f-801b-80e3d86d79de/volumes"
Sep 15 19:05:45.621675 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.621649    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:45.626712 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.626693    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:45.818766 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.818684    2572 patch_prober.go:28] interesting pod/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 19:05:45.818766 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:45.818741    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 19:05:46.132409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:46.132323    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:46.261503 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:46.261470    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:46.262467 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:46.262451    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:05:48.773046 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.773018    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:48.864127 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864060    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602d802b-0022-49b9-8d1f-6e1243a81674-istiod-ca-cert\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864127 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864113    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-envoy\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864288 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864134    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-certs\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864288 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864180    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-data\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864288 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864202    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602d802b-0022-49b9-8d1f-6e1243a81674-istio-podinfo\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864288 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864231    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-socket\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864288 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864281    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-istio-token\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864308    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm5gn\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-kube-api-access-cm5gn\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864341    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-credential-socket\") pod \"602d802b-0022-49b9-8d1f-6e1243a81674\" (UID: \"602d802b-0022-49b9-8d1f-6e1243a81674\") "
Sep 15 19:05:48.864526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864462    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:48.864526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864504    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-data" (OuterVolumeSpecName: "istio-data") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:48.864526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864515    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602d802b-0022-49b9-8d1f-6e1243a81674-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:05:48.864782 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864682    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:48.864782 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864717    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:48.864782 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864733    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/602d802b-0022-49b9-8d1f-6e1243a81674-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:48.864782 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864746    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:48.865039 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.864897    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:48.866311 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.866287    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/602d802b-0022-49b9-8d1f-6e1243a81674-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:05:48.866447 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.866426    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-kube-api-access-cm5gn" (OuterVolumeSpecName: "kube-api-access-cm5gn") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "kube-api-access-cm5gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:05:48.866743 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.866726    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:05:48.866819 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.866731    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-istio-token" (OuterVolumeSpecName: "istio-token") pod "602d802b-0022-49b9-8d1f-6e1243a81674" (UID: "602d802b-0022-49b9-8d1f-6e1243a81674"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:05:48.965544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.965508    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:48.965544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.965542    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/602d802b-0022-49b9-8d1f-6e1243a81674-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:48.965544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.965552    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:48.965719 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.965562    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:48.965719 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.965571    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm5gn\" (UniqueName: \"kubernetes.io/projected/602d802b-0022-49b9-8d1f-6e1243a81674-kube-api-access-cm5gn\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:48.965719 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:48.965580    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/602d802b-0022-49b9-8d1f-6e1243a81674-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:05:49.220774 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.220743    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:49.281338 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.281307    2572 generic.go:356] "Generic (PLEG): container finished" podID="602d802b-0022-49b9-8d1f-6e1243a81674" containerID="9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1" exitCode=0
Sep 15 19:05:49.281456 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.281366    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"
Sep 15 19:05:49.281456 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.281401    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" event={"ID":"602d802b-0022-49b9-8d1f-6e1243a81674","Type":"ContainerDied","Data":"9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1"}
Sep 15 19:05:49.281525 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.281467    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m" event={"ID":"602d802b-0022-49b9-8d1f-6e1243a81674","Type":"ContainerDied","Data":"43d4472758b427cda46bd443be2112710cf3fff02f015f9a6f09254d2a97b63d"}
Sep 15 19:05:49.281525 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.281498    2572 scope.go:117] "RemoveContainer" containerID="9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1"
Sep 15 19:05:49.292106 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.292088    2572 scope.go:117] "RemoveContainer" containerID="7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03"
Sep 15 19:05:49.300426 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.300407    2572 scope.go:117] "RemoveContainer" containerID="9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1"
Sep 15 19:05:49.300667 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:05:49.300644    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1\": container with ID starting with 9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1 not found: ID does not exist" containerID="9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1"
Sep 15 19:05:49.300749 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.300678    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1"} err="failed to get container status \"9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1\": rpc error: code = NotFound desc = could not find container \"9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1\": container with ID starting with 9df9a223fecf6b86925f4ad7a3f9d57e75c4b4e8ec0fabe46fec9a10f9db50a1 not found: ID does not exist"
Sep 15 19:05:49.300749 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.300703    2572 scope.go:117] "RemoveContainer" containerID="7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03"
Sep 15 19:05:49.301044 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:05:49.301016    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03\": container with ID starting with 7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03 not found: ID does not exist" containerID="7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03"
Sep 15 19:05:49.301147 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.301053    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03"} err="failed to get container status \"7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03\": rpc error: code = NotFound desc = could not find container \"7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03\": container with ID starting with 7e10a07368b377728c0f01ff8aedabee3584ea447f79b9196f8c7b2a8f523a03 not found: ID does not exist"
Sep 15 19:05:49.304488 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.304470    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"]
Sep 15 19:05:49.307079 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.307058    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:49.308244 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.308224    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-813c61ca-gw-openshift-default-85f5bcb5dd-rsk9m"]
Sep 15 19:05:49.558277 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.558219    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" path="/var/lib/kubelet/pods/602d802b-0022-49b9-8d1f-6e1243a81674/volumes"
Sep 15 19:05:49.871222 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.871149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:49.938130 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:49.938103    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:50.039078 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.039046    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:50.420494 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.420464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:50.518564 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.518536    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:05:50.564926 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.564896    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"]
Sep 15 19:05:50.565291 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.565280    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy"
Sep 15 19:05:50.565344 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.565293    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy"
Sep 15 19:05:50.565378 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.565365    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy"
Sep 15 19:05:50.569761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.569743    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:50.571840 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.571819    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e886bcb7\""
Sep 15 19:05:50.571938 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.571848    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e886bcb7-dockercfg-rdfmh\""
Sep 15 19:05:50.582892 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.581718    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"]
Sep 15 19:05:50.684284 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.684197    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6tnf\" (UniqueName: \"kubernetes.io/projected/06abe885-bad5-4893-949b-23ba575f3d68-kube-api-access-g6tnf\") pod \"payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f\" (UID: \"06abe885-bad5-4893-949b-23ba575f3d68\") " pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:50.684284 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.684258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06abe885-bad5-4893-949b-23ba575f3d68-plugins-config-volume\") pod \"payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f\" (UID: \"06abe885-bad5-4893-949b-23ba575f3d68\") " pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:50.785140 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.785105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6tnf\" (UniqueName: \"kubernetes.io/projected/06abe885-bad5-4893-949b-23ba575f3d68-kube-api-access-g6tnf\") pod \"payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f\" (UID: \"06abe885-bad5-4893-949b-23ba575f3d68\") " pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:50.785269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.785149    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06abe885-bad5-4893-949b-23ba575f3d68-plugins-config-volume\") pod \"payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f\" (UID: \"06abe885-bad5-4893-949b-23ba575f3d68\") " pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:50.785869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.785851    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06abe885-bad5-4893-949b-23ba575f3d68-plugins-config-volume\") pod \"payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f\" (UID: \"06abe885-bad5-4893-949b-23ba575f3d68\") " pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:50.792312 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.792291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6tnf\" (UniqueName: \"kubernetes.io/projected/06abe885-bad5-4893-949b-23ba575f3d68-kube-api-access-g6tnf\") pod \"payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f\" (UID: \"06abe885-bad5-4893-949b-23ba575f3d68\") " pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:50.886249 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:50.886221    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:51.156870 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:51.156843    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"]
Sep 15 19:05:51.158086 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:05:51.158057    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06abe885_bad5_4893_949b_23ba575f3d68.slice/crio-a3d049042f6e6e9dd720a5eecd559e3c38486d8febf2cbb680bdb2add9a1f003 WatchSource:0}: Error finding container a3d049042f6e6e9dd720a5eecd559e3c38486d8febf2cbb680bdb2add9a1f003: Status 404 returned error can't find the container with id a3d049042f6e6e9dd720a5eecd559e3c38486d8febf2cbb680bdb2add9a1f003
Sep 15 19:05:51.295866 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:51.295833    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f" event={"ID":"06abe885-bad5-4893-949b-23ba575f3d68","Type":"ContainerStarted","Data":"75826a2a5f34b4aedfb465e33dbd63c0dede2773ddbec86dd5a72cd56c36676f"}
Sep 15 19:05:51.296028 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:51.295890    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f" event={"ID":"06abe885-bad5-4893-949b-23ba575f3d68","Type":"ContainerStarted","Data":"a3d049042f6e6e9dd720a5eecd559e3c38486d8febf2cbb680bdb2add9a1f003"}
Sep 15 19:05:51.296028 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:51.295922    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:05:51.311071 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:05:51.311003    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f" podStartSLOduration=1.310989647 podStartE2EDuration="1.310989647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:05:51.310147558 +0000 UTC m=+926.258375897" watchObservedRunningTime="2026-09-15 19:05:51.310989647 +0000 UTC m=+926.259217974"
Sep 15 19:06:02.304194 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:02.304161    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:06:04.682464 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:04.682430    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:08.420719 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:08.420686    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:08.472642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:08.472606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:09.399477 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:09.399445    2572 generic.go:356] "Generic (PLEG): container finished" podID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerID="d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585" exitCode=0
Sep 15 19:06:09.399664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:09.399522    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" event={"ID":"4e934e81-bb11-44aa-8e4f-7c88f83cd917","Type":"ContainerDied","Data":"d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585"}
Sep 15 19:06:09.399904 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:09.399887    2572 scope.go:117] "RemoveContainer" containerID="d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585"
Sep 15 19:06:09.400893 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:09.400869    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:06:09.400950 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:09.400930    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:06:09.400989 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:09.400962    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:06:10.407725 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:10.407689    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" event={"ID":"4e934e81-bb11-44aa-8e4f-7c88f83cd917","Type":"ContainerStarted","Data":"b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf"}
Sep 15 19:06:10.621544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:10.621501    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:06:10.621796 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:10.621769    2572 patch_prober.go:28] interesting pod/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 19:06:10.621914 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:10.621848    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 19:06:11.621512 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:11.621452    2572 patch_prober.go:28] interesting pod/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 19:06:11.622061 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:11.621535    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 19:06:12.621982 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:12.621945    2572 patch_prober.go:28] interesting pod/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 19:06:12.622544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:12.622507    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 19:06:12.659314 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:12.659282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:13.364627 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:13.364599    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:13.621600 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:13.621511    2572 patch_prober.go:28] interesting pod/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 19:06:13.621875 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:13.621843    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 19:06:13.789089 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:13.789058    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:14.053184 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:14.053149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:14.621890 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:14.621847    2572 patch_prober.go:28] interesting pod/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 15 19:06:14.622087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:14.621942    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 15 19:06:14.662430 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:14.662398    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:15.297631 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:15.297596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:15.625859 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:15.625766    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:06:15.626143 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:15.626120    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:06:15.626655 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:15.626636    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:06:15.842297 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:15.842257    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:17.562963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.562935    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"]
Sep 15 19:06:17.563314 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.563306    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy"
Sep 15 19:06:17.563355 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.563317    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy"
Sep 15 19:06:17.563394 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.563390    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="602d802b-0022-49b9-8d1f-6e1243a81674" containerName="istio-proxy"
Sep 15 19:06:17.565515 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.565489    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"
Sep 15 19:06:17.567463 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.567444    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:06:17.572921 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.572900    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"]
Sep 15 19:06:17.614293 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.614266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16f9b344-8f08-47a6-aa88-e413088f3452-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq\" (UID: \"16f9b344-8f08-47a6-aa88-e413088f3452\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"
Sep 15 19:06:17.715166 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.715135    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16f9b344-8f08-47a6-aa88-e413088f3452-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq\" (UID: \"16f9b344-8f08-47a6-aa88-e413088f3452\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"
Sep 15 19:06:17.715690 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.715673    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16f9b344-8f08-47a6-aa88-e413088f3452-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq\" (UID: \"16f9b344-8f08-47a6-aa88-e413088f3452\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"
Sep 15 19:06:17.876515 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:17.876459    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"
Sep 15 19:06:18.142819 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:18.142778    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"]
Sep 15 19:06:18.144197 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:06:18.144162    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f9b344_8f08_47a6_aa88_e413088f3452.slice/crio-bc042c9dcde0111ab2d08eb81676fd98c1f703693909276d40f771e481623c90 WatchSource:0}: Error finding container bc042c9dcde0111ab2d08eb81676fd98c1f703693909276d40f771e481623c90: Status 404 returned error can't find the container with id bc042c9dcde0111ab2d08eb81676fd98c1f703693909276d40f771e481623c90
Sep 15 19:06:18.354150 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:18.354118    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:18.478982 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:18.478950    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq" event={"ID":"16f9b344-8f08-47a6-aa88-e413088f3452","Type":"ContainerStarted","Data":"fe6199426707f3bcd5438973c259737b07267bcc1aef9808841c3aff7a5ba2b7"}
Sep 15 19:06:18.479115 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:18.479005    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq" event={"ID":"16f9b344-8f08-47a6-aa88-e413088f3452","Type":"ContainerStarted","Data":"bc042c9dcde0111ab2d08eb81676fd98c1f703693909276d40f771e481623c90"}
Sep 15 19:06:18.501542 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:18.501491    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq" podStartSLOduration=1.501476789 podStartE2EDuration="1.501476789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:06:18.499149088 +0000 UTC m=+953.447377414" watchObservedRunningTime="2026-09-15 19:06:18.501476789 +0000 UTC m=+953.449705112"
Sep 15 19:06:18.962697 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:18.962665    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:19.083403 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:19.083335    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:19.486761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:19.486725    2572 generic.go:356] "Generic (PLEG): container finished" podID="16f9b344-8f08-47a6-aa88-e413088f3452" containerID="fe6199426707f3bcd5438973c259737b07267bcc1aef9808841c3aff7a5ba2b7" exitCode=0
Sep 15 19:06:19.486929 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:19.486827    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq" event={"ID":"16f9b344-8f08-47a6-aa88-e413088f3452","Type":"ContainerDied","Data":"fe6199426707f3bcd5438973c259737b07267bcc1aef9808841c3aff7a5ba2b7"}
Sep 15 19:06:19.728065 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:19.728024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:20.444860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:20.444830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:20.551379 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:20.551351    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:06:20.637896 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:20.637865    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"
Sep 15 19:06:20.740999 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:20.740935    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16f9b344-8f08-47a6-aa88-e413088f3452-maas-api-service-ca\") pod \"16f9b344-8f08-47a6-aa88-e413088f3452\" (UID: \"16f9b344-8f08-47a6-aa88-e413088f3452\") "
Sep 15 19:06:20.741219 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:20.741199    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16f9b344-8f08-47a6-aa88-e413088f3452-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "16f9b344-8f08-47a6-aa88-e413088f3452" (UID: "16f9b344-8f08-47a6-aa88-e413088f3452"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:06:20.842337 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:20.842310    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16f9b344-8f08-47a6-aa88-e413088f3452-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:21.072213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:21.072089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:21.500016 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:21.499990    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"
Sep 15 19:06:21.500016 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:21.500005    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq" event={"ID":"16f9b344-8f08-47a6-aa88-e413088f3452","Type":"ContainerDied","Data":"bc042c9dcde0111ab2d08eb81676fd98c1f703693909276d40f771e481623c90"}
Sep 15 19:06:21.500429 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:21.500051    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc042c9dcde0111ab2d08eb81676fd98c1f703693909276d40f771e481623c90"
Sep 15 19:06:21.552326 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:21.552306    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:06:21.805483 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:21.805402    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:28.389765 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.389726    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:28.418168 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.418128    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"]
Sep 15 19:06:28.418377 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.418344    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f" podUID="06abe885-bad5-4893-949b-23ba575f3d68" containerName="payload-processing" containerID="cri-o://75826a2a5f34b4aedfb465e33dbd63c0dede2773ddbec86dd5a72cd56c36676f" gracePeriod=30
Sep 15 19:06:28.490424 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.490382    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:28.545997 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.545926    2572 generic.go:356] "Generic (PLEG): container finished" podID="06abe885-bad5-4893-949b-23ba575f3d68" containerID="75826a2a5f34b4aedfb465e33dbd63c0dede2773ddbec86dd5a72cd56c36676f" exitCode=0
Sep 15 19:06:28.546199 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.546058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f" event={"ID":"06abe885-bad5-4893-949b-23ba575f3d68","Type":"ContainerDied","Data":"75826a2a5f34b4aedfb465e33dbd63c0dede2773ddbec86dd5a72cd56c36676f"}
Sep 15 19:06:28.580949 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.580913    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"]
Sep 15 19:06:28.583226 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.583199    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:28.587816 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.587780    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e886bcb7-kfkkq"]
Sep 15 19:06:28.651460 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.651432    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:28.670702 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.670677    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:06:28.814871 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.814839    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06abe885-bad5-4893-949b-23ba575f3d68-plugins-config-volume\") pod \"06abe885-bad5-4893-949b-23ba575f3d68\" (UID: \"06abe885-bad5-4893-949b-23ba575f3d68\") "
Sep 15 19:06:28.815038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.814913    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6tnf\" (UniqueName: \"kubernetes.io/projected/06abe885-bad5-4893-949b-23ba575f3d68-kube-api-access-g6tnf\") pod \"06abe885-bad5-4893-949b-23ba575f3d68\" (UID: \"06abe885-bad5-4893-949b-23ba575f3d68\") "
Sep 15 19:06:28.815195 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.815173    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06abe885-bad5-4893-949b-23ba575f3d68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06abe885-bad5-4893-949b-23ba575f3d68" (UID: "06abe885-bad5-4893-949b-23ba575f3d68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:06:28.815280 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.815264    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06abe885-bad5-4893-949b-23ba575f3d68-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:28.816944 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.816923    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06abe885-bad5-4893-949b-23ba575f3d68-kube-api-access-g6tnf" (OuterVolumeSpecName: "kube-api-access-g6tnf") pod "06abe885-bad5-4893-949b-23ba575f3d68" (UID: "06abe885-bad5-4893-949b-23ba575f3d68"). InnerVolumeSpecName "kube-api-access-g6tnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:06:28.916028 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:28.915999    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6tnf\" (UniqueName: \"kubernetes.io/projected/06abe885-bad5-4893-949b-23ba575f3d68-kube-api-access-g6tnf\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:29.049060 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.049024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:29.554282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.554250    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"
Sep 15 19:06:29.559522 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.559490    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16f9b344-8f08-47a6-aa88-e413088f3452" path="/var/lib/kubelet/pods/16f9b344-8f08-47a6-aa88-e413088f3452/volumes"
Sep 15 19:06:29.559988 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.559965    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f" event={"ID":"06abe885-bad5-4893-949b-23ba575f3d68","Type":"ContainerDied","Data":"a3d049042f6e6e9dd720a5eecd559e3c38486d8febf2cbb680bdb2add9a1f003"}
Sep 15 19:06:29.560099 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.560019    2572 scope.go:117] "RemoveContainer" containerID="75826a2a5f34b4aedfb465e33dbd63c0dede2773ddbec86dd5a72cd56c36676f"
Sep 15 19:06:29.580376 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.580353    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"]
Sep 15 19:06:29.583663 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.583642    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e886bcb7-5b6c5d9b45-k926f"]
Sep 15 19:06:29.754633 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.754595    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"]
Sep 15 19:06:29.754893 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.754866    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy" containerID="cri-o://b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf" gracePeriod=30
Sep 15 19:06:29.768097 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.768068    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:29.869081 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:29.868978    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:30.223438 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.223403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:30.507842 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.507739    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"]
Sep 15 19:06:30.508202 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.508183    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06abe885-bad5-4893-949b-23ba575f3d68" containerName="payload-processing"
Sep 15 19:06:30.508202 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.508199    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="06abe885-bad5-4893-949b-23ba575f3d68" containerName="payload-processing"
Sep 15 19:06:30.508356 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.508212    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16f9b344-8f08-47a6-aa88-e413088f3452" containerName="revoke-keys"
Sep 15 19:06:30.508356 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.508219    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="16f9b344-8f08-47a6-aa88-e413088f3452" containerName="revoke-keys"
Sep 15 19:06:30.508356 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.508295    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="16f9b344-8f08-47a6-aa88-e413088f3452" containerName="revoke-keys"
Sep 15 19:06:30.508356 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.508305    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="06abe885-bad5-4893-949b-23ba575f3d68" containerName="payload-processing"
Sep 15 19:06:30.511433 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.511412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.513626 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.513606    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b6741af4-openshift-default-dockercfg-r94q9\""
Sep 15 19:06:30.523599 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.523573    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"]
Sep 15 19:06:30.535918 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.535894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:30.628329 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.628301    2572 patch_prober.go:28] interesting pod/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 15 19:06:30.628654 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.628351    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 19:06:30.632642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.632617    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:30.632942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.632922    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-certs\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.633004 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.632951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-envoy\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.633004 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.632977    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdrnc\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-kube-api-access-sdrnc\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.633078 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.633050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4892787-9b3a-4314-b7cb-792154043ff8-istiod-ca-cert\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.633113 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.633089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-data\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.633113 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.633108    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4892787-9b3a-4314-b7cb-792154043ff8-istio-podinfo\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.633182 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.633140    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-credential-socket\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.633230 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.633182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-istio-token\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.633230 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.633205    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-socket\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.733788 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.733754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-credential-socket\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.733960 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.733787    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:30.733960 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.733859    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-istio-token\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.733960 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.733917    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-socket\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734118 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.733980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-certs\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734118 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-envoy\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734118 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdrnc\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-kube-api-access-sdrnc\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734118 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4892787-9b3a-4314-b7cb-792154043ff8-istiod-ca-cert\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734395 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-data\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734395 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734159    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-credential-socket\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734395 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734216    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4892787-9b3a-4314-b7cb-792154043ff8-istio-podinfo\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734395 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734227    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-socket\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734395 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734347    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-certs\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.734565 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734483    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-data\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.742194 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.734795    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4892787-9b3a-4314-b7cb-792154043ff8-istiod-ca-cert\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.742635 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.742610    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-envoy\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.742846 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.742824    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4892787-9b3a-4314-b7cb-792154043ff8-istio-podinfo\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.744844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.744824    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-istio-token\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.744941 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.744914    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdrnc\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-kube-api-access-sdrnc\") pod \"e2e-derive-b6741af4-openshift-default-f4c9fb88-796br\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") " pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:30.823642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:30.823573    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:31.097573 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.097542    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"]
Sep 15 19:06:31.099396 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:06:31.099367    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4892787_9b3a_4314_b7cb_792154043ff8.slice/crio-4283ba51ffce68c05a6b6de7a1eb4cb2c290796ba2884987520602c402f697d7 WatchSource:0}: Error finding container 4283ba51ffce68c05a6b6de7a1eb4cb2c290796ba2884987520602c402f697d7: Status 404 returned error can't find the container with id 4283ba51ffce68c05a6b6de7a1eb4cb2c290796ba2884987520602c402f697d7
Sep 15 19:06:31.102074 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.102032    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:06:31.102147 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.102113    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:06:31.102191 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.102153    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:06:31.352677 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.352584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:31.558633 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.558603    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06abe885-bad5-4893-949b-23ba575f3d68" path="/var/lib/kubelet/pods/06abe885-bad5-4893-949b-23ba575f3d68/volumes"
Sep 15 19:06:31.567739 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.567708    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" event={"ID":"f4892787-9b3a-4314-b7cb-792154043ff8","Type":"ContainerStarted","Data":"6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7"}
Sep 15 19:06:31.567895 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.567756    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" event={"ID":"f4892787-9b3a-4314-b7cb-792154043ff8","Type":"ContainerStarted","Data":"4283ba51ffce68c05a6b6de7a1eb4cb2c290796ba2884987520602c402f697d7"}
Sep 15 19:06:31.585868 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.585799    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" podStartSLOduration=1.58578463 podStartE2EDuration="1.58578463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:06:31.584508763 +0000 UTC m=+966.532737092" watchObservedRunningTime="2026-09-15 19:06:31.58578463 +0000 UTC m=+966.534012956"
Sep 15 19:06:31.824635 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.824598    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:31.889639 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:31.889604    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:32.599283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:32.599249    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:32.829198 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:32.829170    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:32.930269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:32.930232    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:33.021991 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:33.021952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:33.463228 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:33.463191    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:33.580075 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:33.580046    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:33.581072 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:33.581054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:06:34.085312 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:34.085278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:34.972921 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:34.972884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:35.000127 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.000103    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:06:35.078268 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078181    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kd79\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-kube-api-access-6kd79\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078268 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078240    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-token\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078499 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078275    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-data\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078499 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078299    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-socket\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078499 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078339    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istiod-ca-cert\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078499 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078389    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-credential-socket\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078499 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078435    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-certs\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078763 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-envoy\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078763 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078529    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-podinfo\") pod \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\" (UID: \"4e934e81-bb11-44aa-8e4f-7c88f83cd917\") "
Sep 15 19:06:35.078763 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078589    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:06:35.078763 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078623    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:06:35.078763 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078688    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:06:35.078763 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078752    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:06:35.079111 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078918    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.079111 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078935    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.079111 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078955    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.079111 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.078971    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.079111 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.079065    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:06:35.080647 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.080624    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-kube-api-access-6kd79" (OuterVolumeSpecName: "kube-api-access-6kd79") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "kube-api-access-6kd79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:06:35.080647 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.080645    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:06:35.080825 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.080654    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:06:35.080825 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.080659    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e934e81-bb11-44aa-8e4f-7c88f83cd917" (UID: "4e934e81-bb11-44aa-8e4f-7c88f83cd917"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:06:35.180250 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.180219    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.180250 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.180246    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.180250 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.180255    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kd79\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-kube-api-access-6kd79\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.180713 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.180263    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.180713 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.180272    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e934e81-bb11-44aa-8e4f-7c88f83cd917-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:06:35.592192 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.592154    2572 generic.go:356] "Generic (PLEG): container finished" podID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerID="b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf" exitCode=0
Sep 15 19:06:35.592361 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.592217    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"
Sep 15 19:06:35.592361 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.592218    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" event={"ID":"4e934e81-bb11-44aa-8e4f-7c88f83cd917","Type":"ContainerDied","Data":"b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf"}
Sep 15 19:06:35.592361 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.592275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz" event={"ID":"4e934e81-bb11-44aa-8e4f-7c88f83cd917","Type":"ContainerDied","Data":"44d5b18c0a7065bbc7daa6ca7b471209212333b258bd66652b16811cccf3adf4"}
Sep 15 19:06:35.592361 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.592305    2572 scope.go:117] "RemoveContainer" containerID="b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf"
Sep 15 19:06:35.592605 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.592490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:35.601873 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.601855    2572 scope.go:117] "RemoveContainer" containerID="d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585"
Sep 15 19:06:35.610739 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.610713    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"]
Sep 15 19:06:35.611472 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.611457    2572 scope.go:117] "RemoveContainer" containerID="b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf"
Sep 15 19:06:35.611789 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:06:35.611769    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf\": container with ID starting with b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf not found: ID does not exist" containerID="b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf"
Sep 15 19:06:35.611876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.611799    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf"} err="failed to get container status \"b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf\": rpc error: code = NotFound desc = could not find container \"b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf\": container with ID starting with b62d2ef847426dbcc3a19f28b6552807dbf50b60cc7f461d184deed723e4ddaf not found: ID does not exist"
Sep 15 19:06:35.611876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.611836    2572 scope.go:117] "RemoveContainer" containerID="d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585"
Sep 15 19:06:35.612078 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:06:35.612064    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585\": container with ID starting with d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585 not found: ID does not exist" containerID="d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585"
Sep 15 19:06:35.612120 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.612083    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585"} err="failed to get container status \"d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585\": rpc error: code = NotFound desc = could not find container \"d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585\": container with ID starting with d40db647f27935a97940a948d3ce3db74ff7427e6e67a410882306882f43d585 not found: ID does not exist"
Sep 15 19:06:35.616215 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:35.616190    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e886bcb7-openshift-default-7f9995d54b-xcdzz"]
Sep 15 19:06:36.270156 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.270123    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:36.329609 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.329580    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:36.495345 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.495297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:36.775881 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.775851    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:36.879547 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.879516    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:36.889154 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.889125    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"]
Sep 15 19:06:36.889548 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.889534    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy"
Sep 15 19:06:36.889596 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.889553    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy"
Sep 15 19:06:36.889596 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.889572    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy"
Sep 15 19:06:36.889596 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.889578    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy"
Sep 15 19:06:36.889691 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.889656    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy"
Sep 15 19:06:36.889691 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.889664    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" containerName="istio-proxy"
Sep 15 19:06:36.892380 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.892363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:36.894496 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.894473    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b6741af4\""
Sep 15 19:06:36.894600 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.894563    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-b6741af4-dockercfg-xnf9j\""
Sep 15 19:06:36.903641 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.903615    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"]
Sep 15 19:06:36.917200 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.917174    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"]
Sep 15 19:06:36.919546 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.919531    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:36.931856 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.931835    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"]
Sep 15 19:06:36.997728 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.997685    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fca6880-aeb1-4430-8703-02a1604e54be-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s\" (UID: \"1fca6880-aeb1-4430-8703-02a1604e54be\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:36.997943 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.997827    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghg2k\" (UniqueName: \"kubernetes.io/projected/1fca6880-aeb1-4430-8703-02a1604e54be-kube-api-access-ghg2k\") pod \"payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s\" (UID: \"1fca6880-aeb1-4430-8703-02a1604e54be\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:36.997943 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.997911    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxngj\" (UniqueName: \"kubernetes.io/projected/427529d2-9f39-4a86-9fab-ab7aab40b6ad-kube-api-access-lxngj\") pod \"payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq\" (UID: \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\") " pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:36.997943 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:36.997946    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427529d2-9f39-4a86-9fab-ab7aab40b6ad-plugins-config-volume\") pod \"payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq\" (UID: \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\") " pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:37.098976 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.098876    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fca6880-aeb1-4430-8703-02a1604e54be-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s\" (UID: \"1fca6880-aeb1-4430-8703-02a1604e54be\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:37.098976 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.098944    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghg2k\" (UniqueName: \"kubernetes.io/projected/1fca6880-aeb1-4430-8703-02a1604e54be-kube-api-access-ghg2k\") pod \"payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s\" (UID: \"1fca6880-aeb1-4430-8703-02a1604e54be\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:37.099205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.098998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxngj\" (UniqueName: \"kubernetes.io/projected/427529d2-9f39-4a86-9fab-ab7aab40b6ad-kube-api-access-lxngj\") pod \"payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq\" (UID: \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\") " pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:37.099205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.099030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427529d2-9f39-4a86-9fab-ab7aab40b6ad-plugins-config-volume\") pod \"payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq\" (UID: \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\") " pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:37.099580 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.099558    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fca6880-aeb1-4430-8703-02a1604e54be-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s\" (UID: \"1fca6880-aeb1-4430-8703-02a1604e54be\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:37.099695 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.099677    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427529d2-9f39-4a86-9fab-ab7aab40b6ad-plugins-config-volume\") pod \"payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq\" (UID: \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\") " pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:37.106437 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.106413    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghg2k\" (UniqueName: \"kubernetes.io/projected/1fca6880-aeb1-4430-8703-02a1604e54be-kube-api-access-ghg2k\") pod \"payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s\" (UID: \"1fca6880-aeb1-4430-8703-02a1604e54be\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:37.106532 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.106455    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxngj\" (UniqueName: \"kubernetes.io/projected/427529d2-9f39-4a86-9fab-ab7aab40b6ad-kube-api-access-lxngj\") pod \"payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq\" (UID: \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\") " pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:37.202896 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.202868    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:37.230818 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.230780    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:37.474409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.474384    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"]
Sep 15 19:06:37.475418 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:06:37.475390    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fca6880_aeb1_4430_8703_02a1604e54be.slice/crio-81f2720a7799af7e9a69a62e6a9dba82f1aa25d84e047ce6853b66764b2a72e5 WatchSource:0}: Error finding container 81f2720a7799af7e9a69a62e6a9dba82f1aa25d84e047ce6853b66764b2a72e5: Status 404 returned error can't find the container with id 81f2720a7799af7e9a69a62e6a9dba82f1aa25d84e047ce6853b66764b2a72e5
Sep 15 19:06:37.507583 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.507561    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"]
Sep 15 19:06:37.509934 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:06:37.509906    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427529d2_9f39_4a86_9fab_ab7aab40b6ad.slice/crio-de5ff88c0fbacb1f1189028150fec86a12a25e7ae3c3f7dc6d38f297d44a92fa WatchSource:0}: Error finding container de5ff88c0fbacb1f1189028150fec86a12a25e7ae3c3f7dc6d38f297d44a92fa: Status 404 returned error can't find the container with id de5ff88c0fbacb1f1189028150fec86a12a25e7ae3c3f7dc6d38f297d44a92fa
Sep 15 19:06:37.560142 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.560122    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e934e81-bb11-44aa-8e4f-7c88f83cd917" path="/var/lib/kubelet/pods/4e934e81-bb11-44aa-8e4f-7c88f83cd917/volumes"
Sep 15 19:06:37.606774 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.606743    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq" event={"ID":"427529d2-9f39-4a86-9fab-ab7aab40b6ad","Type":"ContainerStarted","Data":"f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa"}
Sep 15 19:06:37.606933 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.606819    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq" event={"ID":"427529d2-9f39-4a86-9fab-ab7aab40b6ad","Type":"ContainerStarted","Data":"de5ff88c0fbacb1f1189028150fec86a12a25e7ae3c3f7dc6d38f297d44a92fa"}
Sep 15 19:06:37.606933 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.606853    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:37.608613 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.608587    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s" event={"ID":"1fca6880-aeb1-4430-8703-02a1604e54be","Type":"ContainerStarted","Data":"af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01"}
Sep 15 19:06:37.608729 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.608629    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s" event={"ID":"1fca6880-aeb1-4430-8703-02a1604e54be","Type":"ContainerStarted","Data":"81f2720a7799af7e9a69a62e6a9dba82f1aa25d84e047ce6853b66764b2a72e5"}
Sep 15 19:06:37.608729 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.608683    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:37.622630 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.622577    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq" podStartSLOduration=1.6225568639999999 podStartE2EDuration="1.622556864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:06:37.621097873 +0000 UTC m=+972.569326199" watchObservedRunningTime="2026-09-15 19:06:37.622556864 +0000 UTC m=+972.570785193"
Sep 15 19:06:37.637454 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:37.637398    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s" podStartSLOduration=1.63738329 podStartE2EDuration="1.63738329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:06:37.635501387 +0000 UTC m=+972.583729714" watchObservedRunningTime="2026-09-15 19:06:37.63738329 +0000 UTC m=+972.585611616"
Sep 15 19:06:48.616606 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:48.616516    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:06:48.616606 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:48.616598    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:06:49.450348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:49.450277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:57.826553 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:57.826517    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"]
Sep 15 19:06:57.829192 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:57.829170    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"
Sep 15 19:06:57.831584 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:57.831559    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:06:57.837707 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:57.837258    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"]
Sep 15 19:06:57.890966 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:57.890919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74a0db32-21e7-4a8c-b798-3282a5d161d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq\" (UID: \"74a0db32-21e7-4a8c-b798-3282a5d161d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"
Sep 15 19:06:57.991403 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:57.991361    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74a0db32-21e7-4a8c-b798-3282a5d161d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq\" (UID: \"74a0db32-21e7-4a8c-b798-3282a5d161d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"
Sep 15 19:06:57.992019 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:57.992001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74a0db32-21e7-4a8c-b798-3282a5d161d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq\" (UID: \"74a0db32-21e7-4a8c-b798-3282a5d161d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"
Sep 15 19:06:58.142522 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:58.142436    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"
Sep 15 19:06:58.277480 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:58.277448    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:58.414592 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:58.414563    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"]
Sep 15 19:06:58.416673 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:06:58.416643    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a0db32_21e7_4a8c_b798_3282a5d161d4.slice/crio-177bec75fb5f6097ad59ddb1e2fc48f8ea6ac5f59c5d373dc1418dabb3c153ab WatchSource:0}: Error finding container 177bec75fb5f6097ad59ddb1e2fc48f8ea6ac5f59c5d373dc1418dabb3c153ab: Status 404 returned error can't find the container with id 177bec75fb5f6097ad59ddb1e2fc48f8ea6ac5f59c5d373dc1418dabb3c153ab
Sep 15 19:06:58.745729 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:58.745689    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq" event={"ID":"74a0db32-21e7-4a8c-b798-3282a5d161d4","Type":"ContainerStarted","Data":"f522b189f2d05183f6437aa2ada39846b906b73adb755249efa22a25743f82b3"}
Sep 15 19:06:58.745941 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:58.745765    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq" event={"ID":"74a0db32-21e7-4a8c-b798-3282a5d161d4","Type":"ContainerStarted","Data":"177bec75fb5f6097ad59ddb1e2fc48f8ea6ac5f59c5d373dc1418dabb3c153ab"}
Sep 15 19:06:58.766339 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:58.766278    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq" podStartSLOduration=1.766260359 podStartE2EDuration="1.766260359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:06:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:06:58.762331456 +0000 UTC m=+993.710559782" watchObservedRunningTime="2026-09-15 19:06:58.766260359 +0000 UTC m=+993.714488685"
Sep 15 19:06:59.064787 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:59.064704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:59.723133 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:59.723093    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:06:59.754161 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:59.754132    2572 generic.go:356] "Generic (PLEG): container finished" podID="74a0db32-21e7-4a8c-b798-3282a5d161d4" containerID="f522b189f2d05183f6437aa2ada39846b906b73adb755249efa22a25743f82b3" exitCode=0
Sep 15 19:06:59.754311 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:06:59.754218    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq" event={"ID":"74a0db32-21e7-4a8c-b798-3282a5d161d4","Type":"ContainerDied","Data":"f522b189f2d05183f6437aa2ada39846b906b73adb755249efa22a25743f82b3"}
Sep 15 19:07:00.387037 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:00.386983    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:00.959151 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:00.959130    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"
Sep 15 19:07:01.021883 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.021773    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74a0db32-21e7-4a8c-b798-3282a5d161d4-maas-api-service-ca\") pod \"74a0db32-21e7-4a8c-b798-3282a5d161d4\" (UID: \"74a0db32-21e7-4a8c-b798-3282a5d161d4\") "
Sep 15 19:07:01.022092 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.022068    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74a0db32-21e7-4a8c-b798-3282a5d161d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74a0db32-21e7-4a8c-b798-3282a5d161d4" (UID: "74a0db32-21e7-4a8c-b798-3282a5d161d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:07:01.123123 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.123100    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74a0db32-21e7-4a8c-b798-3282a5d161d4-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:01.769223 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.769188    2572 generic.go:356] "Generic (PLEG): container finished" podID="f4892787-9b3a-4314-b7cb-792154043ff8" containerID="6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7" exitCode=0
Sep 15 19:07:01.769593 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.769257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" event={"ID":"f4892787-9b3a-4314-b7cb-792154043ff8","Type":"ContainerDied","Data":"6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7"}
Sep 15 19:07:01.769727 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.769711    2572 scope.go:117] "RemoveContainer" containerID="6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7"
Sep 15 19:07:01.770747 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.770728    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"
Sep 15 19:07:01.770893 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.770746    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq" event={"ID":"74a0db32-21e7-4a8c-b798-3282a5d161d4","Type":"ContainerDied","Data":"177bec75fb5f6097ad59ddb1e2fc48f8ea6ac5f59c5d373dc1418dabb3c153ab"}
Sep 15 19:07:01.770893 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.770781    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="177bec75fb5f6097ad59ddb1e2fc48f8ea6ac5f59c5d373dc1418dabb3c153ab"
Sep 15 19:07:01.770987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.770952    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:07:01.771050 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.771030    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:07:01.771097 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:01.771084    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:07:02.778637 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:02.778605    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" event={"ID":"f4892787-9b3a-4314-b7cb-792154043ff8","Type":"ContainerStarted","Data":"1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753"}
Sep 15 19:07:02.825083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:02.825031    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:07:02.825711 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:02.825675    2572 patch_prober.go:28] interesting pod/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 19:07:02.825870 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:02.825735    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 19:07:03.313098 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:03.313050    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:03.373224 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:03.373193    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:03.580124 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:03.580030    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:07:03.824294 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:03.824254    2572 patch_prober.go:28] interesting pod/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 19:07:03.824742 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:03.824318    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 19:07:04.745974 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.745935    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:04.772358 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.772321    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"]
Sep 15 19:07:04.772602 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.772556    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq" podUID="427529d2-9f39-4a86-9fab-ab7aab40b6ad" containerName="payload-processing" containerID="cri-o://f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa" gracePeriod=30
Sep 15 19:07:04.777732 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.777332    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"]
Sep 15 19:07:04.777732 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.777546    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s" podUID="1fca6880-aeb1-4430-8703-02a1604e54be" containerName="payload-pre-processing" containerID="cri-o://af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01" gracePeriod=30
Sep 15 19:07:04.841680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.840996    2572 patch_prober.go:28] interesting pod/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 15 19:07:04.841680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.841048    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 15 19:07:04.841680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.841355    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:04.936318 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.936245    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"]
Sep 15 19:07:04.940469 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.940403    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b6741af4-9qwgq"]
Sep 15 19:07:04.953344 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:04.953313    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:05.056769 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.056636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:05.070067 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.069981    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"]
Sep 15 19:07:05.082824 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.081677    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:07:05.122360 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.122216    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:05.166650 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.166623    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427529d2-9f39-4a86-9fab-ab7aab40b6ad-plugins-config-volume\") pod \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\" (UID: \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\") "
Sep 15 19:07:05.166794 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.166746    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxngj\" (UniqueName: \"kubernetes.io/projected/427529d2-9f39-4a86-9fab-ab7aab40b6ad-kube-api-access-lxngj\") pod \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\" (UID: \"427529d2-9f39-4a86-9fab-ab7aab40b6ad\") "
Sep 15 19:07:05.167093 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.167060    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/427529d2-9f39-4a86-9fab-ab7aab40b6ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "427529d2-9f39-4a86-9fab-ab7aab40b6ad" (UID: "427529d2-9f39-4a86-9fab-ab7aab40b6ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:07:05.169022 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.168992    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/427529d2-9f39-4a86-9fab-ab7aab40b6ad-kube-api-access-lxngj" (OuterVolumeSpecName: "kube-api-access-lxngj") pod "427529d2-9f39-4a86-9fab-ab7aab40b6ad" (UID: "427529d2-9f39-4a86-9fab-ab7aab40b6ad"). InnerVolumeSpecName "kube-api-access-lxngj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:07:05.182565 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.182544    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:07:05.263473 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.263437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:05.267500 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.267478    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fca6880-aeb1-4430-8703-02a1604e54be-plugins-config-volume\") pod \"1fca6880-aeb1-4430-8703-02a1604e54be\" (UID: \"1fca6880-aeb1-4430-8703-02a1604e54be\") "
Sep 15 19:07:05.267578 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.267512    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghg2k\" (UniqueName: \"kubernetes.io/projected/1fca6880-aeb1-4430-8703-02a1604e54be-kube-api-access-ghg2k\") pod \"1fca6880-aeb1-4430-8703-02a1604e54be\" (UID: \"1fca6880-aeb1-4430-8703-02a1604e54be\") "
Sep 15 19:07:05.267885 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.267862    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fca6880-aeb1-4430-8703-02a1604e54be-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fca6880-aeb1-4430-8703-02a1604e54be" (UID: "1fca6880-aeb1-4430-8703-02a1604e54be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:07:05.267962 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.267945    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxngj\" (UniqueName: \"kubernetes.io/projected/427529d2-9f39-4a86-9fab-ab7aab40b6ad-kube-api-access-lxngj\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:05.268002 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.267965    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427529d2-9f39-4a86-9fab-ab7aab40b6ad-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:05.269698 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.269678    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fca6880-aeb1-4430-8703-02a1604e54be-kube-api-access-ghg2k" (OuterVolumeSpecName: "kube-api-access-ghg2k") pod "1fca6880-aeb1-4430-8703-02a1604e54be" (UID: "1fca6880-aeb1-4430-8703-02a1604e54be"). InnerVolumeSpecName "kube-api-access-ghg2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:07:05.368634 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.368544    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fca6880-aeb1-4430-8703-02a1604e54be-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:05.368634 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.368576    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghg2k\" (UniqueName: \"kubernetes.io/projected/1fca6880-aeb1-4430-8703-02a1604e54be-kube-api-access-ghg2k\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:05.558622 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.558589    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74a0db32-21e7-4a8c-b798-3282a5d161d4" path="/var/lib/kubelet/pods/74a0db32-21e7-4a8c-b798-3282a5d161d4/volumes"
Sep 15 19:07:05.760255 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.760220    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:05.799515 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.799484    2572 generic.go:356] "Generic (PLEG): container finished" podID="427529d2-9f39-4a86-9fab-ab7aab40b6ad" containerID="f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa" exitCode=0
Sep 15 19:07:05.799664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.799523    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"
Sep 15 19:07:05.799664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.799539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq" event={"ID":"427529d2-9f39-4a86-9fab-ab7aab40b6ad","Type":"ContainerDied","Data":"f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa"}
Sep 15 19:07:05.799664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.799592    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq" event={"ID":"427529d2-9f39-4a86-9fab-ab7aab40b6ad","Type":"ContainerDied","Data":"de5ff88c0fbacb1f1189028150fec86a12a25e7ae3c3f7dc6d38f297d44a92fa"}
Sep 15 19:07:05.799664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.799624    2572 scope.go:117] "RemoveContainer" containerID="f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa"
Sep 15 19:07:05.801676 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.801282    2572 generic.go:356] "Generic (PLEG): container finished" podID="1fca6880-aeb1-4430-8703-02a1604e54be" containerID="af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01" exitCode=0
Sep 15 19:07:05.801676 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.801327    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"
Sep 15 19:07:05.801676 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.801342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s" event={"ID":"1fca6880-aeb1-4430-8703-02a1604e54be","Type":"ContainerDied","Data":"af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01"}
Sep 15 19:07:05.801676 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.801392    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s" event={"ID":"1fca6880-aeb1-4430-8703-02a1604e54be","Type":"ContainerDied","Data":"81f2720a7799af7e9a69a62e6a9dba82f1aa25d84e047ce6853b66764b2a72e5"}
Sep 15 19:07:05.802122 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.801924    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy" containerID="cri-o://1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753" gracePeriod=30
Sep 15 19:07:05.835066 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.835031    2572 scope.go:117] "RemoveContainer" containerID="f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa"
Sep 15 19:07:05.835610 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:07:05.835575    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa\": container with ID starting with f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa not found: ID does not exist" containerID="f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa"
Sep 15 19:07:05.835743 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.835621    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa"} err="failed to get container status \"f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa\": rpc error: code = NotFound desc = could not find container \"f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa\": container with ID starting with f6c90c64a341200a631f3067803927c69f97e443ab4597884981ea2ecf4225fa not found: ID does not exist"
Sep 15 19:07:05.835743 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.835648    2572 scope.go:117] "RemoveContainer" containerID="af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01"
Sep 15 19:07:05.836347 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.836320    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:05.852300 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.852276    2572 scope.go:117] "RemoveContainer" containerID="af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01"
Sep 15 19:07:05.852597 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:07:05.852560    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01\": container with ID starting with af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01 not found: ID does not exist" containerID="af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01"
Sep 15 19:07:05.852597 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.852587    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01"} err="failed to get container status \"af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01\": rpc error: code = NotFound desc = could not find container \"af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01\": container with ID starting with af9aeb6b2dc54d8fc3aba484296f5fc6832b2da1dc7a17c3e26ee2a348296e01 not found: ID does not exist"
Sep 15 19:07:05.854383 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.854362    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"]
Sep 15 19:07:05.858945 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.858925    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b6741af4-f49f6f6b5-phwfq"]
Sep 15 19:07:05.870879 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.870855    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"]
Sep 15 19:07:05.878077 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.878057    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b6741af4-d5bc899bb-kmj6s"]
Sep 15 19:07:05.920834 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:05.920788    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:06.683386 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:06.683331    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:07.333482 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:07.333448    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:07.416407 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:07.416374    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:07.558577 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:07.558543    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fca6880-aeb1-4430-8703-02a1604e54be" path="/var/lib/kubelet/pods/1fca6880-aeb1-4430-8703-02a1604e54be/volumes"
Sep 15 19:07:07.558949 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:07.558935    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427529d2-9f39-4a86-9fab-ab7aab40b6ad" path="/var/lib/kubelet/pods/427529d2-9f39-4a86-9fab-ab7aab40b6ad/volumes"
Sep 15 19:07:08.041234 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:08.041197    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:13.117746 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.117710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:13.182520 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.182487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:13.255864 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.255826    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:13.350899 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.350870    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:07:13.353697 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.353672    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:13.435501 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435474    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-socket\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.435659 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435515    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-istio-token\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.435659 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435568    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-envoy\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.435659 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435640    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4892787-9b3a-4314-b7cb-792154043ff8-istio-podinfo\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.435848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435673    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4892787-9b3a-4314-b7cb-792154043ff8-istiod-ca-cert\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.435848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435712    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdrnc\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-kube-api-access-sdrnc\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.435848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435709    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:07:13.435848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435738    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-data\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.435848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435799    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-certs\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.436102 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435866    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-credential-socket\") pod \"f4892787-9b3a-4314-b7cb-792154043ff8\" (UID: \"f4892787-9b3a-4314-b7cb-792154043ff8\") "
Sep 15 19:07:13.436102 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.435997    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:07:13.436206 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.436119    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:07:13.436206 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.436123    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4892787-9b3a-4314-b7cb-792154043ff8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:07:13.436206 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.436169    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.436206 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.436188    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.436425 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.436210    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:07:13.437741 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.437716    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:07:13.437854 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.437831    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4892787-9b3a-4314-b7cb-792154043ff8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:07:13.438056 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.438037    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:07:13.438201 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.438182    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-kube-api-access-sdrnc" (OuterVolumeSpecName: "kube-api-access-sdrnc") pod "f4892787-9b3a-4314-b7cb-792154043ff8" (UID: "f4892787-9b3a-4314-b7cb-792154043ff8"). InnerVolumeSpecName "kube-api-access-sdrnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:07:13.455040 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.455017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:13.537478 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.537455    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.537478 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.537476    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.537607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.537486    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.537607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.537496    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4892787-9b3a-4314-b7cb-792154043ff8-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.537607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.537504    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4892787-9b3a-4314-b7cb-792154043ff8-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.537607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.537511    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4892787-9b3a-4314-b7cb-792154043ff8-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.537607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.537521    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdrnc\" (UniqueName: \"kubernetes.io/projected/f4892787-9b3a-4314-b7cb-792154043ff8-kube-api-access-sdrnc\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:07:13.855973 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.855916    2572 generic.go:356] "Generic (PLEG): container finished" podID="f4892787-9b3a-4314-b7cb-792154043ff8" containerID="1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753" exitCode=0
Sep 15 19:07:13.855973 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.855952    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" event={"ID":"f4892787-9b3a-4314-b7cb-792154043ff8","Type":"ContainerDied","Data":"1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753"}
Sep 15 19:07:13.855973 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.855958    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"
Sep 15 19:07:13.856134 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.855992    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br" event={"ID":"f4892787-9b3a-4314-b7cb-792154043ff8","Type":"ContainerDied","Data":"4283ba51ffce68c05a6b6de7a1eb4cb2c290796ba2884987520602c402f697d7"}
Sep 15 19:07:13.856134 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.856015    2572 scope.go:117] "RemoveContainer" containerID="1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753"
Sep 15 19:07:13.865536 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.865515    2572 scope.go:117] "RemoveContainer" containerID="6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7"
Sep 15 19:07:13.875370 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.875354    2572 scope.go:117] "RemoveContainer" containerID="1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753"
Sep 15 19:07:13.875596 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.875570    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"]
Sep 15 19:07:13.875671 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:07:13.875631    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753\": container with ID starting with 1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753 not found: ID does not exist" containerID="1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753"
Sep 15 19:07:13.875671 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.875652    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753"} err="failed to get container status \"1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753\": rpc error: code = NotFound desc = could not find container \"1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753\": container with ID starting with 1709f575942503140db6a833e8a3c4a68aee286d27c6eca12856d556384d8753 not found: ID does not exist"
Sep 15 19:07:13.875671 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.875668    2572 scope.go:117] "RemoveContainer" containerID="6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7"
Sep 15 19:07:13.875952 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:07:13.875936    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7\": container with ID starting with 6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7 not found: ID does not exist" containerID="6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7"
Sep 15 19:07:13.876000 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.875959    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7"} err="failed to get container status \"6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7\": rpc error: code = NotFound desc = could not find container \"6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7\": container with ID starting with 6b0cbef82d317a3431ea8169a832d9a6d6889d28a4d97e3b1d4b2143f08058b7 not found: ID does not exist"
Sep 15 19:07:13.883494 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:13.883473    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b6741af4-openshift-default-f4c9fb88-796br"]
Sep 15 19:07:15.393269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:15.393230    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:15.456836 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:15.456793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:15.557678 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:15.557653    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" path="/var/lib/kubelet/pods/f4892787-9b3a-4314-b7cb-792154043ff8/volumes"
Sep 15 19:07:34.551696 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:34.551658    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:07:36.551727 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:36.551690    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:07:39.808442 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:39.808408    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:45.185767 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:45.185730    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:45.785575 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:45.785541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:45.894416 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:45.894383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:46.062328 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:46.062245    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:07:46.687659 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:07:46.687629    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:01.919724 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:01.919660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:07.647676 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:07.647635    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:07.749154 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:07.749115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:07.856038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:07.856002    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:07.948402 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:07.948378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:18.538386 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:18.538302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:18.689632 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:18.689603    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:19.372242 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:19.372206    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:25.032372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:25.032336    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:25.095261 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:25.095230    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:25.178372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:25.178329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:25.277911 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:25.277872    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:25.342018 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:25.341946    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:26.020181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:26.020139    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:26.140201 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:26.140166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:27.850917 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:27.850886    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:33.747008 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:33.746974    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:33.846597 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:33.846564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:34.717956 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:34.717922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:36.176775 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:36.176741    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:40.398074 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.398038    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:40.499625 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.499590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:40.658740 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.658639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:40.969608 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.969522    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"]
Sep 15 19:08:40.970023 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970003    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy"
Sep 15 19:08:40.970023 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970022    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970043    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fca6880-aeb1-4430-8703-02a1604e54be" containerName="payload-pre-processing"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970049    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fca6880-aeb1-4430-8703-02a1604e54be" containerName="payload-pre-processing"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970068    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427529d2-9f39-4a86-9fab-ab7aab40b6ad" containerName="payload-processing"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970074    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="427529d2-9f39-4a86-9fab-ab7aab40b6ad" containerName="payload-processing"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970084    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74a0db32-21e7-4a8c-b798-3282a5d161d4" containerName="revoke-keys"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970090    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="74a0db32-21e7-4a8c-b798-3282a5d161d4" containerName="revoke-keys"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970149    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="74a0db32-21e7-4a8c-b798-3282a5d161d4" containerName="revoke-keys"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970156    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="427529d2-9f39-4a86-9fab-ab7aab40b6ad" containerName="payload-processing"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970164    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fca6880-aeb1-4430-8703-02a1604e54be" containerName="payload-pre-processing"
Sep 15 19:08:40.970221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.970172    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy"
Sep 15 19:08:40.972286 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.972266    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:40.974515 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.974495    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-84ee0c4c-openshift-default-dockercfg-m6tf2\""
Sep 15 19:08:40.984013 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.983991    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"]
Sep 15 19:08:40.995316 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:40.995296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:41.079623 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xkxx\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-kube-api-access-7xkxx\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.079838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079640    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-certs\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.079838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079666    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-credential-socket\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.079838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-envoy\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.079838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-istio-token\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.079838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079764    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ffef51-16e0-474d-a03c-030554829381-istio-podinfo\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.079838 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-socket\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.080133 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-data\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.080133 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.079934    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ffef51-16e0-474d-a03c-030554829381-istiod-ca-cert\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181129 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-data\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181299 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ffef51-16e0-474d-a03c-030554829381-istiod-ca-cert\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181299 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xkxx\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-kube-api-access-7xkxx\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181299 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-certs\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181299 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-credential-socket\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181299 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-envoy\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-istio-token\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ffef51-16e0-474d-a03c-030554829381-istio-podinfo\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-socket\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-data\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181709 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181580    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-certs\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181709 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181607    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-credential-socket\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.181786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181709    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-socket\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.182007 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.181987    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ffef51-16e0-474d-a03c-030554829381-istiod-ca-cert\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.183710 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.183689    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-envoy\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.183865 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.183855    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ffef51-16e0-474d-a03c-030554829381-istio-podinfo\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.188431 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.188404    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xkxx\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-kube-api-access-7xkxx\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.188952 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.188933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-istio-token\") pod \"e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") " pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.199778 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.199754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:41.283815 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.283731    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:41.559279 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.559254    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"]
Sep 15 19:08:41.560556 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:08:41.560524    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ffef51_16e0_474d_a03c_030554829381.slice/crio-4d0ab5680972de551acf8a5b3545ae5e53338a11212c31099c6d1946e16de1f3 WatchSource:0}: Error finding container 4d0ab5680972de551acf8a5b3545ae5e53338a11212c31099c6d1946e16de1f3: Status 404 returned error can't find the container with id 4d0ab5680972de551acf8a5b3545ae5e53338a11212c31099c6d1946e16de1f3
Sep 15 19:08:41.563044 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.563005    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:08:41.563121 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.563093    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:08:41.563171 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:41.563140    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:08:42.365355 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:42.365319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" event={"ID":"e7ffef51-16e0-474d-a03c-030554829381","Type":"ContainerStarted","Data":"f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b"}
Sep 15 19:08:42.365884 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:42.365383    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" event={"ID":"e7ffef51-16e0-474d-a03c-030554829381","Type":"ContainerStarted","Data":"4d0ab5680972de551acf8a5b3545ae5e53338a11212c31099c6d1946e16de1f3"}
Sep 15 19:08:42.384031 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:42.383985    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podStartSLOduration=2.383970805 podStartE2EDuration="2.383970805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:08:42.382921085 +0000 UTC m=+1097.331149401" watchObservedRunningTime="2026-09-15 19:08:42.383970805 +0000 UTC m=+1097.332199130"
Sep 15 19:08:43.284445 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:43.284408    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:43.289349 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:43.289324    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:43.371408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:43.371380    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:43.372203 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:43.372184    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:08:43.957956 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:43.957922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:44.552053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:44.552023    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:08:44.558942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:44.558918    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:44.659570 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:44.659515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:45.252724 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:45.252694    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:46.071347 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:46.071314    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:46.710285 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:46.710248    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:47.381066 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.381017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:47.430933 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.430895    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:47.806797 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.806760    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:47.907675 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.907643    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:47.938370 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.938339    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"]
Sep 15 19:08:47.938744 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.938732    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy"
Sep 15 19:08:47.938787 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.938745    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy"
Sep 15 19:08:47.938841 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.938825    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4892787-9b3a-4314-b7cb-792154043ff8" containerName="istio-proxy"
Sep 15 19:08:47.940897 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.940881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:47.942972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.942950    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-84ee0c4c\""
Sep 15 19:08:47.943078 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.942980    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-84ee0c4c-dockercfg-s45c7\""
Sep 15 19:08:47.949872 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.949851    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"]
Sep 15 19:08:47.968543 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.968511    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"]
Sep 15 19:08:47.970735 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.970719    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:47.982885 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.982865    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"]
Sep 15 19:08:47.987604 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:47.987585    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:08:48.034573 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.034532    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfp4n\" (UniqueName: \"kubernetes.io/projected/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-kube-api-access-gfp4n\") pod \"payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r\" (UID: \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\") " pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:48.034776 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.034613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-plugins-config-volume\") pod \"payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r\" (UID: \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\") " pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:48.034776 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.034655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjrv\" (UniqueName: \"kubernetes.io/projected/267b792f-cade-4235-8159-2ac373de1b3c-kube-api-access-7hjrv\") pod \"payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf\" (UID: \"267b792f-cade-4235-8159-2ac373de1b3c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:48.034776 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.034695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/267b792f-cade-4235-8159-2ac373de1b3c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf\" (UID: \"267b792f-cade-4235-8159-2ac373de1b3c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:48.135622 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.135536    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-plugins-config-volume\") pod \"payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r\" (UID: \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\") " pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:48.135622 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.135573    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjrv\" (UniqueName: \"kubernetes.io/projected/267b792f-cade-4235-8159-2ac373de1b3c-kube-api-access-7hjrv\") pod \"payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf\" (UID: \"267b792f-cade-4235-8159-2ac373de1b3c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:48.135622 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.135600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/267b792f-cade-4235-8159-2ac373de1b3c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf\" (UID: \"267b792f-cade-4235-8159-2ac373de1b3c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:48.135966 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.135682    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfp4n\" (UniqueName: \"kubernetes.io/projected/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-kube-api-access-gfp4n\") pod \"payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r\" (UID: \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\") " pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:48.136376 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.136353    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/267b792f-cade-4235-8159-2ac373de1b3c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf\" (UID: \"267b792f-cade-4235-8159-2ac373de1b3c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:48.136464 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.136374    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-plugins-config-volume\") pod \"payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r\" (UID: \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\") " pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:48.143397 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.143370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjrv\" (UniqueName: \"kubernetes.io/projected/267b792f-cade-4235-8159-2ac373de1b3c-kube-api-access-7hjrv\") pod \"payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf\" (UID: \"267b792f-cade-4235-8159-2ac373de1b3c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:48.143922 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.143901    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfp4n\" (UniqueName: \"kubernetes.io/projected/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-kube-api-access-gfp4n\") pod \"payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r\" (UID: \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\") " pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:48.252616 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.252589    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:48.280754 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.280727    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:48.524690 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.524665    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"]
Sep 15 19:08:48.525953 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:08:48.525928    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267b792f_cade_4235_8159_2ac373de1b3c.slice/crio-d28ea1619ff0f5f186c9039a136d323fc5dd221188860b2c737a6ef1ca29adae WatchSource:0}: Error finding container d28ea1619ff0f5f186c9039a136d323fc5dd221188860b2c737a6ef1ca29adae: Status 404 returned error can't find the container with id d28ea1619ff0f5f186c9039a136d323fc5dd221188860b2c737a6ef1ca29adae
Sep 15 19:08:48.561872 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:48.561845    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"]
Sep 15 19:08:48.564054 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:08:48.564032    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf91cb0_3ff3_4cee_a06e_15fc7947f0c2.slice/crio-6387d9dc14929a12ce1628ac071d977434ced93baac2a5b49088c014c1930165 WatchSource:0}: Error finding container 6387d9dc14929a12ce1628ac071d977434ced93baac2a5b49088c014c1930165: Status 404 returned error can't find the container with id 6387d9dc14929a12ce1628ac071d977434ced93baac2a5b49088c014c1930165
Sep 15 19:08:49.411087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:49.411050    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf" event={"ID":"267b792f-cade-4235-8159-2ac373de1b3c","Type":"ContainerStarted","Data":"da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63"}
Sep 15 19:08:49.411359 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:49.411112    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf" event={"ID":"267b792f-cade-4235-8159-2ac373de1b3c","Type":"ContainerStarted","Data":"d28ea1619ff0f5f186c9039a136d323fc5dd221188860b2c737a6ef1ca29adae"}
Sep 15 19:08:49.411359 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:49.411141    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:08:49.412666 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:49.412639    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r" event={"ID":"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2","Type":"ContainerStarted","Data":"68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f"}
Sep 15 19:08:49.412971 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:49.412691    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:08:49.412971 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:49.412714    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r" event={"ID":"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2","Type":"ContainerStarted","Data":"6387d9dc14929a12ce1628ac071d977434ced93baac2a5b49088c014c1930165"}
Sep 15 19:08:49.434649 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:49.434603    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf" podStartSLOduration=2.434589743 podStartE2EDuration="2.434589743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:08:49.432257134 +0000 UTC m=+1104.380485460" watchObservedRunningTime="2026-09-15 19:08:49.434589743 +0000 UTC m=+1104.382818069"
Sep 15 19:08:49.448116 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:08:49.448078    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r" podStartSLOduration=2.448065172 podStartE2EDuration="2.448065172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:08:49.445709923 +0000 UTC m=+1104.393938248" watchObservedRunningTime="2026-09-15 19:08:49.448065172 +0000 UTC m=+1104.396293498"
Sep 15 19:09:00.421372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:00.421334    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:09:00.421772 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:00.421422    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:09:04.552219 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:04.552180    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:09:05.975168 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:05.975118    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:06.029116 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:06.029085    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:09.136769 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:09.136731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:09.364477 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:09.364431    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:09.478410 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:09.478352    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:10.075475 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:10.075437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:10.175197 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:10.175155    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:10.595014 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:10.594981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:11.076290 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:11.076258    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:11.740773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:11.740734    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:12.464045 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:12.464006    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:13.035918 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:13.035887    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:13.165384 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:13.165338    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:14.412970 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:14.412931    2572 patch_prober.go:28] interesting pod/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 19:09:14.413358 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:14.412988    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 19:09:15.140397 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.140368    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:15.232678 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.232644    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"]
Sep 15 19:09:15.236682 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.236659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"
Sep 15 19:09:15.239931 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.239905    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:09:15.242997 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.242965    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"]
Sep 15 19:09:15.401570 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.401478    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac40df2b-7e88-4553-ab68-ae5e0469c503-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7\" (UID: \"ac40df2b-7e88-4553-ab68-ae5e0469c503\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"
Sep 15 19:09:15.502556 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.502521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac40df2b-7e88-4553-ab68-ae5e0469c503-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7\" (UID: \"ac40df2b-7e88-4553-ab68-ae5e0469c503\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"
Sep 15 19:09:15.503372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.503350    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac40df2b-7e88-4553-ab68-ae5e0469c503-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7\" (UID: \"ac40df2b-7e88-4553-ab68-ae5e0469c503\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"
Sep 15 19:09:15.537772 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.537744    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:15.551722 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.551696    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"
Sep 15 19:09:15.833865 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:15.833837    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"]
Sep 15 19:09:15.835625 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:09:15.835587    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac40df2b_7e88_4553_ab68_ae5e0469c503.slice/crio-046cbc8fc4d6f274fbb90e34e7afde929683669d7e234017bf821a63150da24c WatchSource:0}: Error finding container 046cbc8fc4d6f274fbb90e34e7afde929683669d7e234017bf821a63150da24c: Status 404 returned error can't find the container with id 046cbc8fc4d6f274fbb90e34e7afde929683669d7e234017bf821a63150da24c
Sep 15 19:09:16.368770 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.368685    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:16.517701 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.517637    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:16.585669 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.585640    2572 generic.go:356] "Generic (PLEG): container finished" podID="ac40df2b-7e88-4553-ab68-ae5e0469c503" containerID="4d463b58284e7c1fb8138c0fc7e79eaf6f0f8a196dd88a4643dbed0f249310e2" exitCode=0
Sep 15 19:09:16.585798 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.585725    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7" event={"ID":"ac40df2b-7e88-4553-ab68-ae5e0469c503","Type":"ContainerDied","Data":"4d463b58284e7c1fb8138c0fc7e79eaf6f0f8a196dd88a4643dbed0f249310e2"}
Sep 15 19:09:16.585798 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.585774    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7" event={"ID":"ac40df2b-7e88-4553-ab68-ae5e0469c503","Type":"ContainerStarted","Data":"046cbc8fc4d6f274fbb90e34e7afde929683669d7e234017bf821a63150da24c"}
Sep 15 19:09:16.587389 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.587368    2572 generic.go:356] "Generic (PLEG): container finished" podID="e7ffef51-16e0-474d-a03c-030554829381" containerID="f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b" exitCode=0
Sep 15 19:09:16.587478 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.587438    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" event={"ID":"e7ffef51-16e0-474d-a03c-030554829381","Type":"ContainerDied","Data":"f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b"}
Sep 15 19:09:16.587782 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.587768    2572 scope.go:117] "RemoveContainer" containerID="f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b"
Sep 15 19:09:16.588821 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.588784    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:16.588898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.588866    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:16.588944 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.588907    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:16.611603 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.611584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:16.841263 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.841226    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"]
Sep 15 19:09:16.844060 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.844041    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"
Sep 15 19:09:16.851120 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.851090    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"]
Sep 15 19:09:16.972925 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:16.972897    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:17.015688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.015663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e144d4-4e30-474a-8174-6243d5a3dafd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr\" (UID: \"a6e144d4-4e30-474a-8174-6243d5a3dafd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"
Sep 15 19:09:17.117301 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.117265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e144d4-4e30-474a-8174-6243d5a3dafd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr\" (UID: \"a6e144d4-4e30-474a-8174-6243d5a3dafd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"
Sep 15 19:09:17.117877 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.117858    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e144d4-4e30-474a-8174-6243d5a3dafd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr\" (UID: \"a6e144d4-4e30-474a-8174-6243d5a3dafd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"
Sep 15 19:09:17.157183 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.157153    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"
Sep 15 19:09:17.451758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.451728    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"]
Sep 15 19:09:17.452449 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:09:17.452421    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e144d4_4e30_474a_8174_6243d5a3dafd.slice/crio-51e63dc9be1110d92d255f153ea6a59ab7c87f5ccc5d3fb00fd6774d4d555c6e WatchSource:0}: Error finding container 51e63dc9be1110d92d255f153ea6a59ab7c87f5ccc5d3fb00fd6774d4d555c6e: Status 404 returned error can't find the container with id 51e63dc9be1110d92d255f153ea6a59ab7c87f5ccc5d3fb00fd6774d4d555c6e
Sep 15 19:09:17.601945 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.601908    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr" event={"ID":"a6e144d4-4e30-474a-8174-6243d5a3dafd","Type":"ContainerStarted","Data":"51e63dc9be1110d92d255f153ea6a59ab7c87f5ccc5d3fb00fd6774d4d555c6e"}
Sep 15 19:09:17.603857 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.603831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" event={"ID":"e7ffef51-16e0-474d-a03c-030554829381","Type":"ContainerStarted","Data":"2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834"}
Sep 15 19:09:17.793116 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.793095    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"
Sep 15 19:09:17.839742 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.839703    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac40df2b-7e88-4553-ab68-ae5e0469c503-maas-api-service-ca\") pod \"ac40df2b-7e88-4553-ab68-ae5e0469c503\" (UID: \"ac40df2b-7e88-4553-ab68-ae5e0469c503\") "
Sep 15 19:09:17.840076 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.840050    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac40df2b-7e88-4553-ab68-ae5e0469c503-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac40df2b-7e88-4553-ab68-ae5e0469c503" (UID: "ac40df2b-7e88-4553-ab68-ae5e0469c503"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:09:17.841293 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.841267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:17.940561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:17.940521    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac40df2b-7e88-4553-ab68-ae5e0469c503-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:18.284033 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.284004    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:09:18.284324 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.284297    2572 patch_prober.go:28] interesting pod/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 19:09:18.284434 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.284348    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 19:09:18.573501 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.573410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:18.614021 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.613986    2572 generic.go:356] "Generic (PLEG): container finished" podID="a6e144d4-4e30-474a-8174-6243d5a3dafd" containerID="1dbd0f4bebcaf4cdd7c4f75cc8b1291c98db3cce883bb3e097d55ea807bd6432" exitCode=0
Sep 15 19:09:18.614461 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.614104    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr" event={"ID":"a6e144d4-4e30-474a-8174-6243d5a3dafd","Type":"ContainerDied","Data":"1dbd0f4bebcaf4cdd7c4f75cc8b1291c98db3cce883bb3e097d55ea807bd6432"}
Sep 15 19:09:18.616709 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.616681    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"
Sep 15 19:09:18.624959 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.624932    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7" event={"ID":"ac40df2b-7e88-4553-ab68-ae5e0469c503","Type":"ContainerDied","Data":"046cbc8fc4d6f274fbb90e34e7afde929683669d7e234017bf821a63150da24c"}
Sep 15 19:09:18.625066 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:18.624983    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="046cbc8fc4d6f274fbb90e34e7afde929683669d7e234017bf821a63150da24c"
Sep 15 19:09:19.282246 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:19.282216    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:19.284353 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:19.284330    2572 patch_prober.go:28] interesting pod/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 19:09:19.284464 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:19.284378    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 19:09:19.792162 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:19.792139    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"
Sep 15 19:09:19.859746 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:19.859716    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e144d4-4e30-474a-8174-6243d5a3dafd-maas-api-service-ca\") pod \"a6e144d4-4e30-474a-8174-6243d5a3dafd\" (UID: \"a6e144d4-4e30-474a-8174-6243d5a3dafd\") "
Sep 15 19:09:19.860038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:19.860016    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e144d4-4e30-474a-8174-6243d5a3dafd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a6e144d4-4e30-474a-8174-6243d5a3dafd" (UID: "a6e144d4-4e30-474a-8174-6243d5a3dafd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:09:19.960404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:19.960373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:19.960561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:19.960462    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e144d4-4e30-474a-8174-6243d5a3dafd-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:20.284179 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:20.284098    2572 patch_prober.go:28] interesting pod/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 19:09:20.284179 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:20.284154    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 19:09:20.636217 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:20.636137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr" event={"ID":"a6e144d4-4e30-474a-8174-6243d5a3dafd","Type":"ContainerDied","Data":"51e63dc9be1110d92d255f153ea6a59ab7c87f5ccc5d3fb00fd6774d4d555c6e"}
Sep 15 19:09:20.636217 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:20.636158    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"
Sep 15 19:09:20.636217 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:20.636183    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51e63dc9be1110d92d255f153ea6a59ab7c87f5ccc5d3fb00fd6774d4d555c6e"
Sep 15 19:09:20.668315 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:20.668282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:21.284488 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:21.284452    2572 patch_prober.go:28] interesting pod/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 19:09:21.284871 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:21.284508    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 19:09:21.368768 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:21.368739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:22.284277 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:22.284242    2572 patch_prober.go:28] interesting pod/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 19:09:22.284454 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:22.284293    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 19:09:23.305762 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:23.305722    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:09:23.306245 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:23.306204    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:09:23.307074 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:23.307045    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:09:25.468159 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:25.468124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:26.108973 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:26.108932    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:26.177518 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:26.177490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:26.277336 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:26.277308    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:26.294268 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:26.294241    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"]
Sep 15 19:09:26.296885 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:26.296859    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d5559a-f5qk7"]
Sep 15 19:09:26.365408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:26.365330    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:26.647093 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:26.647011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:26.766932 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:26.766900    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:27.320960 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:27.320914    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:27.557509 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:27.557477    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac40df2b-7e88-4553-ab68-ae5e0469c503" path="/var/lib/kubelet/pods/ac40df2b-7e88-4553-ab68-ae5e0469c503/volumes"
Sep 15 19:09:28.034950 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.034916    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:28.598707 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.598671    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:28.629228 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.629199    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"]
Sep 15 19:09:28.629799 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.629743    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r" podUID="bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2" containerName="payload-processing" containerID="cri-o://68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f" gracePeriod=30
Sep 15 19:09:28.634015 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.633990    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"]
Sep 15 19:09:28.634263 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.634225    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf" podUID="267b792f-cade-4235-8159-2ac373de1b3c" containerName="payload-pre-processing" containerID="cri-o://da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63" gracePeriod=30
Sep 15 19:09:28.674084 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.674057    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:28.747582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.747531    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:28.834480 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.832704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:28.899071 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.899040    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:28.904966 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.904932    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"]
Sep 15 19:09:28.907795 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.907771    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ee0c4c-dgnnr"]
Sep 15 19:09:28.909736 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.909718    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:09:28.943768 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.941315    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfp4n\" (UniqueName: \"kubernetes.io/projected/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-kube-api-access-gfp4n\") pod \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\" (UID: \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\") "
Sep 15 19:09:28.943768 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.941365    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-plugins-config-volume\") pod \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\" (UID: \"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2\") "
Sep 15 19:09:28.943768 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.942191    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2" (UID: "bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:09:28.945595 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.945564    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-kube-api-access-gfp4n" (OuterVolumeSpecName: "kube-api-access-gfp4n") pod "bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2" (UID: "bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2"). InnerVolumeSpecName "kube-api-access-gfp4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:09:28.951640 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.951615    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:09:28.999544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:28.999510    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:29.042731 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.042700    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hjrv\" (UniqueName: \"kubernetes.io/projected/267b792f-cade-4235-8159-2ac373de1b3c-kube-api-access-7hjrv\") pod \"267b792f-cade-4235-8159-2ac373de1b3c\" (UID: \"267b792f-cade-4235-8159-2ac373de1b3c\") "
Sep 15 19:09:29.043134 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.042786    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/267b792f-cade-4235-8159-2ac373de1b3c-plugins-config-volume\") pod \"267b792f-cade-4235-8159-2ac373de1b3c\" (UID: \"267b792f-cade-4235-8159-2ac373de1b3c\") "
Sep 15 19:09:29.043209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.043184    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267b792f-cade-4235-8159-2ac373de1b3c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "267b792f-cade-4235-8159-2ac373de1b3c" (UID: "267b792f-cade-4235-8159-2ac373de1b3c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:09:29.043257 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.043199    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfp4n\" (UniqueName: \"kubernetes.io/projected/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-kube-api-access-gfp4n\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:29.043257 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.043232    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:29.044731 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.044706    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267b792f-cade-4235-8159-2ac373de1b3c-kube-api-access-7hjrv" (OuterVolumeSpecName: "kube-api-access-7hjrv") pod "267b792f-cade-4235-8159-2ac373de1b3c" (UID: "267b792f-cade-4235-8159-2ac373de1b3c"). InnerVolumeSpecName "kube-api-access-7hjrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:09:29.144140 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.144064    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hjrv\" (UniqueName: \"kubernetes.io/projected/267b792f-cade-4235-8159-2ac373de1b3c-kube-api-access-7hjrv\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:29.144140 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.144089    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/267b792f-cade-4235-8159-2ac373de1b3c-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:29.239219 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.239187    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:29.557642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.557614    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e144d4-4e30-474a-8174-6243d5a3dafd" path="/var/lib/kubelet/pods/a6e144d4-4e30-474a-8174-6243d5a3dafd/volumes"
Sep 15 19:09:29.692656 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.692631    2572 generic.go:356] "Generic (PLEG): container finished" podID="bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2" containerID="68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f" exitCode=0
Sep 15 19:09:29.692756 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.692671    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r" event={"ID":"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2","Type":"ContainerDied","Data":"68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f"}
Sep 15 19:09:29.692756 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.692722    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r" event={"ID":"bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2","Type":"ContainerDied","Data":"6387d9dc14929a12ce1628ac071d977434ced93baac2a5b49088c014c1930165"}
Sep 15 19:09:29.692756 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.692744    2572 scope.go:117] "RemoveContainer" containerID="68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f"
Sep 15 19:09:29.692897 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.692676    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"
Sep 15 19:09:29.694284 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.694259    2572 generic.go:356] "Generic (PLEG): container finished" podID="267b792f-cade-4235-8159-2ac373de1b3c" containerID="da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63" exitCode=0
Sep 15 19:09:29.694413 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.694290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf" event={"ID":"267b792f-cade-4235-8159-2ac373de1b3c","Type":"ContainerDied","Data":"da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63"}
Sep 15 19:09:29.694413 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.694310    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"
Sep 15 19:09:29.694413 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.694339    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf" event={"ID":"267b792f-cade-4235-8159-2ac373de1b3c","Type":"ContainerDied","Data":"d28ea1619ff0f5f186c9039a136d323fc5dd221188860b2c737a6ef1ca29adae"}
Sep 15 19:09:29.702289 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.702269    2572 scope.go:117] "RemoveContainer" containerID="68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f"
Sep 15 19:09:29.702543 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:09:29.702526    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f\": container with ID starting with 68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f not found: ID does not exist" containerID="68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f"
Sep 15 19:09:29.702595 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.702549    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f"} err="failed to get container status \"68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f\": rpc error: code = NotFound desc = could not find container \"68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f\": container with ID starting with 68ba791dfbd63ecda6fa60befdcbee4b2578e1582d17b65995aef715503d584f not found: ID does not exist"
Sep 15 19:09:29.702595 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.702564    2572 scope.go:117] "RemoveContainer" containerID="da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63"
Sep 15 19:09:29.710586 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.710567    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"]
Sep 15 19:09:29.711019 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.711001    2572 scope.go:117] "RemoveContainer" containerID="da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63"
Sep 15 19:09:29.711312 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:09:29.711234    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63\": container with ID starting with da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63 not found: ID does not exist" containerID="da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63"
Sep 15 19:09:29.711312 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.711258    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63"} err="failed to get container status \"da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63\": rpc error: code = NotFound desc = could not find container \"da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63\": container with ID starting with da8ab5ca5f9aafb6522bae114191f9c7e1170486847ddf7919306a26e029ec63 not found: ID does not exist"
Sep 15 19:09:29.714439 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.714420    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-84ee0c4c-6fc46956bf-5zn7r"]
Sep 15 19:09:29.725730 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.725710    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"]
Sep 15 19:09:29.729830 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.729798    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-84ee0c4c-6b95c5bf9d-6cbvf"]
Sep 15 19:09:29.939720 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:29.939690    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:30.315345 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:30.315261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:31.055694 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:31.055654    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:31.557905 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:31.557876    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="267b792f-cade-4235-8159-2ac373de1b3c" path="/var/lib/kubelet/pods/267b792f-cade-4235-8159-2ac373de1b3c/volumes"
Sep 15 19:09:31.558269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:31.558234    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2" path="/var/lib/kubelet/pods/bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2/volumes"
Sep 15 19:09:31.790143 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:31.790114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:32.577128 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:32.577092    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:32.682117 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:32.682085    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:32.800056 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:32.800022    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"]
Sep 15 19:09:32.800317 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:32.800290    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy" containerID="cri-o://ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18" gracePeriod=30
Sep 15 19:09:32.817946 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:32.817922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:33.138997 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.138959    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"]
Sep 15 19:09:33.139439 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139421    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2" containerName="payload-processing"
Sep 15 19:09:33.139524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139441    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2" containerName="payload-processing"
Sep 15 19:09:33.139524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139473    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac40df2b-7e88-4553-ab68-ae5e0469c503" containerName="revoke-keys"
Sep 15 19:09:33.139524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139482    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac40df2b-7e88-4553-ab68-ae5e0469c503" containerName="revoke-keys"
Sep 15 19:09:33.139524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139500    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="267b792f-cade-4235-8159-2ac373de1b3c" containerName="payload-pre-processing"
Sep 15 19:09:33.139524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139509    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="267b792f-cade-4235-8159-2ac373de1b3c" containerName="payload-pre-processing"
Sep 15 19:09:33.139524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139523    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e144d4-4e30-474a-8174-6243d5a3dafd" containerName="revoke-keys"
Sep 15 19:09:33.139844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139533    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e144d4-4e30-474a-8174-6243d5a3dafd" containerName="revoke-keys"
Sep 15 19:09:33.139844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139645    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e144d4-4e30-474a-8174-6243d5a3dafd" containerName="revoke-keys"
Sep 15 19:09:33.139844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139658    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf91cb0-3ff3-4cee-a06e-15fc7947f0c2" containerName="payload-processing"
Sep 15 19:09:33.139844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139671    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="267b792f-cade-4235-8159-2ac373de1b3c" containerName="payload-pre-processing"
Sep 15 19:09:33.139844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.139681    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac40df2b-7e88-4553-ab68-ae5e0469c503" containerName="revoke-keys"
Sep 15 19:09:33.142720 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.142697    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"
Sep 15 19:09:33.144697 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.144674    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:09:33.149781 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.149760    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"]
Sep 15 19:09:33.181586 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.181555    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88a66e40-4eac-4ba5-b7f4-a8fb482deda4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96\" (UID: \"88a66e40-4eac-4ba5-b7f4-a8fb482deda4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"
Sep 15 19:09:33.282041 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.282015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88a66e40-4eac-4ba5-b7f4-a8fb482deda4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96\" (UID: \"88a66e40-4eac-4ba5-b7f4-a8fb482deda4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"
Sep 15 19:09:33.282584 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.282560    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88a66e40-4eac-4ba5-b7f4-a8fb482deda4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96\" (UID: \"88a66e40-4eac-4ba5-b7f4-a8fb482deda4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"
Sep 15 19:09:33.454827 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.454793    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"
Sep 15 19:09:33.725533 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.725502    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"]
Sep 15 19:09:33.726680 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:09:33.726655    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a66e40_4eac_4ba5_b7f4_a8fb482deda4.slice/crio-ed11976ea3ce26d85f473a106ad4a306060f9a9f1c146c656251b04cad905f13 WatchSource:0}: Error finding container ed11976ea3ce26d85f473a106ad4a306060f9a9f1c146c656251b04cad905f13: Status 404 returned error can't find the container with id ed11976ea3ce26d85f473a106ad4a306060f9a9f1c146c656251b04cad905f13
Sep 15 19:09:33.975342 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:33.975289    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:34.683346 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:34.683321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:34.727382 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:34.727358    2572 generic.go:356] "Generic (PLEG): container finished" podID="88a66e40-4eac-4ba5-b7f4-a8fb482deda4" containerID="6aad6170c78536a7cd1ab90da9e575991490bf2faa8a9ea466768ccbff9ea0fe" exitCode=0
Sep 15 19:09:34.727687 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:34.727445    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96" event={"ID":"88a66e40-4eac-4ba5-b7f4-a8fb482deda4","Type":"ContainerDied","Data":"6aad6170c78536a7cd1ab90da9e575991490bf2faa8a9ea466768ccbff9ea0fe"}
Sep 15 19:09:34.727687 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:34.727494    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96" event={"ID":"88a66e40-4eac-4ba5-b7f4-a8fb482deda4","Type":"ContainerStarted","Data":"ed11976ea3ce26d85f473a106ad4a306060f9a9f1c146c656251b04cad905f13"}
Sep 15 19:09:35.341333 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:35.341302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:35.508669 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:35.508635    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:35.609282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:35.609192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:35.754966 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:35.754935    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"]
Sep 15 19:09:35.755392 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:35.755163    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy" containerID="cri-o://2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834" gracePeriod=30
Sep 15 19:09:35.779852 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:35.779795    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:35.886165 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:35.886141    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"
Sep 15 19:09:36.007785 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.007757    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88a66e40-4eac-4ba5-b7f4-a8fb482deda4-maas-api-service-ca\") pod \"88a66e40-4eac-4ba5-b7f4-a8fb482deda4\" (UID: \"88a66e40-4eac-4ba5-b7f4-a8fb482deda4\") "
Sep 15 19:09:36.008100 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.008074    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88a66e40-4eac-4ba5-b7f4-a8fb482deda4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "88a66e40-4eac-4ba5-b7f4-a8fb482deda4" (UID: "88a66e40-4eac-4ba5-b7f4-a8fb482deda4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:09:36.102968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.102901    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:36.109240 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.109213    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88a66e40-4eac-4ba5-b7f4-a8fb482deda4-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:36.193369 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.193321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:36.298255 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.298226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:36.741909 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.741878    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"
Sep 15 19:09:36.742063 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.741879    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96" event={"ID":"88a66e40-4eac-4ba5-b7f4-a8fb482deda4","Type":"ContainerDied","Data":"ed11976ea3ce26d85f473a106ad4a306060f9a9f1c146c656251b04cad905f13"}
Sep 15 19:09:36.742063 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:36.742012    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed11976ea3ce26d85f473a106ad4a306060f9a9f1c146c656251b04cad905f13"
Sep 15 19:09:38.047405 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.047381    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:09:38.126734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.126653    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istiod-ca-cert\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.126734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.126719    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-data\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.126963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.126763    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-podinfo\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.126963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.126790    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llppd\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-kube-api-access-llppd\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.126963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.126832    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-token\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.126963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.126945    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-certs\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.127170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127004    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-socket\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.127170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127033    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-envoy\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.127170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127067    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-credential-socket\") pod \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\" (UID: \"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87\") "
Sep 15 19:09:38.127170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127085    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:38.127170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127097    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:09:38.127413 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127342    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:38.127413 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127365    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:38.127521 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127433    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.127521 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127451    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.127521 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127465    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.127624 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.127562    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:38.129045 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.129018    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:09:38.129127 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.129052    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-kube-api-access-llppd" (OuterVolumeSpecName: "kube-api-access-llppd") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "kube-api-access-llppd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:09:38.129284 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.129264    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:09:38.129352 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.129313    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" (UID: "3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:38.228151 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.228115    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.228151 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.228148    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.228289 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.228163    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llppd\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-kube-api-access-llppd\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.228289 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.228177    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.228289 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.228188    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.228289 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.228200    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:38.308608 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.308578    2572 patch_prober.go:28] interesting pod/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 15 19:09:38.308684 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.308622    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 19:09:38.754862 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.754833    2572 generic.go:356] "Generic (PLEG): container finished" podID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerID="ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18" exitCode=0
Sep 15 19:09:38.754983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.754877    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"
Sep 15 19:09:38.754983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.754917    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" event={"ID":"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87","Type":"ContainerDied","Data":"ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18"}
Sep 15 19:09:38.754983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.754969    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5" event={"ID":"3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87","Type":"ContainerDied","Data":"17387bbdf1dc30ebd0481890d9a17075c0a72a1fab9f2354f9dd403aa811f22c"}
Sep 15 19:09:38.755097 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.754995    2572 scope.go:117] "RemoveContainer" containerID="ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18"
Sep 15 19:09:38.764783 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.764766    2572 scope.go:117] "RemoveContainer" containerID="b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9"
Sep 15 19:09:38.772610 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.772595    2572 scope.go:117] "RemoveContainer" containerID="ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18"
Sep 15 19:09:38.772914 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:09:38.772897    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18\": container with ID starting with ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18 not found: ID does not exist" containerID="ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18"
Sep 15 19:09:38.772952 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.772922    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18"} err="failed to get container status \"ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18\": rpc error: code = NotFound desc = could not find container \"ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18\": container with ID starting with ebbd74b803762a2cc8b44d9aa05d42269fc2c4ff19052852f0e6a6df859c7d18 not found: ID does not exist"
Sep 15 19:09:38.772952 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.772938    2572 scope.go:117] "RemoveContainer" containerID="b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9"
Sep 15 19:09:38.773165 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:09:38.773151    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9\": container with ID starting with b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9 not found: ID does not exist" containerID="b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9"
Sep 15 19:09:38.773204 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.773170    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9"} err="failed to get container status \"b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9\": rpc error: code = NotFound desc = could not find container \"b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9\": container with ID starting with b469d5464310b5b2fba899fee8b2611509b1a54bc6a1c2975ae14c7227d96ba9 not found: ID does not exist"
Sep 15 19:09:38.776915 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.776892    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"]
Sep 15 19:09:38.781263 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:38.781242    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d5559a-openshift-default-69f8d5f7fb-w8mq5"]
Sep 15 19:09:39.557895 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:39.557865    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" path="/var/lib/kubelet/pods/3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87/volumes"
Sep 15 19:09:40.315278 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:40.315242    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:41.003084 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.003061    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:09:41.149637 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149560    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-istio-token\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.149637 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149596    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-data\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.149637 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149623    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xkxx\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-kube-api-access-7xkxx\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.149947 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149643    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ffef51-16e0-474d-a03c-030554829381-istio-podinfo\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.149947 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149775    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ffef51-16e0-474d-a03c-030554829381-istiod-ca-cert\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.149947 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149855    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-credential-socket\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.149947 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149906    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-certs\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.149947 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149938    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:41.150213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.149988    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-envoy\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.150213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150016    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-socket\") pod \"e7ffef51-16e0-474d-a03c-030554829381\" (UID: \"e7ffef51-16e0-474d-a03c-030554829381\") "
Sep 15 19:09:41.150213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150035    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:41.150213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150080    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:41.150213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150162    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ffef51-16e0-474d-a03c-030554829381-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:09:41.150471 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150269    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:41.150471 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150357    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.150471 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150371    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.150471 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150379    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ffef51-16e0-474d-a03c-030554829381-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.150471 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150388    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.150471 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.150396    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.151883 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.151857    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:09:41.151985 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.151894    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-kube-api-access-7xkxx" (OuterVolumeSpecName: "kube-api-access-7xkxx") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "kube-api-access-7xkxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:09:41.151985 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.151959    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:09:41.152068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.152036    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7ffef51-16e0-474d-a03c-030554829381-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7ffef51-16e0-474d-a03c-030554829381" (UID: "e7ffef51-16e0-474d-a03c-030554829381"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:09:41.251659 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.251633    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.251755 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.251661    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xkxx\" (UniqueName: \"kubernetes.io/projected/e7ffef51-16e0-474d-a03c-030554829381-kube-api-access-7xkxx\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.251755 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.251676    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ffef51-16e0-474d-a03c-030554829381-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.251755 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.251687    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ffef51-16e0-474d-a03c-030554829381-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:41.779567 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.779542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:41.783908 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.783881    2572 generic.go:356] "Generic (PLEG): container finished" podID="e7ffef51-16e0-474d-a03c-030554829381" containerID="2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834" exitCode=0
Sep 15 19:09:41.784016 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.783926    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"
Sep 15 19:09:41.784016 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.783927    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" event={"ID":"e7ffef51-16e0-474d-a03c-030554829381","Type":"ContainerDied","Data":"2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834"}
Sep 15 19:09:41.784016 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.783980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67" event={"ID":"e7ffef51-16e0-474d-a03c-030554829381","Type":"ContainerDied","Data":"4d0ab5680972de551acf8a5b3545ae5e53338a11212c31099c6d1946e16de1f3"}
Sep 15 19:09:41.784016 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.784002    2572 scope.go:117] "RemoveContainer" containerID="2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834"
Sep 15 19:09:41.792721 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.792706    2572 scope.go:117] "RemoveContainer" containerID="f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b"
Sep 15 19:09:41.800379 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.800358    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"]
Sep 15 19:09:41.800634 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.800619    2572 scope.go:117] "RemoveContainer" containerID="2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834"
Sep 15 19:09:41.800965 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:09:41.800944    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834\": container with ID starting with 2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834 not found: ID does not exist" containerID="2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834"
Sep 15 19:09:41.801075 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.800974    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834"} err="failed to get container status \"2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834\": rpc error: code = NotFound desc = could not find container \"2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834\": container with ID starting with 2d9c1ec975ea2c5187e8c6ccf4ddec9a1aeed9ca051e62f102e47b8f3cb35834 not found: ID does not exist"
Sep 15 19:09:41.801075 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.800991    2572 scope.go:117] "RemoveContainer" containerID="f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b"
Sep 15 19:09:41.801281 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:09:41.801242    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b\": container with ID starting with f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b not found: ID does not exist" containerID="f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b"
Sep 15 19:09:41.801371 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.801286    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b"} err="failed to get container status \"f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b\": rpc error: code = NotFound desc = could not find container \"f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b\": container with ID starting with f3730be906303c406c3b25e67de50b9f5e49338eb707e60710703249508a4b3b not found: ID does not exist"
Sep 15 19:09:41.804107 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:41.804083    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-84ee0c4c-openshift-default-65b8bf5584-bzq67"]
Sep 15 19:09:42.532182 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:42.532151    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:42.635091 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:42.635067    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:42.764406 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:42.764365    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:42.866939 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:42.866863    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:43.378300 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:43.378272    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:43.558289 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:43.558261    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7ffef51-16e0-474d-a03c-030554829381" path="/var/lib/kubelet/pods/e7ffef51-16e0-474d-a03c-030554829381/volumes"
Sep 15 19:09:44.105405 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.105370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:44.697943 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.697912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:44.725635 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.725607    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"]
Sep 15 19:09:44.725851 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.725801    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj" podUID="91215ae3-41a8-40f0-b51f-b6789f4ccb6d" containerName="payload-processing" containerID="cri-o://5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1" gracePeriod=30
Sep 15 19:09:44.796868 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.796840    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:44.888894 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.888861    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"]
Sep 15 19:09:44.891986 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.891955    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08e9c4-flk96"]
Sep 15 19:09:44.943499 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.943467    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:44.978492 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:44.978470    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:09:45.017175 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.017138    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:45.080905 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.080877    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-plugins-config-volume\") pod \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\" (UID: \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\") "
Sep 15 19:09:45.081099 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.080942    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft2l6\" (UniqueName: \"kubernetes.io/projected/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-kube-api-access-ft2l6\") pod \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\" (UID: \"91215ae3-41a8-40f0-b51f-b6789f4ccb6d\") "
Sep 15 19:09:45.081226 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.081202    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91215ae3-41a8-40f0-b51f-b6789f4ccb6d" (UID: "91215ae3-41a8-40f0-b51f-b6789f4ccb6d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:09:45.083076 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.083053    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-kube-api-access-ft2l6" (OuterVolumeSpecName: "kube-api-access-ft2l6") pod "91215ae3-41a8-40f0-b51f-b6789f4ccb6d" (UID: "91215ae3-41a8-40f0-b51f-b6789f4ccb6d"). InnerVolumeSpecName "kube-api-access-ft2l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:09:45.182247 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.182220    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:45.182247 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.182243    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft2l6\" (UniqueName: \"kubernetes.io/projected/91215ae3-41a8-40f0-b51f-b6789f4ccb6d-kube-api-access-ft2l6\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:09:45.257475 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.257391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:45.355194 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.355170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:45.559599 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.559520    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88a66e40-4eac-4ba5-b7f4-a8fb482deda4" path="/var/lib/kubelet/pods/88a66e40-4eac-4ba5-b7f4-a8fb482deda4/volumes"
Sep 15 19:09:45.808582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.808551    2572 generic.go:356] "Generic (PLEG): container finished" podID="91215ae3-41a8-40f0-b51f-b6789f4ccb6d" containerID="5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1" exitCode=0
Sep 15 19:09:45.808987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.808602    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"
Sep 15 19:09:45.808987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.808632    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj" event={"ID":"91215ae3-41a8-40f0-b51f-b6789f4ccb6d","Type":"ContainerDied","Data":"5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1"}
Sep 15 19:09:45.808987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.808682    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj" event={"ID":"91215ae3-41a8-40f0-b51f-b6789f4ccb6d","Type":"ContainerDied","Data":"70028ec08222e8f0d4d24c3c9e86c9d42024d0fdc7a347daffcb0865612d4357"}
Sep 15 19:09:45.808987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.808705    2572 scope.go:117] "RemoveContainer" containerID="5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1"
Sep 15 19:09:45.818429 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.818411    2572 scope.go:117] "RemoveContainer" containerID="5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1"
Sep 15 19:09:45.818723 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:09:45.818697    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1\": container with ID starting with 5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1 not found: ID does not exist" containerID="5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1"
Sep 15 19:09:45.818782 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.818723    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1"} err="failed to get container status \"5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1\": rpc error: code = NotFound desc = could not find container \"5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1\": container with ID starting with 5316cd281752c00f3655d8cd636780c723a300274b0cb4dbc591fc29573837e1 not found: ID does not exist"
Sep 15 19:09:45.824849 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.824828    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"]
Sep 15 19:09:45.828274 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.828254    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-08e9c4-66776b9969-4kjdj"]
Sep 15 19:09:45.978868 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:45.978837    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:46.694468 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:46.694441    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:47.558407 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:47.558373    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91215ae3-41a8-40f0-b51f-b6789f4ccb6d" path="/var/lib/kubelet/pods/91215ae3-41a8-40f0-b51f-b6789f4ccb6d/volumes"
Sep 15 19:09:48.585386 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:48.585351    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:48.653424 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:48.653399    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:49.469197 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.469159    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:49.741683 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.741611    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"]
Sep 15 19:09:49.742051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.741997    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a66e40-4eac-4ba5-b7f4-a8fb482deda4" containerName="revoke-keys"
Sep 15 19:09:49.742051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742012    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a66e40-4eac-4ba5-b7f4-a8fb482deda4" containerName="revoke-keys"
Sep 15 19:09:49.742051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742025    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91215ae3-41a8-40f0-b51f-b6789f4ccb6d" containerName="payload-processing"
Sep 15 19:09:49.742051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742032    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="91215ae3-41a8-40f0-b51f-b6789f4ccb6d" containerName="payload-processing"
Sep 15 19:09:49.742051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742040    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy"
Sep 15 19:09:49.742051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742045    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742057    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742063    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742069    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742074    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742082    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742087    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742143    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="91215ae3-41a8-40f0-b51f-b6789f4ccb6d" containerName="payload-processing"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742153    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742159    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742165    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a66e40-4eac-4ba5-b7f4-a8fb482deda4" containerName="revoke-keys"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742170    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8e22b3-ec83-4fa8-bc44-5bfa11f73c87" containerName="istio-proxy"
Sep 15 19:09:49.742253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.742177    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ffef51-16e0-474d-a03c-030554829381" containerName="istio-proxy"
Sep 15 19:09:49.744706 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.744689    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.747050 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.747027    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-4d299f-openshift-default-dockercfg-p92ll\""
Sep 15 19:09:49.757357 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.757333    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"]
Sep 15 19:09:49.768986 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.768963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:49.819983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.819958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-token\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.820083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.819985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-socket\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.820083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.820017    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xczw6\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-kube-api-access-xczw6\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.820083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.820040    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-certs\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.820083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.820062    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-data\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.820083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.820080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-podinfo\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.820250 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.820159    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-credential-socket\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.820250 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.820208    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-envoy\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.820250 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.820244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istiod-ca-cert\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.901971 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.901919    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:49.921652 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921627    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xczw6\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-kube-api-access-xczw6\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.921765 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-certs\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.921765 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-data\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.921765 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-podinfo\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.921765 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921744    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-credential-socket\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.921983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921772    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-envoy\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.921983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istiod-ca-cert\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.921983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-token\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.921983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.921928    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-socket\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.922198 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.922069    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-certs\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.922198 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.922122    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-data\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.922198 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.922189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-credential-socket\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.922477 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.922454    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-socket\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.922574 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.922555    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istiod-ca-cert\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.924060 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.924041    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-envoy\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.924168 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.924153    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-podinfo\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.928862 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.928839    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-token\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:49.929080 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:49.929060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xczw6\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-kube-api-access-xczw6\") pod \"e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") " pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:50.055186 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:50.055103    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:50.328658 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:50.328634    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"]
Sep 15 19:09:50.330317 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:09:50.330291    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbba9983_84fa_4c09_ae62_371dbd70a4f3.slice/crio-8e934d03ac02c1b9a14428e37f62c3eea5b3962289e6b3753924d41455a24e3e WatchSource:0}: Error finding container 8e934d03ac02c1b9a14428e37f62c3eea5b3962289e6b3753924d41455a24e3e: Status 404 returned error can't find the container with id 8e934d03ac02c1b9a14428e37f62c3eea5b3962289e6b3753924d41455a24e3e
Sep 15 19:09:50.332522 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:50.332484    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:50.332589 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:50.332574    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:50.332642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:50.332621    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:50.850791 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:50.850756    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" event={"ID":"dbba9983-84fa-4c09-ae62-371dbd70a4f3","Type":"ContainerStarted","Data":"da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015"}
Sep 15 19:09:50.851178 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:50.850856    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" event={"ID":"dbba9983-84fa-4c09-ae62-371dbd70a4f3","Type":"ContainerStarted","Data":"8e934d03ac02c1b9a14428e37f62c3eea5b3962289e6b3753924d41455a24e3e"}
Sep 15 19:09:50.869440 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:50.869395    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podStartSLOduration=1.869380783 podStartE2EDuration="1.869380783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:09:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:09:50.867893234 +0000 UTC m=+1165.816121559" watchObservedRunningTime="2026-09-15 19:09:50.869380783 +0000 UTC m=+1165.817609180"
Sep 15 19:09:51.055955 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:51.055923    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:51.060712 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:51.060683    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:51.068416 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:51.068391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:51.126383 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:51.126324    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:51.336968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:51.336939    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:51.856226 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:51.856196    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:51.857070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:51.857053    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:09:51.867062 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:51.867032    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:52.087607 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.087553    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:52.129751 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.129685    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"]
Sep 15 19:09:52.132091 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.132074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.134172 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.134152    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-7073b8-openshift-default-dockercfg-zbdrw\""
Sep 15 19:09:52.145230 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.145200    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"]
Sep 15 19:09:52.169311 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.169284    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:52.245372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-data\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.245372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245264    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-envoy\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.245372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245297    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-token\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.245372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245344    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-socket\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.245750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245408    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-podinfo\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.245750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245464    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2twwf\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-kube-api-access-2twwf\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.245750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245539    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-credential-socket\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.245750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245576    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-certs\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.245750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.245622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76953b1d-a90d-4dde-a950-c9b8c9618e50-istiod-ca-cert\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346407 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346379    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-credential-socket\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346416    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-certs\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76953b1d-a90d-4dde-a950-c9b8c9618e50-istiod-ca-cert\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-data\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-envoy\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346517    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-token\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-socket\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346582 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346574    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-podinfo\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2twwf\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-kube-api-access-2twwf\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346835    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-credential-socket\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346858    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-certs\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.346968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.346933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-data\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.347108 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.347065    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-socket\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.347292 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.347271    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76953b1d-a90d-4dde-a950-c9b8c9618e50-istiod-ca-cert\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.348720 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.348701    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-envoy\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.349068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.349052    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-podinfo\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.354603 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.354579    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2twwf\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-kube-api-access-2twwf\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.354679 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.354661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-token\") pod \"e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") " pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.444578 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.444557    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:52.522761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.522733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:52.668335 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.668299    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:52.722993 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.722968    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"]
Sep 15 19:09:52.724666 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:09:52.724642    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76953b1d_a90d_4dde_a950_c9b8c9618e50.slice/crio-2202eb1d0ad3a6c3b5609eafa4f7d0d772da9e4893b57d5b6188c2c3c58f17a6 WatchSource:0}: Error finding container 2202eb1d0ad3a6c3b5609eafa4f7d0d772da9e4893b57d5b6188c2c3c58f17a6: Status 404 returned error can't find the container with id 2202eb1d0ad3a6c3b5609eafa4f7d0d772da9e4893b57d5b6188c2c3c58f17a6
Sep 15 19:09:52.727280 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.727248    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:52.727356 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.727318    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:52.727356 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.727350    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:09:52.867515 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.867402    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" event={"ID":"76953b1d-a90d-4dde-a950-c9b8c9618e50","Type":"ContainerStarted","Data":"c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d"}
Sep 15 19:09:52.867515 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.867457    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" event={"ID":"76953b1d-a90d-4dde-a950-c9b8c9618e50","Type":"ContainerStarted","Data":"2202eb1d0ad3a6c3b5609eafa4f7d0d772da9e4893b57d5b6188c2c3c58f17a6"}
Sep 15 19:09:52.890612 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.890525    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" podStartSLOduration=0.890503869 podStartE2EDuration="890.503869ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:09:52.886143395 +0000 UTC m=+1167.834371723" watchObservedRunningTime="2026-09-15 19:09:52.890503869 +0000 UTC m=+1167.838732196"
Sep 15 19:09:52.995789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:52.995699    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:53.101771 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:53.101739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:53.445688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:53.445660    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:53.451163 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:53.451140    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:53.542719 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:53.542689    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:53.872445 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:53.872370    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:53.873270 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:53.873252    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:09:54.409160 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:54.409129    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:54.468707 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:54.468660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:54.635601 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:54.635571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:54.767490 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:54.767412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:54.866843 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:54.866792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:55.239520 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.239487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:55.335225 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.335199    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:55.339757 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.339734    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"]
Sep 15 19:09:55.342075 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.342059    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:55.344064 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.344044    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-4d299f\""
Sep 15 19:09:55.344239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.344225    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-4d299f-dockercfg-wjz5z\""
Sep 15 19:09:55.353280 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.353259    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"]
Sep 15 19:09:55.377623 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.377572    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"]
Sep 15 19:09:55.381315 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.381290    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:55.382908 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.382886    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"]
Sep 15 19:09:55.480067 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.480032    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlsk7\" (UniqueName: \"kubernetes.io/projected/ed13c890-df39-4055-a275-7a36962495b1-kube-api-access-wlsk7\") pod \"payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp\" (UID: \"ed13c890-df39-4055-a275-7a36962495b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:55.480251 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.480095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed13c890-df39-4055-a275-7a36962495b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp\" (UID: \"ed13c890-df39-4055-a275-7a36962495b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:55.480251 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.480132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83b84973-476f-41bf-b95e-09b513421ef6-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb\" (UID: \"83b84973-476f-41bf-b95e-09b513421ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:55.480327 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.480294    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfm7\" (UniqueName: \"kubernetes.io/projected/83b84973-476f-41bf-b95e-09b513421ef6-kube-api-access-dpfm7\") pod \"payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb\" (UID: \"83b84973-476f-41bf-b95e-09b513421ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:55.581068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.580990    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed13c890-df39-4055-a275-7a36962495b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp\" (UID: \"ed13c890-df39-4055-a275-7a36962495b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:55.581068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.581047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83b84973-476f-41bf-b95e-09b513421ef6-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb\" (UID: \"83b84973-476f-41bf-b95e-09b513421ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:55.581298 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.581176    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfm7\" (UniqueName: \"kubernetes.io/projected/83b84973-476f-41bf-b95e-09b513421ef6-kube-api-access-dpfm7\") pod \"payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb\" (UID: \"83b84973-476f-41bf-b95e-09b513421ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:55.581298 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.581205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlsk7\" (UniqueName: \"kubernetes.io/projected/ed13c890-df39-4055-a275-7a36962495b1-kube-api-access-wlsk7\") pod \"payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp\" (UID: \"ed13c890-df39-4055-a275-7a36962495b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:55.581725 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.581704    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83b84973-476f-41bf-b95e-09b513421ef6-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb\" (UID: \"83b84973-476f-41bf-b95e-09b513421ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:55.581725 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.581716    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed13c890-df39-4055-a275-7a36962495b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp\" (UID: \"ed13c890-df39-4055-a275-7a36962495b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:55.588737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.588715    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfm7\" (UniqueName: \"kubernetes.io/projected/83b84973-476f-41bf-b95e-09b513421ef6-kube-api-access-dpfm7\") pod \"payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb\" (UID: \"83b84973-476f-41bf-b95e-09b513421ef6\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:55.589022 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.589006    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlsk7\" (UniqueName: \"kubernetes.io/projected/ed13c890-df39-4055-a275-7a36962495b1-kube-api-access-wlsk7\") pod \"payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp\" (UID: \"ed13c890-df39-4055-a275-7a36962495b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:55.599433 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.599411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:55.652932 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.652906    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:55.691747 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.691720    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:55.936082 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.936057    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"]
Sep 15 19:09:55.936829 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:09:55.936791    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded13c890_df39_4055_a275_7a36962495b1.slice/crio-7cce0335aae798964cbc2392e7979a58ec78f977e4e91f7302b9aae65f6889c5 WatchSource:0}: Error finding container 7cce0335aae798964cbc2392e7979a58ec78f977e4e91f7302b9aae65f6889c5: Status 404 returned error can't find the container with id 7cce0335aae798964cbc2392e7979a58ec78f977e4e91f7302b9aae65f6889c5
Sep 15 19:09:55.973517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:55.973490    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"]
Sep 15 19:09:55.974731 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:09:55.974706    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b84973_476f_41bf_b95e_09b513421ef6.slice/crio-3b33671a3a104c341f34e6d09e399a8c2d9b07b2b9c09fac5d8ba8bd9da36071 WatchSource:0}: Error finding container 3b33671a3a104c341f34e6d09e399a8c2d9b07b2b9c09fac5d8ba8bd9da36071: Status 404 returned error can't find the container with id 3b33671a3a104c341f34e6d09e399a8c2d9b07b2b9c09fac5d8ba8bd9da36071
Sep 15 19:09:56.206487 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.206408    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:56.880761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.880722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:56.890465 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.890438    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp" event={"ID":"ed13c890-df39-4055-a275-7a36962495b1","Type":"ContainerStarted","Data":"20549bb71d2566da580f7d1ba3b454e5c627e5e17e746d4ba5eb040f6a2d9999"}
Sep 15 19:09:56.890628 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.890597    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:09:56.890695 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.890650    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp" event={"ID":"ed13c890-df39-4055-a275-7a36962495b1","Type":"ContainerStarted","Data":"7cce0335aae798964cbc2392e7979a58ec78f977e4e91f7302b9aae65f6889c5"}
Sep 15 19:09:56.892157 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.892133    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb" event={"ID":"83b84973-476f-41bf-b95e-09b513421ef6","Type":"ContainerStarted","Data":"787b0e986079e3a59c2d0d4b3a76d2e9d0d2aa673d38b3377e002316f3b0e893"}
Sep 15 19:09:56.892286 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.892177    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:09:56.892286 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.892197    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb" event={"ID":"83b84973-476f-41bf-b95e-09b513421ef6","Type":"ContainerStarted","Data":"3b33671a3a104c341f34e6d09e399a8c2d9b07b2b9c09fac5d8ba8bd9da36071"}
Sep 15 19:09:56.906905 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.906854    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp" podStartSLOduration=1.906840192 podStartE2EDuration="1.906840192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:09:56.904413404 +0000 UTC m=+1171.852641730" watchObservedRunningTime="2026-09-15 19:09:56.906840192 +0000 UTC m=+1171.855068520"
Sep 15 19:09:56.919423 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:56.919379    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb" podStartSLOduration=1.919366846 podStartE2EDuration="1.919366846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:09:56.918760674 +0000 UTC m=+1171.866989001" watchObservedRunningTime="2026-09-15 19:09:56.919366846 +0000 UTC m=+1171.867595222"
Sep 15 19:09:57.645411 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:57.645372    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:58.408198 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:58.408168    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:58.507882 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:58.507851    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:58.607109 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:58.607080    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:58.772752 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:58.772728    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:09:58.871533 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:09:58.871504    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:07.900014 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:07.899981    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:10:07.900408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:07.900057    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:10:08.551517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:08.551474    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:10:15.021544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:15.021515    2572 generic.go:356] "Generic (PLEG): container finished" podID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerID="da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015" exitCode=0
Sep 15 19:10:15.023123 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:15.021589    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" event={"ID":"dbba9983-84fa-4c09-ae62-371dbd70a4f3","Type":"ContainerDied","Data":"da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015"}
Sep 15 19:10:15.023123 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:15.022087    2572 scope.go:117] "RemoveContainer" containerID="da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015"
Sep 15 19:10:15.023463 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:15.023240    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:15.023463 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:15.023318    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:15.023463 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:15.023362    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:16.034127 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.034088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:16.034694 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.034655    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" event={"ID":"dbba9983-84fa-4c09-ae62-371dbd70a4f3","Type":"ContainerStarted","Data":"b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf"}
Sep 15 19:10:16.036623 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.036598    2572 generic.go:356] "Generic (PLEG): container finished" podID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerID="c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d" exitCode=0
Sep 15 19:10:16.036747 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.036629    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" event={"ID":"76953b1d-a90d-4dde-a950-c9b8c9618e50","Type":"ContainerDied","Data":"c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d"}
Sep 15 19:10:16.037038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.037019    2572 scope.go:117] "RemoveContainer" containerID="c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d"
Sep 15 19:10:16.038148 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.038114    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:16.038287 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.038194    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:16.038287 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.038245    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:16.055939 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.055916    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:10:16.056142 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.056112    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 15 19:10:16.056214 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.056192    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 15 19:10:16.953595 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:16.953545    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:17.050189 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:17.050145    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" event={"ID":"76953b1d-a90d-4dde-a950-c9b8c9618e50","Type":"ContainerStarted","Data":"b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b"}
Sep 15 19:10:17.055551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:17.055506    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 15 19:10:17.055689 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:17.055574    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 15 19:10:17.445610 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:17.445565    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:10:17.445851 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:17.445750    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 19:10:17.446107 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:17.446070    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 19:10:17.644351 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:17.644300    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:17.745856 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:17.745732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:18.037498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.037387    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:18.056204 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.056159    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 15 19:10:18.056683 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.056238    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 15 19:10:18.328225 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.328105    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"]
Sep 15 19:10:18.349169 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.349138    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.352894 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.352853    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-501bed-openshift-default-dockercfg-hwxps\""
Sep 15 19:10:18.363140 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.363111    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"]
Sep 15 19:10:18.375786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.375748    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:18.391201 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-socket\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.391201 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391200    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-podinfo\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.391412 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istiod-ca-cert\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.391412 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-certs\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.391412 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391283    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb8hv\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-kube-api-access-tb8hv\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.391412 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391307    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-envoy\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.391412 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391343    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-token\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.391412 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391381    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-data\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.391412 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.391397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-credential-socket\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.446206 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.446169    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 19:10:18.446497 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.446468    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 19:10:18.492385 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.492348    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-data\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.492631 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.492610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-credential-socket\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.492795 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.492778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-socket\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.492944 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.492925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-podinfo\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493040 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.493019    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-socket\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493184 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.492879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-credential-socket\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493184 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.492704    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-data\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493270 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.493047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istiod-ca-cert\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493396 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.493376    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-certs\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.493512    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb8hv\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-kube-api-access-tb8hv\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493613 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.493604    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-envoy\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493704 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.493692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-token\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493861 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.493697    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-certs\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.493968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.493729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istiod-ca-cert\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.496037 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.496014    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-envoy\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.496505 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.496484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-podinfo\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.512790 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.512757    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb8hv\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-kube-api-access-tb8hv\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.517368 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.517328    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-token\") pod \"e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") " pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.529470 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.529426    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:18.638070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.637948    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:18.679169 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.679139    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:18.996972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:18.996945    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"]
Sep 15 19:10:18.998226 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:10:18.998189    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba0b409_3253_44a1_a89b_4fc4bb835b01.slice/crio-1a8c9c5b3e14d56d2d905ae8290db44d03ab758de4abe2cf719ba596adb2bc38 WatchSource:0}: Error finding container 1a8c9c5b3e14d56d2d905ae8290db44d03ab758de4abe2cf719ba596adb2bc38: Status 404 returned error can't find the container with id 1a8c9c5b3e14d56d2d905ae8290db44d03ab758de4abe2cf719ba596adb2bc38
Sep 15 19:10:19.000541 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.000510    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:19.000621 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.000572    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:19.000621 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.000600    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:19.056567 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.056519    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 15 19:10:19.056994 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.056590    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 15 19:10:19.071682 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.071644    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" event={"ID":"1ba0b409-3253-44a1-a89b-4fc4bb835b01","Type":"ContainerStarted","Data":"1a8c9c5b3e14d56d2d905ae8290db44d03ab758de4abe2cf719ba596adb2bc38"}
Sep 15 19:10:19.164012 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.163969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:19.445526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.445477    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 19:10:19.445744 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.445564    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 19:10:19.710690 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.710589    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:19.815845 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:19.815777    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:20.037283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.037187    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:20.056092 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.056053    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 15 19:10:20.056369 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.056340    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 15 19:10:20.079599 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.079564    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" event={"ID":"1ba0b409-3253-44a1-a89b-4fc4bb835b01","Type":"ContainerStarted","Data":"32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d"}
Sep 15 19:10:20.100309 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.100258    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" podStartSLOduration=2.100233253 podStartE2EDuration="2.100233253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:10:20.09888145 +0000 UTC m=+1195.047109776" watchObservedRunningTime="2026-09-15 19:10:20.100233253 +0000 UTC m=+1195.048461579"
Sep 15 19:10:20.364917 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.361258    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:20.446379 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.446333    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 19:10:20.446688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.446628    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 19:10:20.578994 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.578964    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:20.679961 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.679920    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:20.685007 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:20.684973    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:21.055766 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.055676    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 15 19:10:21.055766 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.055733    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 15 19:10:21.087148 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.087108    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:21.088223 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.088198    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:21.183540 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.183489    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:21.445560 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.445512    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 15 19:10:21.445766 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.445584    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 15 19:10:21.470649 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.470614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:21.856408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:21.856319    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:10:22.060373 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:22.060336    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:10:22.095833 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:22.095781    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:10:22.184830 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:22.184777    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:22.283868 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:22.283831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:22.383873 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:22.383819    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:22.450156 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:22.450071    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:10:22.450405 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:22.450385    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:10:22.452902 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:22.452879    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:10:23.270723 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:23.270691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:23.579315 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:23.579227    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:23.672651 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:23.672619    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:24.063012 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:24.062975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:24.877821 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:24.877760    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:25.554290 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:25.554252    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:10:25.601633 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:25.601605    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:10:25.603466 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:25.603433    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:10:25.684120 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:25.684091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:25.784751 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:25.784710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:26.265086 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.265057    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:26.338782 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.338746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:26.340629 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.340605    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"]
Sep 15 19:10:26.345741 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.345725    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:26.347832 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.347778    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-33ff04\""
Sep 15 19:10:26.356854 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.356828    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"]
Sep 15 19:10:26.489913 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.489872    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdd18f23-9f51-4e18-8b1a-a88a105797c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9\" (UID: \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:26.490226 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.490203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdhb\" (UniqueName: \"kubernetes.io/projected/cdd18f23-9f51-4e18-8b1a-a88a105797c8-kube-api-access-hzdhb\") pod \"payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9\" (UID: \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:26.591664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.591571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdd18f23-9f51-4e18-8b1a-a88a105797c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9\" (UID: \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:26.591664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.591611    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdhb\" (UniqueName: \"kubernetes.io/projected/cdd18f23-9f51-4e18-8b1a-a88a105797c8-kube-api-access-hzdhb\") pod \"payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9\" (UID: \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:26.592340 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.592320    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdd18f23-9f51-4e18-8b1a-a88a105797c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9\" (UID: \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:26.599041 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.599012    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdhb\" (UniqueName: \"kubernetes.io/projected/cdd18f23-9f51-4e18-8b1a-a88a105797c8-kube-api-access-hzdhb\") pod \"payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9\" (UID: \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:26.658016 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.657977    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:26.779419 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.779363    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:26.930212 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:26.930181    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"]
Sep 15 19:10:26.931369 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:10:26.931342    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd18f23_9f51_4e18_8b1a_a88a105797c8.slice/crio-1460fa5056cb0b060cb9c71001377df372228a83ac23bac4ac349f7482a651c8 WatchSource:0}: Error finding container 1460fa5056cb0b060cb9c71001377df372228a83ac23bac4ac349f7482a651c8: Status 404 returned error can't find the container with id 1460fa5056cb0b060cb9c71001377df372228a83ac23bac4ac349f7482a651c8
Sep 15 19:10:27.127622 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:27.127585    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9" event={"ID":"cdd18f23-9f51-4e18-8b1a-a88a105797c8","Type":"ContainerStarted","Data":"c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395"}
Sep 15 19:10:27.127801 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:27.127651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9" event={"ID":"cdd18f23-9f51-4e18-8b1a-a88a105797c8","Type":"ContainerStarted","Data":"1460fa5056cb0b060cb9c71001377df372228a83ac23bac4ac349f7482a651c8"}
Sep 15 19:10:27.127801 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:27.127682    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:27.142021 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:27.141974    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9" podStartSLOduration=1.141959035 podStartE2EDuration="1.141959035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:10:27.140473438 +0000 UTC m=+1202.088701765" watchObservedRunningTime="2026-09-15 19:10:27.141959035 +0000 UTC m=+1202.090187421"
Sep 15 19:10:27.655069 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:27.655031    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:28.198065 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.198035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:28.299054 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.299022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:28.404065 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.404035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:28.722641 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.722607    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:28.827608 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.827569    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:28.832311 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.832281    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"]
Sep 15 19:10:28.836048 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.836026    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:28.838042 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.838021    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w1-501bed-dockercfg-86j6w\""
Sep 15 19:10:28.838163 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.838081    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w1-501bed\""
Sep 15 19:10:28.845848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.845825    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"]
Sep 15 19:10:28.869389 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.869356    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"]
Sep 15 19:10:28.872772 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.872751    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:28.880663 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.880642    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"]
Sep 15 19:10:28.915194 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.915163    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcqhd\" (UniqueName: \"kubernetes.io/projected/a21ed03a-7bd7-493c-a429-8c5808bf8740-kube-api-access-kcqhd\") pod \"payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm\" (UID: \"a21ed03a-7bd7-493c-a429-8c5808bf8740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:28.915382 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:28.915297    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21ed03a-7bd7-493c-a429-8c5808bf8740-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm\" (UID: \"a21ed03a-7bd7-493c-a429-8c5808bf8740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:29.016564 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.016468    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c11a4a1-5a39-451f-9af6-636159c3b2b8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn\" (UID: \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:29.016564 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.016528    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21ed03a-7bd7-493c-a429-8c5808bf8740-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm\" (UID: \"a21ed03a-7bd7-493c-a429-8c5808bf8740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:29.016773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.016584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l98bh\" (UniqueName: \"kubernetes.io/projected/2c11a4a1-5a39-451f-9af6-636159c3b2b8-kube-api-access-l98bh\") pod \"payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn\" (UID: \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:29.016773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.016619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcqhd\" (UniqueName: \"kubernetes.io/projected/a21ed03a-7bd7-493c-a429-8c5808bf8740-kube-api-access-kcqhd\") pod \"payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm\" (UID: \"a21ed03a-7bd7-493c-a429-8c5808bf8740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:29.017340 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.017318    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21ed03a-7bd7-493c-a429-8c5808bf8740-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm\" (UID: \"a21ed03a-7bd7-493c-a429-8c5808bf8740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:29.024711 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.024683    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcqhd\" (UniqueName: \"kubernetes.io/projected/a21ed03a-7bd7-493c-a429-8c5808bf8740-kube-api-access-kcqhd\") pod \"payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm\" (UID: \"a21ed03a-7bd7-493c-a429-8c5808bf8740\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:29.117859 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.117799    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c11a4a1-5a39-451f-9af6-636159c3b2b8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn\" (UID: \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:29.118041 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.117957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l98bh\" (UniqueName: \"kubernetes.io/projected/2c11a4a1-5a39-451f-9af6-636159c3b2b8-kube-api-access-l98bh\") pod \"payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn\" (UID: \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:29.118577 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.118559    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c11a4a1-5a39-451f-9af6-636159c3b2b8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn\" (UID: \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:29.123346 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.123325    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:29.125304 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.125283    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l98bh\" (UniqueName: \"kubernetes.io/projected/2c11a4a1-5a39-451f-9af6-636159c3b2b8-kube-api-access-l98bh\") pod \"payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn\" (UID: \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:29.147764 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.147739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:29.184746 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.184721    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:29.433248 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:10:29.433205    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21ed03a_7bd7_493c_a429_8c5808bf8740.slice/crio-9983d6f21d5dc489072b9525aea7275b7c542b3ad5fc9080104b0ebd446552fb WatchSource:0}: Error finding container 9983d6f21d5dc489072b9525aea7275b7c542b3ad5fc9080104b0ebd446552fb: Status 404 returned error can't find the container with id 9983d6f21d5dc489072b9525aea7275b7c542b3ad5fc9080104b0ebd446552fb
Sep 15 19:10:29.433498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.433472    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"]
Sep 15 19:10:29.487706 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:29.487685    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"]
Sep 15 19:10:29.489228 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:10:29.489200    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c11a4a1_5a39_451f_9af6_636159c3b2b8.slice/crio-70993fc967bc60b4a2bef13ffc8b712b308623fe4bf71c0638dcc73088391ce9 WatchSource:0}: Error finding container 70993fc967bc60b4a2bef13ffc8b712b308623fe4bf71c0638dcc73088391ce9: Status 404 returned error can't find the container with id 70993fc967bc60b4a2bef13ffc8b712b308623fe4bf71c0638dcc73088391ce9
Sep 15 19:10:30.034974 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.034924    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:30.152908 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.152863    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm" event={"ID":"a21ed03a-7bd7-493c-a429-8c5808bf8740","Type":"ContainerStarted","Data":"037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2"}
Sep 15 19:10:30.153093 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.152935    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm" event={"ID":"a21ed03a-7bd7-493c-a429-8c5808bf8740","Type":"ContainerStarted","Data":"9983d6f21d5dc489072b9525aea7275b7c542b3ad5fc9080104b0ebd446552fb"}
Sep 15 19:10:30.153775 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.153751    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:30.155864 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.155831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn" event={"ID":"2c11a4a1-5a39-451f-9af6-636159c3b2b8","Type":"ContainerStarted","Data":"c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef"}
Sep 15 19:10:30.155966 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.155883    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn" event={"ID":"2c11a4a1-5a39-451f-9af6-636159c3b2b8","Type":"ContainerStarted","Data":"70993fc967bc60b4a2bef13ffc8b712b308623fe4bf71c0638dcc73088391ce9"}
Sep 15 19:10:30.156381 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.156357    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:30.171125 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.171081    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm" podStartSLOduration=2.171068739 podStartE2EDuration="2.171068739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:10:30.168101856 +0000 UTC m=+1205.116330185" watchObservedRunningTime="2026-09-15 19:10:30.171068739 +0000 UTC m=+1205.119297113"
Sep 15 19:10:30.183959 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:30.183914    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn" podStartSLOduration=2.183903588 podStartE2EDuration="2.183903588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:10:30.183391812 +0000 UTC m=+1205.131620164" watchObservedRunningTime="2026-09-15 19:10:30.183903588 +0000 UTC m=+1205.132131919"
Sep 15 19:10:38.136200 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:38.136165    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:10:42.171367 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:42.171334    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:10:42.171862 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:42.171419    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:10:47.671480 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:47.671439    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:49.296618 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:49.296587    2572 generic.go:356] "Generic (PLEG): container finished" podID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerID="32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d" exitCode=0
Sep 15 19:10:49.297164 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:49.296670    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" event={"ID":"1ba0b409-3253-44a1-a89b-4fc4bb835b01","Type":"ContainerDied","Data":"32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d"}
Sep 15 19:10:49.297233 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:49.297219    2572 scope.go:117] "RemoveContainer" containerID="32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d"
Sep 15 19:10:49.298384 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:49.298357    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:49.298474 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:49.298420    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:49.298474 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:49.298454    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:10:49.640604 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:49.640476    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:50.304968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:50.304933    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" event={"ID":"1ba0b409-3253-44a1-a89b-4fc4bb835b01","Type":"ContainerStarted","Data":"8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c"}
Sep 15 19:10:50.390897 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:50.390860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:50.679554 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:50.679519    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:50.680878 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:50.680851    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 15 19:10:50.680999 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:50.680899    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 15 19:10:51.087567 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:51.087474    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:51.266449 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:51.266413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:51.680138 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:51.680103    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 15 19:10:51.680527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:51.680159    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 15 19:10:51.973254 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:51.973154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:52.099796 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:52.099763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:52.665852 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:52.665788    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:52.679933 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:52.679902    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 15 19:10:52.680051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:52.679950    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 15 19:10:53.380676 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:53.380628    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:53.680124 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:53.680093    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 15 19:10:53.680294 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:53.680145    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 15 19:10:54.193879 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:54.193840    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:54.679954 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:54.679926    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 15 19:10:54.680325 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:54.679973    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 15 19:10:54.890729 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:54.890693    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:55.557079 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:55.557044    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:55.684944 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:55.684915    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:55.686003 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:55.685979    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:10:56.385746 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:56.385716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:56.488479 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:56.488446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:57.567213 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:57.567171    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:10:57.667074 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:10:57.667042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:02.581470 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:02.581415    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:02.697532 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:02.697499    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"]
Sep 15 19:11:02.702577 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:02.702554    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"
Sep 15 19:11:02.704839 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:02.704793    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:11:02.707493 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:02.707472    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"]
Sep 15 19:11:02.748281 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:02.748257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8313de52-81b9-44ca-b49f-2d7ac2a8e4ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz\" (UID: \"8313de52-81b9-44ca-b49f-2d7ac2a8e4ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"
Sep 15 19:11:02.849294 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:02.849236    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8313de52-81b9-44ca-b49f-2d7ac2a8e4ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz\" (UID: \"8313de52-81b9-44ca-b49f-2d7ac2a8e4ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"
Sep 15 19:11:02.849872 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:02.849850    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8313de52-81b9-44ca-b49f-2d7ac2a8e4ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz\" (UID: \"8313de52-81b9-44ca-b49f-2d7ac2a8e4ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"
Sep 15 19:11:03.016512 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.016486    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"
Sep 15 19:11:03.028453 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.028423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:03.288750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.288724    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"]
Sep 15 19:11:03.290121 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:11:03.290093    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8313de52_81b9_44ca_b49f_2d7ac2a8e4ab.slice/crio-cc30843afab953829bd0ae0dd3bc65175229abaa146c2925be43218c5636ba81 WatchSource:0}: Error finding container cc30843afab953829bd0ae0dd3bc65175229abaa146c2925be43218c5636ba81: Status 404 returned error can't find the container with id cc30843afab953829bd0ae0dd3bc65175229abaa146c2925be43218c5636ba81
Sep 15 19:11:03.396336 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.396308    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz" event={"ID":"8313de52-81b9-44ca-b49f-2d7ac2a8e4ab","Type":"ContainerStarted","Data":"cc30843afab953829bd0ae0dd3bc65175229abaa146c2925be43218c5636ba81"}
Sep 15 19:11:03.401292 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.401272    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:03.636379 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.636351    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"]
Sep 15 19:11:03.640367 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.640346    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.642462 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.642446    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d2e6cc70-openshift-default-dockercfg-qbvr5\""
Sep 15 19:11:03.653923 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.653898    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"]
Sep 15 19:11:03.665424 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.665401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:03.763873 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.763799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-certs\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.764188 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.764165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-data\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.764340 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.764325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefc281b-de67-43a0-b43b-02008faf8de4-istiod-ca-cert\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.764472 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.764456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgmqb\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-kube-api-access-vgmqb\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.764591 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.764576    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-credential-socket\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.764722 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.764708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-envoy\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.764853 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.764835    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefc281b-de67-43a0-b43b-02008faf8de4-istio-podinfo\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.765043 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.765021    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-istio-token\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.765195 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.765181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-socket\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.809158 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.809130    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:03.866325 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.866245    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-credential-socket\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.866544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.866523    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-envoy\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.866861 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.866839    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefc281b-de67-43a0-b43b-02008faf8de4-istio-podinfo\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.867514 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.867494    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-istio-token\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.868290 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.868269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-socket\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.869005 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.868984    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-certs\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.869169 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.869149    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-data\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.870997 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.870979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefc281b-de67-43a0-b43b-02008faf8de4-istiod-ca-cert\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.871853 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.871832    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgmqb\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-kube-api-access-vgmqb\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.872339 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.868885    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-socket\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.872484 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.870108    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefc281b-de67-43a0-b43b-02008faf8de4-istio-podinfo\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.872599 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.870380    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-envoy\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.872599 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.871358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-data\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.872835 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.871722    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefc281b-de67-43a0-b43b-02008faf8de4-istiod-ca-cert\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.872835 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.869551    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-certs\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.872835 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.866692    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-credential-socket\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.876079 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.876058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-istio-token\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.879246 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.879223    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgmqb\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-kube-api-access-vgmqb\") pod \"e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") " pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.952584 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.952564    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:03.981068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:03.981036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:04.246343 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.246316    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"]
Sep 15 19:11:04.248464 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:11:04.248438    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefc281b_de67_43a0_b43b_02008faf8de4.slice/crio-92c265fa4d4a80f7fd36b351061e43d58dcec47262ec7c43709d8d3c4e03bdf8 WatchSource:0}: Error finding container 92c265fa4d4a80f7fd36b351061e43d58dcec47262ec7c43709d8d3c4e03bdf8: Status 404 returned error can't find the container with id 92c265fa4d4a80f7fd36b351061e43d58dcec47262ec7c43709d8d3c4e03bdf8
Sep 15 19:11:04.250895 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.250861    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:11:04.250965 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.250930    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:11:04.250965 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.250960    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:11:04.406235 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.406179    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" event={"ID":"eefc281b-de67-43a0-b43b-02008faf8de4","Type":"ContainerStarted","Data":"0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6"}
Sep 15 19:11:04.406418 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.406258    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" event={"ID":"eefc281b-de67-43a0-b43b-02008faf8de4","Type":"ContainerStarted","Data":"92c265fa4d4a80f7fd36b351061e43d58dcec47262ec7c43709d8d3c4e03bdf8"}
Sep 15 19:11:04.408015 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.407983    2572 generic.go:356] "Generic (PLEG): container finished" podID="8313de52-81b9-44ca-b49f-2d7ac2a8e4ab" containerID="ff5ad0d82be674508b409c0392d4f92374f8840694a03a128bc49b1290cb3db7" exitCode=0
Sep 15 19:11:04.408133 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.408038    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz" event={"ID":"8313de52-81b9-44ca-b49f-2d7ac2a8e4ab","Type":"ContainerDied","Data":"ff5ad0d82be674508b409c0392d4f92374f8840694a03a128bc49b1290cb3db7"}
Sep 15 19:11:04.427688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.427637    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" podStartSLOduration=1.427622706 podStartE2EDuration="1.427622706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:11:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:11:04.42606364 +0000 UTC m=+1239.374291967" watchObservedRunningTime="2026-09-15 19:11:04.427622706 +0000 UTC m=+1239.375851031"
Sep 15 19:11:04.770936 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.770901    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:04.953056 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:04.953024    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:05.555133 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:05.555106    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"
Sep 15 19:11:05.659314 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:05.659279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:05.693558 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:05.693473    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8313de52-81b9-44ca-b49f-2d7ac2a8e4ab-maas-api-service-ca\") pod \"8313de52-81b9-44ca-b49f-2d7ac2a8e4ab\" (UID: \"8313de52-81b9-44ca-b49f-2d7ac2a8e4ab\") "
Sep 15 19:11:05.693848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:05.693786    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8313de52-81b9-44ca-b49f-2d7ac2a8e4ab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8313de52-81b9-44ca-b49f-2d7ac2a8e4ab" (UID: "8313de52-81b9-44ca-b49f-2d7ac2a8e4ab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:11:05.694108 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:05.694092    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8313de52-81b9-44ca-b49f-2d7ac2a8e4ab-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:05.958935 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:05.958854    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:06.316329 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:06.316239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:06.414603 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:06.414564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:06.422232 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:06.422209    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"
Sep 15 19:11:06.422389 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:06.422235    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz" event={"ID":"8313de52-81b9-44ca-b49f-2d7ac2a8e4ab","Type":"ContainerDied","Data":"cc30843afab953829bd0ae0dd3bc65175229abaa146c2925be43218c5636ba81"}
Sep 15 19:11:06.422389 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:06.422282    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc30843afab953829bd0ae0dd3bc65175229abaa146c2925be43218c5636ba81"
Sep 15 19:11:06.422678 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:06.422660    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:06.423539 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:06.423518    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:06.515726 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:06.515696    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:07.284265 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:07.284221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:07.713252 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:07.713211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:08.125457 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:08.125355    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:08.949251 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:08.949204    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:09.694785 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:09.694744    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:09.790068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:09.790035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:10.152783 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:10.152689    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:10.253567 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:10.253530    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:10.682961 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:10.682927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:11.367863 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:11.367827    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:12.176779 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:12.176745    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:12.875869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:12.875834    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:18.456393 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.456315    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:18.473949 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.473916    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"]
Sep 15 19:11:18.474173 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.474145    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl" podUID="0a36cc1c-c175-46a6-ab7e-f757a79de411" containerName="payload-processing" containerID="cri-o://4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272" gracePeriod=30
Sep 15 19:11:18.556946 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.556910    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:18.666022 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.659781    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:18.674456 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.674386    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"]
Sep 15 19:11:18.687621 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.687582    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-7c96ca-mrnnz"]
Sep 15 19:11:18.757672 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.757625    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:18.776303 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.776267    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:11:18.834982 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.834938    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a36cc1c-c175-46a6-ab7e-f757a79de411-plugins-config-volume\") pod \"0a36cc1c-c175-46a6-ab7e-f757a79de411\" (UID: \"0a36cc1c-c175-46a6-ab7e-f757a79de411\") "
Sep 15 19:11:18.834982 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.834989    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p98tr\" (UniqueName: \"kubernetes.io/projected/0a36cc1c-c175-46a6-ab7e-f757a79de411-kube-api-access-p98tr\") pod \"0a36cc1c-c175-46a6-ab7e-f757a79de411\" (UID: \"0a36cc1c-c175-46a6-ab7e-f757a79de411\") "
Sep 15 19:11:18.835409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.835377    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a36cc1c-c175-46a6-ab7e-f757a79de411-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a36cc1c-c175-46a6-ab7e-f757a79de411" (UID: "0a36cc1c-c175-46a6-ab7e-f757a79de411"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:11:18.837128 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.837102    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a36cc1c-c175-46a6-ab7e-f757a79de411-kube-api-access-p98tr" (OuterVolumeSpecName: "kube-api-access-p98tr") pod "0a36cc1c-c175-46a6-ab7e-f757a79de411" (UID: "0a36cc1c-c175-46a6-ab7e-f757a79de411"). InnerVolumeSpecName "kube-api-access-p98tr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:11:18.936067 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.936023    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a36cc1c-c175-46a6-ab7e-f757a79de411-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:18.936067 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:18.936060    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p98tr\" (UniqueName: \"kubernetes.io/projected/0a36cc1c-c175-46a6-ab7e-f757a79de411-kube-api-access-p98tr\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:19.030110 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.030011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:19.087557 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.087519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:19.511175 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.511138    2572 generic.go:356] "Generic (PLEG): container finished" podID="0a36cc1c-c175-46a6-ab7e-f757a79de411" containerID="4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272" exitCode=0
Sep 15 19:11:19.511175 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.511178    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"
Sep 15 19:11:19.511741 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.511220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl" event={"ID":"0a36cc1c-c175-46a6-ab7e-f757a79de411","Type":"ContainerDied","Data":"4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272"}
Sep 15 19:11:19.511741 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.511297    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl" event={"ID":"0a36cc1c-c175-46a6-ab7e-f757a79de411","Type":"ContainerDied","Data":"3ae310a1abd59aebcd880f026e0261423f5182412c38c6bdb55bc04bdb1de0ef"}
Sep 15 19:11:19.511741 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.511322    2572 scope.go:117] "RemoveContainer" containerID="4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272"
Sep 15 19:11:19.521901 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.521877    2572 scope.go:117] "RemoveContainer" containerID="4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272"
Sep 15 19:11:19.522210 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:11:19.522188    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272\": container with ID starting with 4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272 not found: ID does not exist" containerID="4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272"
Sep 15 19:11:19.522284 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.522243    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272"} err="failed to get container status \"4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272\": rpc error: code = NotFound desc = could not find container \"4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272\": container with ID starting with 4666f551f837b36b8102ceedc64b76ce7afb1d22f61d25c11cfa06b0bc894272 not found: ID does not exist"
Sep 15 19:11:19.534978 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.534940    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"]
Sep 15 19:11:19.541250 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.541221    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-7c96ca-6c995dd895-tv8sl"]
Sep 15 19:11:19.558399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.558367    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a36cc1c-c175-46a6-ab7e-f757a79de411" path="/var/lib/kubelet/pods/0a36cc1c-c175-46a6-ab7e-f757a79de411/volumes"
Sep 15 19:11:19.558863 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.558844    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8313de52-81b9-44ca-b49f-2d7ac2a8e4ab" path="/var/lib/kubelet/pods/8313de52-81b9-44ca-b49f-2d7ac2a8e4ab/volumes"
Sep 15 19:11:19.691547 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:19.691514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:20.427139 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:20.427102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:21.365574 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:21.365539    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:21.960500 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:21.960465    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:22.551859 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:22.551794    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:11:22.587509 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:22.587475    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:23.459336 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:23.459297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:24.275436 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:24.275403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:24.965210 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:24.965153    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:25.409592 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:25.409550    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:25.510934 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:25.510889    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:25.666362 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:25.666265    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"]
Sep 15 19:11:25.666558 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:25.666525    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" containerID="cri-o://47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215" gracePeriod=30
Sep 15 19:11:25.675793 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:25.675761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:25.702072 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:25.702041    2572 scope.go:117] "RemoveContainer" containerID="5792729e2de8b6860711e6c2e192f5ec81bc7dc3d7230384d5d724134fe03e19"
Sep 15 19:11:25.754698 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:25.754668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:26.201610 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:26.201570    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:26.450166 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:26.450126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:27.803917 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:27.803877    2572 patch_prober.go:28] interesting pod/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 19:11:27.804372 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:27.803955    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 19:11:30.629711 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:30.629667    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:30.936104 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:30.936075    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:11:31.074214 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074172    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-socket\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074233    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-data\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074307    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-token\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074325    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-credential-socket\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074351    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-envoy\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074380    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-podinfo\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074406    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istiod-ca-cert\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074453    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqwkl\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-kube-api-access-zqwkl\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074509    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-certs\") pod \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\" (UID: \"4d5f211a-cac3-4d6c-98d5-3228fa8cf759\") "
Sep 15 19:11:31.074737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074540    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:11:31.074737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074623    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:11:31.074737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074667    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:11:31.075126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074870    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:11:31.075126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074927    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:11:31.075126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074949    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.075126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074969    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.075126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074983    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.075126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.074997    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.077166 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.077138    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-kube-api-access-zqwkl" (OuterVolumeSpecName: "kube-api-access-zqwkl") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "kube-api-access-zqwkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:11:31.077297 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.077278    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:11:31.077351 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.077302    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:11:31.077489 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.077464    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d5f211a-cac3-4d6c-98d5-3228fa8cf759" (UID: "4d5f211a-cac3-4d6c-98d5-3228fa8cf759"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:11:31.175791 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.175696    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.175791 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.175730    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.175791 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.175739    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.175791 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.175749    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.175791 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.175758    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqwkl\" (UniqueName: \"kubernetes.io/projected/4d5f211a-cac3-4d6c-98d5-3228fa8cf759-kube-api-access-zqwkl\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:11:31.600039 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.600003    2572 generic.go:356] "Generic (PLEG): container finished" podID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerID="47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215" exitCode=0
Sep 15 19:11:31.600229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.600123    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"
Sep 15 19:11:31.600229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.600141    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" event={"ID":"4d5f211a-cac3-4d6c-98d5-3228fa8cf759","Type":"ContainerDied","Data":"47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215"}
Sep 15 19:11:31.600229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.600190    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5" event={"ID":"4d5f211a-cac3-4d6c-98d5-3228fa8cf759","Type":"ContainerDied","Data":"5e3c641759d922ffc3116abf9a793593a77e9875fa4dd657064302f1ab1794db"}
Sep 15 19:11:31.600229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.600213    2572 scope.go:117] "RemoveContainer" containerID="47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215"
Sep 15 19:11:31.610065 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.610041    2572 scope.go:117] "RemoveContainer" containerID="34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00"
Sep 15 19:11:31.620026 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.619990    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"]
Sep 15 19:11:31.621991 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.621962    2572 scope.go:117] "RemoveContainer" containerID="47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215"
Sep 15 19:11:31.622312 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:11:31.622291    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215\": container with ID starting with 47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215 not found: ID does not exist" containerID="47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215"
Sep 15 19:11:31.622404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.622318    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215"} err="failed to get container status \"47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215\": rpc error: code = NotFound desc = could not find container \"47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215\": container with ID starting with 47fb0953efa60e740b24e9f30fc496add29532a358ea425056907b03aa583215 not found: ID does not exist"
Sep 15 19:11:31.622404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.622338    2572 scope.go:117] "RemoveContainer" containerID="34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00"
Sep 15 19:11:31.622657 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:11:31.622636    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00\": container with ID starting with 34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00 not found: ID does not exist" containerID="34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00"
Sep 15 19:11:31.622730 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.622662    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00"} err="failed to get container status \"34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00\": rpc error: code = NotFound desc = could not find container \"34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00\": container with ID starting with 34dbb427f172cb8184672295bbaddc9b5c0435c216a958292238429ef9498c00 not found: ID does not exist"
Sep 15 19:11:31.623556 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:31.623532    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-7c96ca-openshift-default-78cf477b8-mkhz5"]
Sep 15 19:11:33.558623 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:33.558586    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" path="/var/lib/kubelet/pods/4d5f211a-cac3-4d6c-98d5-3228fa8cf759/volumes"
Sep 15 19:11:33.621348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:33.621313    2572 generic.go:356] "Generic (PLEG): container finished" podID="eefc281b-de67-43a0-b43b-02008faf8de4" containerID="0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6" exitCode=0
Sep 15 19:11:33.621531 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:33.621351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" event={"ID":"eefc281b-de67-43a0-b43b-02008faf8de4","Type":"ContainerDied","Data":"0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6"}
Sep 15 19:11:33.621783 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:33.621769    2572 scope.go:117] "RemoveContainer" containerID="0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6"
Sep 15 19:11:33.622942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:33.622914    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:11:33.623000 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:33.622983    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:11:33.623036 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:33.623013    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:11:34.635604 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:34.635565    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" event={"ID":"eefc281b-de67-43a0-b43b-02008faf8de4","Type":"ContainerStarted","Data":"694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336"}
Sep 15 19:11:34.953113 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:34.953073    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:34.954491 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:34.954460    2572 patch_prober.go:28] interesting pod/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 19:11:34.954608 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:34.954514    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 19:11:35.953931 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:35.953892    2572 patch_prober.go:28] interesting pod/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 19:11:35.954353 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:35.953955    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 19:11:36.423196 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:36.423129    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:36.953552 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:36.953512    2572 patch_prober.go:28] interesting pod/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 19:11:36.953767 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:36.953572    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 19:11:37.954031 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:37.953986    2572 patch_prober.go:28] interesting pod/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 19:11:37.954477 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:37.954079    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 19:11:38.953748 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:38.953711    2572 patch_prober.go:28] interesting pod/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 15 19:11:38.954003 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:38.953787    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 15 19:11:39.957257 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:39.957221    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:39.958306 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:39.958285    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:11:43.551666 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:43.551631    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:11:44.985564 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:44.985524    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:45.076973 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:45.076938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:45.325593 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:45.325497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:51.103365 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:51.103331    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:51.203739 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:51.203700    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:52.760630 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:52.760592    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:11:59.948051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:11:59.948014    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:12:05.865972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:12:05.865931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:12:14.449282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:12:14.449247    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:12:16.663135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:12:16.663102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:12:25.747533 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:12:25.747496    2572 scope.go:117] "RemoveContainer" containerID="fe6199426707f3bcd5438973c259737b07267bcc1aef9808841c3aff7a5ba2b7"
Sep 15 19:12:25.756899 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:12:25.756874    2572 scope.go:117] "RemoveContainer" containerID="23a021c8680ec3bed0a9ab7aef27b7d166afd6d0e3c70461a037b3a68b2b1443"
Sep 15 19:12:41.552090 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:12:41.552052    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:12:51.856900 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:12:51.856783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:05.555967 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:05.555934    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:13:08.079563 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.079528    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"]
Sep 15 19:13:08.080007 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.079978    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy"
Sep 15 19:13:08.080007 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.079990    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy"
Sep 15 19:13:08.080007 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.080003    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a36cc1c-c175-46a6-ab7e-f757a79de411" containerName="payload-processing"
Sep 15 19:13:08.080007 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.080009    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a36cc1c-c175-46a6-ab7e-f757a79de411" containerName="payload-processing"
Sep 15 19:13:08.080144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.080021    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8313de52-81b9-44ca-b49f-2d7ac2a8e4ab" containerName="revoke-keys"
Sep 15 19:13:08.080144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.080027    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8313de52-81b9-44ca-b49f-2d7ac2a8e4ab" containerName="revoke-keys"
Sep 15 19:13:08.080144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.080105    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy"
Sep 15 19:13:08.080144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.080112    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a36cc1c-c175-46a6-ab7e-f757a79de411" containerName="payload-processing"
Sep 15 19:13:08.080144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.080120    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy"
Sep 15 19:13:08.080144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.080127    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8313de52-81b9-44ca-b49f-2d7ac2a8e4ab" containerName="revoke-keys"
Sep 15 19:13:08.083423 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.083407    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"
Sep 15 19:13:08.085287 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.085263    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:13:08.091093 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.091068    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"]
Sep 15 19:13:08.182425 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.182380    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1cf407-63f5-488a-83c0-383f496baed2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l\" (UID: \"7c1cf407-63f5-488a-83c0-383f496baed2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"
Sep 15 19:13:08.283451 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.283410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1cf407-63f5-488a-83c0-383f496baed2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l\" (UID: \"7c1cf407-63f5-488a-83c0-383f496baed2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"
Sep 15 19:13:08.284055 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.284033    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1cf407-63f5-488a-83c0-383f496baed2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l\" (UID: \"7c1cf407-63f5-488a-83c0-383f496baed2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"
Sep 15 19:13:08.395800 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.395706    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"
Sep 15 19:13:08.670512 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.670479    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"]
Sep 15 19:13:08.671501 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:13:08.671472    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1cf407_63f5_488a_83c0_383f496baed2.slice/crio-2c002ba0f9217354121d65f18f6741ca3e2059ef44f4c41eac3e167d1c492781 WatchSource:0}: Error finding container 2c002ba0f9217354121d65f18f6741ca3e2059ef44f4c41eac3e167d1c492781: Status 404 returned error can't find the container with id 2c002ba0f9217354121d65f18f6741ca3e2059ef44f4c41eac3e167d1c492781
Sep 15 19:13:08.744066 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:08.744034    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:09.228238 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:09.228204    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l" event={"ID":"7c1cf407-63f5-488a-83c0-383f496baed2","Type":"ContainerStarted","Data":"0ce3ab9ffef6fe3ba9f496b0b9258e7a18a6d6076273039a0c63383873f626f9"}
Sep 15 19:13:09.228611 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:09.228296    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l" event={"ID":"7c1cf407-63f5-488a-83c0-383f496baed2","Type":"ContainerStarted","Data":"2c002ba0f9217354121d65f18f6741ca3e2059ef44f4c41eac3e167d1c492781"}
Sep 15 19:13:09.244526 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:09.244467    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l" podStartSLOduration=1.244450718 podStartE2EDuration="1.244450718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:13:09.241221548 +0000 UTC m=+1364.189449896" watchObservedRunningTime="2026-09-15 19:13:09.244450718 +0000 UTC m=+1364.192679060"
Sep 15 19:13:09.388141 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:09.388055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:10.068887 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:10.068845    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:10.235789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:10.235752    2572 generic.go:356] "Generic (PLEG): container finished" podID="7c1cf407-63f5-488a-83c0-383f496baed2" containerID="0ce3ab9ffef6fe3ba9f496b0b9258e7a18a6d6076273039a0c63383873f626f9" exitCode=0
Sep 15 19:13:10.236235 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:10.235846    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l" event={"ID":"7c1cf407-63f5-488a-83c0-383f496baed2","Type":"ContainerDied","Data":"0ce3ab9ffef6fe3ba9f496b0b9258e7a18a6d6076273039a0c63383873f626f9"}
Sep 15 19:13:10.948263 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:10.948196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:11.383651 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:11.383625    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"
Sep 15 19:13:11.515952 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:11.515865    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1cf407-63f5-488a-83c0-383f496baed2-maas-api-service-ca\") pod \"7c1cf407-63f5-488a-83c0-383f496baed2\" (UID: \"7c1cf407-63f5-488a-83c0-383f496baed2\") "
Sep 15 19:13:11.516217 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:11.516193    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c1cf407-63f5-488a-83c0-383f496baed2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c1cf407-63f5-488a-83c0-383f496baed2" (UID: "7c1cf407-63f5-488a-83c0-383f496baed2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:13:11.616985 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:11.616948    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1cf407-63f5-488a-83c0-383f496baed2-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:13:11.784952 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:11.784869    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:12.249234 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:12.249199    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"
Sep 15 19:13:12.249420 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:12.249233    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l" event={"ID":"7c1cf407-63f5-488a-83c0-383f496baed2","Type":"ContainerDied","Data":"2c002ba0f9217354121d65f18f6741ca3e2059ef44f4c41eac3e167d1c492781"}
Sep 15 19:13:12.249420 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:12.249284    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c002ba0f9217354121d65f18f6741ca3e2059ef44f4c41eac3e167d1c492781"
Sep 15 19:13:12.394177 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:12.394136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:13.062762 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:13.062724    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:23.680282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:23.680243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:23.780462 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:23.780410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:23.872917 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:23.872875    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"]
Sep 15 19:13:23.874818 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:23.874766    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:23.875779 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:23.875760    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2e6cc70-tkh7l"]
Sep 15 19:13:23.971865 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:23.971767    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:24.333023 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:24.332933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:24.981014 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:24.980976    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:25.561901 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:25.561860    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c1cf407-63f5-488a-83c0-383f496baed2" path="/var/lib/kubelet/pods/7c1cf407-63f5-488a-83c0-383f496baed2/volumes"
Sep 15 19:13:25.758610 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:25.758570    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:25.789378 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:25.789346    2572 scope.go:117] "RemoveContainer" containerID="f522b189f2d05183f6437aa2ada39846b906b73adb755249efa22a25743f82b3"
Sep 15 19:13:26.395336 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:26.395296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:27.041209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:27.041172    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:27.262135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:27.262095    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:27.763847 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:27.763801    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:32.338767 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:32.338732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:36.832527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:36.832485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:47.010855 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.010817    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:47.106995 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.106959    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"]
Sep 15 19:13:47.107457 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.107440    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c1cf407-63f5-488a-83c0-383f496baed2" containerName="revoke-keys"
Sep 15 19:13:47.107511 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.107461    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c1cf407-63f5-488a-83c0-383f496baed2" containerName="revoke-keys"
Sep 15 19:13:47.107511 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.107472    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy"
Sep 15 19:13:47.107511 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.107478    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d5f211a-cac3-4d6c-98d5-3228fa8cf759" containerName="istio-proxy"
Sep 15 19:13:47.107604 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.107552    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c1cf407-63f5-488a-83c0-383f496baed2" containerName="revoke-keys"
Sep 15 19:13:47.112161 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.112142    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"
Sep 15 19:13:47.114056 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.114035    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:13:47.119138 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.119113    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"]
Sep 15 19:13:47.189029 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.188985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b00dcc9a-5da3-40a3-87c4-1ce3d60734e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5\" (UID: \"b00dcc9a-5da3-40a3-87c4-1ce3d60734e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"
Sep 15 19:13:47.276619 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.276495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:47.289952 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.289917    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b00dcc9a-5da3-40a3-87c4-1ce3d60734e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5\" (UID: \"b00dcc9a-5da3-40a3-87c4-1ce3d60734e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"
Sep 15 19:13:47.290540 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.290518    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b00dcc9a-5da3-40a3-87c4-1ce3d60734e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5\" (UID: \"b00dcc9a-5da3-40a3-87c4-1ce3d60734e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"
Sep 15 19:13:47.423991 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.423961    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"
Sep 15 19:13:47.695348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:47.695312    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"]
Sep 15 19:13:47.697715 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:13:47.697681    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00dcc9a_5da3_40a3_87c4_1ce3d60734e4.slice/crio-b9d6fe6c55fa9895600807ec718f34e269abb3bb35207bd8d855b952e26f05c5 WatchSource:0}: Error finding container b9d6fe6c55fa9895600807ec718f34e269abb3bb35207bd8d855b952e26f05c5: Status 404 returned error can't find the container with id b9d6fe6c55fa9895600807ec718f34e269abb3bb35207bd8d855b952e26f05c5
Sep 15 19:13:48.044617 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:48.044582    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:48.472181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:48.472145    2572 generic.go:356] "Generic (PLEG): container finished" podID="b00dcc9a-5da3-40a3-87c4-1ce3d60734e4" containerID="001d95c7ab160c9f1909e4589784153abf2a009a4c75d9814fab94e5608128c7" exitCode=0
Sep 15 19:13:48.472381 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:48.472208    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5" event={"ID":"b00dcc9a-5da3-40a3-87c4-1ce3d60734e4","Type":"ContainerDied","Data":"001d95c7ab160c9f1909e4589784153abf2a009a4c75d9814fab94e5608128c7"}
Sep 15 19:13:48.472381 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:48.472271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5" event={"ID":"b00dcc9a-5da3-40a3-87c4-1ce3d60734e4","Type":"ContainerStarted","Data":"b9d6fe6c55fa9895600807ec718f34e269abb3bb35207bd8d855b952e26f05c5"}
Sep 15 19:13:48.746480 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:48.746392    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:49.456364 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:49.456329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:49.619846 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:49.619816    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"
Sep 15 19:13:49.715675 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:49.715572    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b00dcc9a-5da3-40a3-87c4-1ce3d60734e4-maas-api-service-ca\") pod \"b00dcc9a-5da3-40a3-87c4-1ce3d60734e4\" (UID: \"b00dcc9a-5da3-40a3-87c4-1ce3d60734e4\") "
Sep 15 19:13:49.716021 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:49.715992    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b00dcc9a-5da3-40a3-87c4-1ce3d60734e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b00dcc9a-5da3-40a3-87c4-1ce3d60734e4" (UID: "b00dcc9a-5da3-40a3-87c4-1ce3d60734e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:13:49.816898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:49.816863    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b00dcc9a-5da3-40a3-87c4-1ce3d60734e4-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:13:50.067053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:50.066961    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:50.494642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:50.494609    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"
Sep 15 19:13:50.494642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:50.494619    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5" event={"ID":"b00dcc9a-5da3-40a3-87c4-1ce3d60734e4","Type":"ContainerDied","Data":"b9d6fe6c55fa9895600807ec718f34e269abb3bb35207bd8d855b952e26f05c5"}
Sep 15 19:13:50.495215 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:50.494686    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9d6fe6c55fa9895600807ec718f34e269abb3bb35207bd8d855b952e26f05c5"
Sep 15 19:13:50.856320 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:50.856226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:51.453904 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:51.453866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:52.070750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:52.070713    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:13:59.551622 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:13:59.551589    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:14:02.794017 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:02.793969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:02.841726 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:02.841689    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"]
Sep 15 19:14:02.842066 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:02.842034    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp" podUID="e3809413-dbd8-40d5-8f58-7b186648e880" containerName="payload-processing" containerID="cri-o://ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b" gracePeriod=30
Sep 15 19:14:02.894191 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:02.894147    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:03.010665 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.010568    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:03.010874 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.010818    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"]
Sep 15 19:14:03.015709 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.015682    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-74ef1f-p97b5"]
Sep 15 19:14:03.094726 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.093117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:03.130688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.130662    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:14:03.147694 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.147661    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3809413-dbd8-40d5-8f58-7b186648e880-plugins-config-volume\") pod \"e3809413-dbd8-40d5-8f58-7b186648e880\" (UID: \"e3809413-dbd8-40d5-8f58-7b186648e880\") "
Sep 15 19:14:03.147881 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.147748    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pbj2\" (UniqueName: \"kubernetes.io/projected/e3809413-dbd8-40d5-8f58-7b186648e880-kube-api-access-7pbj2\") pod \"e3809413-dbd8-40d5-8f58-7b186648e880\" (UID: \"e3809413-dbd8-40d5-8f58-7b186648e880\") "
Sep 15 19:14:03.148150 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.148120    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3809413-dbd8-40d5-8f58-7b186648e880-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3809413-dbd8-40d5-8f58-7b186648e880" (UID: "e3809413-dbd8-40d5-8f58-7b186648e880"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:14:03.150334 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.150302    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3809413-dbd8-40d5-8f58-7b186648e880-kube-api-access-7pbj2" (OuterVolumeSpecName: "kube-api-access-7pbj2") pod "e3809413-dbd8-40d5-8f58-7b186648e880" (UID: "e3809413-dbd8-40d5-8f58-7b186648e880"). InnerVolumeSpecName "kube-api-access-7pbj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:14:03.249137 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.249102    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3809413-dbd8-40d5-8f58-7b186648e880-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:03.249137 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.249133    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pbj2\" (UniqueName: \"kubernetes.io/projected/e3809413-dbd8-40d5-8f58-7b186648e880-kube-api-access-7pbj2\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:03.351745 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.351650    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:03.483326 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.483277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:03.558868 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.558837    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b00dcc9a-5da3-40a3-87c4-1ce3d60734e4" path="/var/lib/kubelet/pods/b00dcc9a-5da3-40a3-87c4-1ce3d60734e4/volumes"
Sep 15 19:14:03.581798 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.581766    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3809413-dbd8-40d5-8f58-7b186648e880" containerID="ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b" exitCode=0
Sep 15 19:14:03.581972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.581826    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"
Sep 15 19:14:03.581972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.581854    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp" event={"ID":"e3809413-dbd8-40d5-8f58-7b186648e880","Type":"ContainerDied","Data":"ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b"}
Sep 15 19:14:03.581972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.581913    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp" event={"ID":"e3809413-dbd8-40d5-8f58-7b186648e880","Type":"ContainerDied","Data":"f6d383081683e33ffef3f52f2a950e210d4d91c494546792c565bc15cb818c08"}
Sep 15 19:14:03.581972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.581943    2572 scope.go:117] "RemoveContainer" containerID="ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b"
Sep 15 19:14:03.591789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.591767    2572 scope.go:117] "RemoveContainer" containerID="ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b"
Sep 15 19:14:03.592150 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:14:03.592124    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b\": container with ID starting with ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b not found: ID does not exist" containerID="ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b"
Sep 15 19:14:03.592254 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.592157    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b"} err="failed to get container status \"ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b\": rpc error: code = NotFound desc = could not find container \"ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b\": container with ID starting with ca764f782cfddf35479b2c6194af26080d74785b5250128b6a0eb4d139806c0b not found: ID does not exist"
Sep 15 19:14:03.603097 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.603026    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"]
Sep 15 19:14:03.605898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:03.605876    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-74ef1f-846448c85c-g7nnp"]
Sep 15 19:14:04.148513 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:04.148477    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:05.038229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:05.038190    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:05.558102 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:05.558071    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3809413-dbd8-40d5-8f58-7b186648e880" path="/var/lib/kubelet/pods/e3809413-dbd8-40d5-8f58-7b186648e880/volumes"
Sep 15 19:14:05.738294 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:05.738259    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:06.289104 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:06.289074    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:08.381577 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:08.381544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:10.005609 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:10.005572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:10.107020 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:10.106977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:10.249588 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:10.249551    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:15.776681 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:15.776641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:15.877199 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:15.877154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:16.008107 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:16.008066    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"]
Sep 15 19:14:16.008409 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:16.008349    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy" containerID="cri-o://694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336" gracePeriod=30
Sep 15 19:14:16.034436 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:16.034342    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:17.302334 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:17.302290    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:17.400692 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:17.400660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:17.501866 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:17.501827    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:18.143514 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:18.143429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:18.238309 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:18.238274    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:18.339796 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:18.339762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:19.649996 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:19.649952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:21.269253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.269224    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:14:21.334232 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334134    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-data\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334232 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334176    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefc281b-de67-43a0-b43b-02008faf8de4-istio-podinfo\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334232 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334199    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-socket\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334232 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334231    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-certs\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334264    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefc281b-de67-43a0-b43b-02008faf8de4-istiod-ca-cert\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334282    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgmqb\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-kube-api-access-vgmqb\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334309    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-istio-token\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334359    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-envoy\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334451    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-credential-socket\") pod \"eefc281b-de67-43a0-b43b-02008faf8de4\" (UID: \"eefc281b-de67-43a0-b43b-02008faf8de4\") "
Sep 15 19:14:21.334551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334463    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-data" (OuterVolumeSpecName: "istio-data") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:14:21.334876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334585    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:14:21.334876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334621    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:14:21.334876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334829    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:14:21.334876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334855    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.334876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334872    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.335083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.334888    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.335083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.335028    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eefc281b-de67-43a0-b43b-02008faf8de4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:14:21.336525 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.336500    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eefc281b-de67-43a0-b43b-02008faf8de4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:14:21.336663 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.336600    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-istio-token" (OuterVolumeSpecName: "istio-token") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:14:21.337001 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.336985    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:14:21.337080 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.337011    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-kube-api-access-vgmqb" (OuterVolumeSpecName: "kube-api-access-vgmqb") pod "eefc281b-de67-43a0-b43b-02008faf8de4" (UID: "eefc281b-de67-43a0-b43b-02008faf8de4"). InnerVolumeSpecName "kube-api-access-vgmqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:14:21.435755 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.435711    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefc281b-de67-43a0-b43b-02008faf8de4-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.435755 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.435749    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgmqb\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-kube-api-access-vgmqb\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.435755 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.435761    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefc281b-de67-43a0-b43b-02008faf8de4-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.436014 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.435769    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.436014 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.435777    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefc281b-de67-43a0-b43b-02008faf8de4-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.436014 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.435785    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefc281b-de67-43a0-b43b-02008faf8de4-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:14:21.696633 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.696597    2572 generic.go:356] "Generic (PLEG): container finished" podID="eefc281b-de67-43a0-b43b-02008faf8de4" containerID="694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336" exitCode=0
Sep 15 19:14:21.696852 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.696649    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"
Sep 15 19:14:21.696852 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.696671    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" event={"ID":"eefc281b-de67-43a0-b43b-02008faf8de4","Type":"ContainerDied","Data":"694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336"}
Sep 15 19:14:21.696852 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.696722    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88" event={"ID":"eefc281b-de67-43a0-b43b-02008faf8de4","Type":"ContainerDied","Data":"92c265fa4d4a80f7fd36b351061e43d58dcec47262ec7c43709d8d3c4e03bdf8"}
Sep 15 19:14:21.696852 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.696743    2572 scope.go:117] "RemoveContainer" containerID="694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336"
Sep 15 19:14:21.706679 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.706652    2572 scope.go:117] "RemoveContainer" containerID="0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6"
Sep 15 19:14:21.714335 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.714307    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"]
Sep 15 19:14:21.716407 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.716388    2572 scope.go:117] "RemoveContainer" containerID="694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336"
Sep 15 19:14:21.716729 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:14:21.716704    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336\": container with ID starting with 694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336 not found: ID does not exist" containerID="694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336"
Sep 15 19:14:21.716821 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.716742    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336"} err="failed to get container status \"694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336\": rpc error: code = NotFound desc = could not find container \"694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336\": container with ID starting with 694a4b3df6e133aba2a2a1ce61e3e397427cc8ea89ec273a64835ce0a420a336 not found: ID does not exist"
Sep 15 19:14:21.716821 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.716768    2572 scope.go:117] "RemoveContainer" containerID="0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6"
Sep 15 19:14:21.716958 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.716933    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d2e6cc70-openshift-default-56775f7484-sgp88"]
Sep 15 19:14:21.717085 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:14:21.717070    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6\": container with ID starting with 0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6 not found: ID does not exist" containerID="0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6"
Sep 15 19:14:21.717127 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:21.717092    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6"} err="failed to get container status \"0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6\": rpc error: code = NotFound desc = could not find container \"0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6\": container with ID starting with 0ce83faf2efeb4ebe6a480a5947c227ea476676f359239835e115f36ff32ecb6 not found: ID does not exist"
Sep 15 19:14:23.010615 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:23.010582    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:23.558529 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:23.558494    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" path="/var/lib/kubelet/pods/eefc281b-de67-43a0-b43b-02008faf8de4/volumes"
Sep 15 19:14:24.552292 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:24.552256    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:14:25.315145 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:25.315105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:25.373699 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:25.373661    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:26.013181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:26.013146    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:28.739639 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:28.739578    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:28.842728 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:28.842693    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:29.929417 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:29.929382    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:31.625289 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:31.625254    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:31.728936 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:31.728894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:31.826055 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:31.826013    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:35.605600 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:35.605568    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:42.356135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:42.356101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:42.577740 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:42.577702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:14:59.522966 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:14:59.522931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:00.140386 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140343    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"]
Sep 15 19:15:00.140778 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140764    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy"
Sep 15 19:15:00.140860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140779    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy"
Sep 15 19:15:00.140860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140790    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy"
Sep 15 19:15:00.140860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140795    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy"
Sep 15 19:15:00.140860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140817    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3809413-dbd8-40d5-8f58-7b186648e880" containerName="payload-processing"
Sep 15 19:15:00.140860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140826    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3809413-dbd8-40d5-8f58-7b186648e880" containerName="payload-processing"
Sep 15 19:15:00.140860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140843    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b00dcc9a-5da3-40a3-87c4-1ce3d60734e4" containerName="revoke-keys"
Sep 15 19:15:00.140860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140851    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b00dcc9a-5da3-40a3-87c4-1ce3d60734e4" containerName="revoke-keys"
Sep 15 19:15:00.141081 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140930    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy"
Sep 15 19:15:00.141081 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140939    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b00dcc9a-5da3-40a3-87c4-1ce3d60734e4" containerName="revoke-keys"
Sep 15 19:15:00.141081 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140947    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="eefc281b-de67-43a0-b43b-02008faf8de4" containerName="istio-proxy"
Sep 15 19:15:00.141081 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.140955    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3809413-dbd8-40d5-8f58-7b186648e880" containerName="payload-processing"
Sep 15 19:15:00.143985 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.143968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"
Sep 15 19:15:00.146861 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.146832    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:15:00.149960 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.149935    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"]
Sep 15 19:15:00.153942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.153921    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"
Sep 15 19:15:00.154058 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.153976    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"]
Sep 15 19:15:00.156331 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.156311    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"
Sep 15 19:15:00.158167 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.158146    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"]
Sep 15 19:15:00.158303 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.158226    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"
Sep 15 19:15:00.174018 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.173986    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"]
Sep 15 19:15:00.177718 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.177337    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"
Sep 15 19:15:00.179780 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.179752    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"]
Sep 15 19:15:00.224620 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.224592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"
Sep 15 19:15:00.464185 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.464158    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"]
Sep 15 19:15:00.465604 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:15:00.465569    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cebacbf_f190_454d_b5e3_52bde624f1b6.slice/crio-b375ccfd78f9a39ff2dc7c3dffec1117fa4f7ca45103c5af353f10a46d8144c5 WatchSource:0}: Error finding container b375ccfd78f9a39ff2dc7c3dffec1117fa4f7ca45103c5af353f10a46d8144c5: Status 404 returned error can't find the container with id b375ccfd78f9a39ff2dc7c3dffec1117fa4f7ca45103c5af353f10a46d8144c5
Sep 15 19:15:00.476707 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.476682    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"]
Sep 15 19:15:00.478990 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:15:00.478960    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b253d7a_3691_4964_8526_9b212d77a58b.slice/crio-a434310ca91532b9430fe183ccc8b32d01195f482f01af7cdd8d2c97230d1f2e WatchSource:0}: Error finding container a434310ca91532b9430fe183ccc8b32d01195f482f01af7cdd8d2c97230d1f2e: Status 404 returned error can't find the container with id a434310ca91532b9430fe183ccc8b32d01195f482f01af7cdd8d2c97230d1f2e
Sep 15 19:15:00.534497 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.534465    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"]
Sep 15 19:15:00.535285 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:15:00.535255    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75320e1_ab8b_4434_bb56_a768a6fb9aed.slice/crio-314fce02c3eab77d6d2e4bf39af1b5128798f20d445c0dfffe4963ff03107fc4 WatchSource:0}: Error finding container 314fce02c3eab77d6d2e4bf39af1b5128798f20d445c0dfffe4963ff03107fc4: Status 404 returned error can't find the container with id 314fce02c3eab77d6d2e4bf39af1b5128798f20d445c0dfffe4963ff03107fc4
Sep 15 19:15:00.934642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.934602    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:00.940475 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.940446    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc" event={"ID":"3b253d7a-3691-4964-8526-9b212d77a58b","Type":"ContainerStarted","Data":"f252c7e4f762de4a21a84239ec0533f9388f7f86c57b6c5730cd02da57a19383"}
Sep 15 19:15:00.940620 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.940499    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc" event={"ID":"3b253d7a-3691-4964-8526-9b212d77a58b","Type":"ContainerStarted","Data":"a434310ca91532b9430fe183ccc8b32d01195f482f01af7cdd8d2c97230d1f2e"}
Sep 15 19:15:00.942332 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.942304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv" event={"ID":"8cebacbf-f190-454d-b5e3-52bde624f1b6","Type":"ContainerStarted","Data":"c2d2ae18c3b6fa95062e5a4730a942a19e17269995b4ccecc289882f97d865ee"}
Sep 15 19:15:00.942463 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.942356    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv" event={"ID":"8cebacbf-f190-454d-b5e3-52bde624f1b6","Type":"ContainerStarted","Data":"b375ccfd78f9a39ff2dc7c3dffec1117fa4f7ca45103c5af353f10a46d8144c5"}
Sep 15 19:15:00.943995 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.943971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x" event={"ID":"b75320e1-ab8b-4434-bb56-a768a6fb9aed","Type":"ContainerStarted","Data":"167f595921d369528dc42daf9c8a193d846304216494755ae72d22a52416500d"}
Sep 15 19:15:00.944101 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.944014    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x" event={"ID":"b75320e1-ab8b-4434-bb56-a768a6fb9aed","Type":"ContainerStarted","Data":"314fce02c3eab77d6d2e4bf39af1b5128798f20d445c0dfffe4963ff03107fc4"}
Sep 15 19:15:00.955871 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.955826    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc" podStartSLOduration=0.955800259 podStartE2EDuration="955.800259ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:15:00.952957679 +0000 UTC m=+1475.901186017" watchObservedRunningTime="2026-09-15 19:15:00.955800259 +0000 UTC m=+1475.904028592"
Sep 15 19:15:00.968473 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.968396    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv" podStartSLOduration=0.968381764 podStartE2EDuration="968.381764ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:15:00.965959946 +0000 UTC m=+1475.914188285" watchObservedRunningTime="2026-09-15 19:15:00.968381764 +0000 UTC m=+1475.916610110"
Sep 15 19:15:00.980252 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:00.980212    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x" podStartSLOduration=0.980199838 podStartE2EDuration="980.199838ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:15:00.978025688 +0000 UTC m=+1475.926254017" watchObservedRunningTime="2026-09-15 19:15:00.980199838 +0000 UTC m=+1475.928428164"
Sep 15 19:15:01.951573 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:01.951529    2572 generic.go:356] "Generic (PLEG): container finished" podID="b75320e1-ab8b-4434-bb56-a768a6fb9aed" containerID="167f595921d369528dc42daf9c8a193d846304216494755ae72d22a52416500d" exitCode=0
Sep 15 19:15:01.952017 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:01.951608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x" event={"ID":"b75320e1-ab8b-4434-bb56-a768a6fb9aed","Type":"ContainerDied","Data":"167f595921d369528dc42daf9c8a193d846304216494755ae72d22a52416500d"}
Sep 15 19:15:01.953141 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:01.953114    2572 generic.go:356] "Generic (PLEG): container finished" podID="3b253d7a-3691-4964-8526-9b212d77a58b" containerID="f252c7e4f762de4a21a84239ec0533f9388f7f86c57b6c5730cd02da57a19383" exitCode=0
Sep 15 19:15:01.953289 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:01.953199    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc" event={"ID":"3b253d7a-3691-4964-8526-9b212d77a58b","Type":"ContainerDied","Data":"f252c7e4f762de4a21a84239ec0533f9388f7f86c57b6c5730cd02da57a19383"}
Sep 15 19:15:01.954851 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:01.954798    2572 generic.go:356] "Generic (PLEG): container finished" podID="8cebacbf-f190-454d-b5e3-52bde624f1b6" containerID="c2d2ae18c3b6fa95062e5a4730a942a19e17269995b4ccecc289882f97d865ee" exitCode=0
Sep 15 19:15:01.954972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:01.954886    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv" event={"ID":"8cebacbf-f190-454d-b5e3-52bde624f1b6","Type":"ContainerDied","Data":"c2d2ae18c3b6fa95062e5a4730a942a19e17269995b4ccecc289882f97d865ee"}
Sep 15 19:15:03.121976 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.121948    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"
Sep 15 19:15:03.172161 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.172133    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"
Sep 15 19:15:03.175139 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.175119    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"
Sep 15 19:15:03.916490 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.916453    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:03.969604 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.969577    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"
Sep 15 19:15:03.969766 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.969574    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv" event={"ID":"8cebacbf-f190-454d-b5e3-52bde624f1b6","Type":"ContainerDied","Data":"b375ccfd78f9a39ff2dc7c3dffec1117fa4f7ca45103c5af353f10a46d8144c5"}
Sep 15 19:15:03.969766 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.969716    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b375ccfd78f9a39ff2dc7c3dffec1117fa4f7ca45103c5af353f10a46d8144c5"
Sep 15 19:15:03.971033 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.971015    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"
Sep 15 19:15:03.971155 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.971046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x" event={"ID":"b75320e1-ab8b-4434-bb56-a768a6fb9aed","Type":"ContainerDied","Data":"314fce02c3eab77d6d2e4bf39af1b5128798f20d445c0dfffe4963ff03107fc4"}
Sep 15 19:15:03.971155 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.971086    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="314fce02c3eab77d6d2e4bf39af1b5128798f20d445c0dfffe4963ff03107fc4"
Sep 15 19:15:03.972611 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.972595    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"
Sep 15 19:15:03.972717 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.972593    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc" event={"ID":"3b253d7a-3691-4964-8526-9b212d77a58b","Type":"ContainerDied","Data":"a434310ca91532b9430fe183ccc8b32d01195f482f01af7cdd8d2c97230d1f2e"}
Sep 15 19:15:03.972717 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:03.972696    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a434310ca91532b9430fe183ccc8b32d01195f482f01af7cdd8d2c97230d1f2e"
Sep 15 19:15:09.307463 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:09.307427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:09.425225 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:09.425186    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:09.954587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:09.954552    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:10.358611 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:10.358516    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:10.822316 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:10.822277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:12.594973 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:12.594939    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:12.983189 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:12.983154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:13.165577 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:13.165543    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:13.262324 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:13.262239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:15.688748 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:15.688707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:15.787636 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:15.787604    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:16.003479 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:16.003401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:16.104709 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:16.104672    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:16.571008 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:16.570974    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:16.699206 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:16.699167    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:17.335517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:17.335482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:17.395005 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:17.394970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:17.552445 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:17.552409    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:15:19.932389 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:19.932355    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:21.410406 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:21.410378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:25.643611 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:25.643576    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:15:25.646756 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:25.646734    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:15:25.831692 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:25.831657    2572 scope.go:117] "RemoveContainer" containerID="1dbd0f4bebcaf4cdd7c4f75cc8b1291c98db3cce883bb3e097d55ea807bd6432"
Sep 15 19:15:25.841098 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:25.841075    2572 scope.go:117] "RemoveContainer" containerID="4d463b58284e7c1fb8138c0fc7e79eaf6f0f8a196dd88a4643dbed0f249310e2"
Sep 15 19:15:29.551648 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:29.551616    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:15:37.962337 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:37.962296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:38.292879 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.292753    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:38.908680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.908645    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"]
Sep 15 19:15:38.909093 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909077    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b253d7a-3691-4964-8526-9b212d77a58b" containerName="cleanup"
Sep 15 19:15:38.909093 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909093    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b253d7a-3691-4964-8526-9b212d77a58b" containerName="cleanup"
Sep 15 19:15:38.909220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909104    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75320e1-ab8b-4434-bb56-a768a6fb9aed" containerName="cleanup"
Sep 15 19:15:38.909220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909110    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75320e1-ab8b-4434-bb56-a768a6fb9aed" containerName="cleanup"
Sep 15 19:15:38.909220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909127    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cebacbf-f190-454d-b5e3-52bde624f1b6" containerName="cleanup"
Sep 15 19:15:38.909220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909133    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cebacbf-f190-454d-b5e3-52bde624f1b6" containerName="cleanup"
Sep 15 19:15:38.909220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909201    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75320e1-ab8b-4434-bb56-a768a6fb9aed" containerName="cleanup"
Sep 15 19:15:38.909220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909211    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b253d7a-3691-4964-8526-9b212d77a58b" containerName="cleanup"
Sep 15 19:15:38.909220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.909216    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cebacbf-f190-454d-b5e3-52bde624f1b6" containerName="cleanup"
Sep 15 19:15:38.912623 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.912599    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.914783 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.914765    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0a7ab7-openshift-default-dockercfg-7xth6\""
Sep 15 19:15:38.923078 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.923051    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"]
Sep 15 19:15:38.997579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997539    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94953562-b5b1-4f36-a0f6-9a9b216bf264-istiod-ca-cert\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.997984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997600    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-token\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.997984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwtqr\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-kube-api-access-fwtqr\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.997984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997672    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-envoy\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.997984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997687    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-socket\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.997984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-credential-socket\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.997984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-certs\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.997984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-data\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:38.997984 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:38.997913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-podinfo\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.098975 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.098935    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-envoy\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.098975 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.098971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-socket\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099237 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-credential-socket\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099237 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099022    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-certs\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099237 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099045    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-data\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099237 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099132    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-podinfo\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099237 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94953562-b5b1-4f36-a0f6-9a9b216bf264-istiod-ca-cert\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099237 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099223    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-token\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099552 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwtqr\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-kube-api-access-fwtqr\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099552 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099401    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-socket\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099552 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099435    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-certs\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099714 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099607    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-credential-socket\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099714 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099626    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-data\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.099983 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.099960    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94953562-b5b1-4f36-a0f6-9a9b216bf264-istiod-ca-cert\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.101539 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.101520    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-envoy\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.101674 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.101655    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-podinfo\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.107651 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.107628    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-token\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.107850 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.107823    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwtqr\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-kube-api-access-fwtqr\") pod \"e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") " pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.225573 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.225529    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:39.506587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.506559    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"]
Sep 15 19:15:39.508245 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:15:39.508209    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94953562_b5b1_4f36_a0f6_9a9b216bf264.slice/crio-e8da3c33a1ca98cfd320533d62e460807cd0dff5da53e4eb431bcb28ee4b4e1e WatchSource:0}: Error finding container e8da3c33a1ca98cfd320533d62e460807cd0dff5da53e4eb431bcb28ee4b4e1e: Status 404 returned error can't find the container with id e8da3c33a1ca98cfd320533d62e460807cd0dff5da53e4eb431bcb28ee4b4e1e
Sep 15 19:15:39.510744 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.510701    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:15:39.510849 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.510796    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:15:39.510900 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:39.510880    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:15:40.204687 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:40.204643    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" event={"ID":"94953562-b5b1-4f36-a0f6-9a9b216bf264","Type":"ContainerStarted","Data":"ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d"}
Sep 15 19:15:40.205094 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:40.204703    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" event={"ID":"94953562-b5b1-4f36-a0f6-9a9b216bf264","Type":"ContainerStarted","Data":"e8da3c33a1ca98cfd320533d62e460807cd0dff5da53e4eb431bcb28ee4b4e1e"}
Sep 15 19:15:40.221647 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:40.221616    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:40.225968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:40.225945    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:40.226106 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:40.225982    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" podStartSLOduration=2.225968025 podStartE2EDuration="2.225968025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:15:40.224044533 +0000 UTC m=+1515.172272890" watchObservedRunningTime="2026-09-15 19:15:40.225968025 +0000 UTC m=+1515.174196351"
Sep 15 19:15:40.231531 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:40.231508    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:40.353922 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:40.353889    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:40.531282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:40.531189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:41.210755 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:41.210725    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:41.211734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:41.211715    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:15:41.274388 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:41.274355    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:42.197137 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:42.197098    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:42.299029 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:42.298992    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:42.986237 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:42.986195    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:43.774326 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:43.774295    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:44.460399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:44.460367    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:44.990655 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:44.990622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:45.759517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:45.759481    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:46.392663 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:46.392630    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:46.494275 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:46.494229    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:46.637379 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:46.637345    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:46.836037 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:46.836003    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:46.925687 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:46.925649    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:47.779977 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:47.779934    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:48.433518 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:48.433488    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:51.046006 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:51.045955    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:57.135008 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:57.134963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:58.952082 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:58.952046    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:15:59.053068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:15:59.053017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:04.370553 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:04.370513    2572 generic.go:356] "Generic (PLEG): container finished" podID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerID="ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d" exitCode=0
Sep 15 19:16:04.371009 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:04.370583    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" event={"ID":"94953562-b5b1-4f36-a0f6-9a9b216bf264","Type":"ContainerDied","Data":"ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d"}
Sep 15 19:16:04.371058 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:04.371016    2572 scope.go:117] "RemoveContainer" containerID="ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d"
Sep 15 19:16:04.372217 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:04.372190    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:16:04.372280 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:04.372264    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:16:04.372319 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:04.372294    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:16:05.379188 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:05.379154    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" event={"ID":"94953562-b5b1-4f36-a0f6-9a9b216bf264","Type":"ContainerStarted","Data":"c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452"}
Sep 15 19:16:06.226518 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:06.226472    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:16:06.226740 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:06.226612    2572 patch_prober.go:28] interesting pod/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 15 19:16:06.226740 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:06.226657    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 15 19:16:07.200334 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:07.200304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:07.226228 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:07.226190    2572 patch_prober.go:28] interesting pod/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 15 19:16:07.226510 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:07.226479    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 15 19:16:08.226252 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:08.226206    2572 patch_prober.go:28] interesting pod/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 15 19:16:08.226951 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:08.226913    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 15 19:16:08.396032 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:08.395996    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:09.164262 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:09.164209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:09.226131 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:09.226089    2572 patch_prober.go:28] interesting pod/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 15 19:16:09.226450 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:09.226419    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 15 19:16:09.790514 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:09.790480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:10.226176 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:10.226124    2572 patch_prober.go:28] interesting pod/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 15 19:16:10.226407 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:10.226188    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 15 19:16:10.473129 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:10.473078    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:11.210908 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:11.210872    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:16:11.231456 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:11.231426    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:16:11.267612 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:11.267583    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:11.419792 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:11.419763    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:16:11.847439 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:11.847401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:12.238208 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:12.238173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:12.648300 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:12.648212    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:15.292598 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.292557    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"]
Sep 15 19:16:15.296399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.296380    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"
Sep 15 19:16:15.298630 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.298610    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:16:15.304092 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.304067    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"]
Sep 15 19:16:15.378670 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.378631    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1fde4b-342b-4cb0-bfbb-b1780887bb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-910e11-mvqmr\" (UID: \"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"
Sep 15 19:16:15.479350 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.479313    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1fde4b-342b-4cb0-bfbb-b1780887bb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-910e11-mvqmr\" (UID: \"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"
Sep 15 19:16:15.479995 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.479974    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1fde4b-342b-4cb0-bfbb-b1780887bb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-910e11-mvqmr\" (UID: \"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"
Sep 15 19:16:15.559544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.559460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:15.607912 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.607874    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"
Sep 15 19:16:15.887360 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:15.887331    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"]
Sep 15 19:16:15.888302 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:16:15.888278    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1fde4b_342b_4cb0_bfbb_b1780887bb2d.slice/crio-6a4b341673a848f78936ce3ae0789a5b0d9dc77e51527edde677accfb2bbaec7 WatchSource:0}: Error finding container 6a4b341673a848f78936ce3ae0789a5b0d9dc77e51527edde677accfb2bbaec7: Status 404 returned error can't find the container with id 6a4b341673a848f78936ce3ae0789a5b0d9dc77e51527edde677accfb2bbaec7
Sep 15 19:16:16.452946 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:16.452911    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr" event={"ID":"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d","Type":"ContainerStarted","Data":"a2f05f66b33cceb0fcd6dd07486c79848cc0bbecceebccfbff55b1e01ced048b"}
Sep 15 19:16:16.453337 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:16.452971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr" event={"ID":"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d","Type":"ContainerStarted","Data":"6a4b341673a848f78936ce3ae0789a5b0d9dc77e51527edde677accfb2bbaec7"}
Sep 15 19:16:16.473764 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:16.473660    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr" podStartSLOduration=1.473643506 podStartE2EDuration="1.473643506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:16:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:16:16.47124728 +0000 UTC m=+1551.419475605" watchObservedRunningTime="2026-09-15 19:16:16.473643506 +0000 UTC m=+1551.421871833"
Sep 15 19:16:16.480385 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:16.480361    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:17.107227 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:17.107191    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:17.460388 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:17.460355    2572 generic.go:356] "Generic (PLEG): container finished" podID="0a1fde4b-342b-4cb0-bfbb-b1780887bb2d" containerID="a2f05f66b33cceb0fcd6dd07486c79848cc0bbecceebccfbff55b1e01ced048b" exitCode=0
Sep 15 19:16:17.460761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:17.460436    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr" event={"ID":"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d","Type":"ContainerDied","Data":"a2f05f66b33cceb0fcd6dd07486c79848cc0bbecceebccfbff55b1e01ced048b"}
Sep 15 19:16:17.841897 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:17.841769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:18.499821 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:18.499779    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:18.613162 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:18.613134    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"
Sep 15 19:16:18.713201 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:18.713172    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1fde4b-342b-4cb0-bfbb-b1780887bb2d-maas-api-service-ca\") pod \"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d\" (UID: \"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d\") "
Sep 15 19:16:18.713496 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:18.713472    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a1fde4b-342b-4cb0-bfbb-b1780887bb2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0a1fde4b-342b-4cb0-bfbb-b1780887bb2d" (UID: "0a1fde4b-342b-4cb0-bfbb-b1780887bb2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:16:18.713580 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:18.713557    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1fde4b-342b-4cb0-bfbb-b1780887bb2d-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:16:19.059963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:19.059931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:19.474419 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:19.474385    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"
Sep 15 19:16:19.474419 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:19.474403    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr" event={"ID":"0a1fde4b-342b-4cb0-bfbb-b1780887bb2d","Type":"ContainerDied","Data":"6a4b341673a848f78936ce3ae0789a5b0d9dc77e51527edde677accfb2bbaec7"}
Sep 15 19:16:19.474652 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:19.474460    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a4b341673a848f78936ce3ae0789a5b0d9dc77e51527edde677accfb2bbaec7"
Sep 15 19:16:19.695628 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:19.695599    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:20.321732 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:20.321697    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:24.562362 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:24.562306    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:24.664298 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:24.664266    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:25.870816 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:25.870782    2572 scope.go:117] "RemoveContainer" containerID="6aad6170c78536a7cd1ab90da9e575991490bf2faa8a9ea466768ccbff9ea0fe"
Sep 15 19:16:30.775825 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:30.775783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:30.876024 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:30.875974    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:30.963087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:30.963053    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"]
Sep 15 19:16:30.964572 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:30.964544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:30.966177 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:30.966151    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-910e11-mvqmr"]
Sep 15 19:16:31.057257 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:31.057181    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:31.305920 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:31.305889    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:31.406632 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:31.406551    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:31.558346 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:31.558305    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a1fde4b-342b-4cb0-bfbb-b1780887bb2d" path="/var/lib/kubelet/pods/0a1fde4b-342b-4cb0-bfbb-b1780887bb2d/volumes"
Sep 15 19:16:32.075754 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:32.075713    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:32.768912 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:32.768870    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:33.466093 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:33.466054    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:33.978712 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:33.978682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:34.767476 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:34.767444    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:36.976591 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:36.976563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:37.106618 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.106587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:37.237193 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.237112    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:37.584617 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.584534    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"]
Sep 15 19:16:37.584991 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.584978    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1fde4b-342b-4cb0-bfbb-b1780887bb2d" containerName="revoke-keys"
Sep 15 19:16:37.585048 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.584993    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1fde4b-342b-4cb0-bfbb-b1780887bb2d" containerName="revoke-keys"
Sep 15 19:16:37.585085 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.585070    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a1fde4b-342b-4cb0-bfbb-b1780887bb2d" containerName="revoke-keys"
Sep 15 19:16:37.588320 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.588303    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"
Sep 15 19:16:37.590440 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.590419    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:16:37.595019 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.594998    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"]
Sep 15 19:16:37.611517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.611484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc6a58e-5719-4a59-94c4-dae3ffb62957-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m\" (UID: \"ebc6a58e-5719-4a59-94c4-dae3ffb62957\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"
Sep 15 19:16:37.712417 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.712364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc6a58e-5719-4a59-94c4-dae3ffb62957-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m\" (UID: \"ebc6a58e-5719-4a59-94c4-dae3ffb62957\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"
Sep 15 19:16:37.712972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.712950    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc6a58e-5719-4a59-94c4-dae3ffb62957-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m\" (UID: \"ebc6a58e-5719-4a59-94c4-dae3ffb62957\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"
Sep 15 19:16:37.901524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:37.901432    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"
Sep 15 19:16:38.172877 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:38.172846    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"]
Sep 15 19:16:38.174229 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:16:38.174200    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc6a58e_5719_4a59_94c4_dae3ffb62957.slice/crio-30795f969fef670eaab7c9a65da9febc967ba20d6d21bc2f848d4127d73c5b43 WatchSource:0}: Error finding container 30795f969fef670eaab7c9a65da9febc967ba20d6d21bc2f848d4127d73c5b43: Status 404 returned error can't find the container with id 30795f969fef670eaab7c9a65da9febc967ba20d6d21bc2f848d4127d73c5b43
Sep 15 19:16:38.357365 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:38.357332    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:38.604511 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:38.604474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m" event={"ID":"ebc6a58e-5719-4a59-94c4-dae3ffb62957","Type":"ContainerStarted","Data":"30795f969fef670eaab7c9a65da9febc967ba20d6d21bc2f848d4127d73c5b43"}
Sep 15 19:16:38.891698 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:38.891608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:39.616351 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:39.616309    2572 generic.go:356] "Generic (PLEG): container finished" podID="ebc6a58e-5719-4a59-94c4-dae3ffb62957" containerID="0ec8f11e96bd232ff1881324f66b781ec1fc3d95c2df40fc0e2be716fe62a4ad" exitCode=0
Sep 15 19:16:39.616847 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:39.616384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m" event={"ID":"ebc6a58e-5719-4a59-94c4-dae3ffb62957","Type":"ContainerDied","Data":"0ec8f11e96bd232ff1881324f66b781ec1fc3d95c2df40fc0e2be716fe62a4ad"}
Sep 15 19:16:39.817604 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:39.817567    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:40.267124 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:40.267089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:40.552195 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:40.552109    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:16:40.771486 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:40.771455    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"
Sep 15 19:16:40.844542 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:40.844459    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc6a58e-5719-4a59-94c4-dae3ffb62957-maas-api-service-ca\") pod \"ebc6a58e-5719-4a59-94c4-dae3ffb62957\" (UID: \"ebc6a58e-5719-4a59-94c4-dae3ffb62957\") "
Sep 15 19:16:40.844865 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:40.844843    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebc6a58e-5719-4a59-94c4-dae3ffb62957-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ebc6a58e-5719-4a59-94c4-dae3ffb62957" (UID: "ebc6a58e-5719-4a59-94c4-dae3ffb62957"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:16:40.946115 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:40.946079    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebc6a58e-5719-4a59-94c4-dae3ffb62957-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:16:40.962545 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:40.962514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:41.629590 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:41.629552    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m" event={"ID":"ebc6a58e-5719-4a59-94c4-dae3ffb62957","Type":"ContainerDied","Data":"30795f969fef670eaab7c9a65da9febc967ba20d6d21bc2f848d4127d73c5b43"}
Sep 15 19:16:41.629758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:41.629596    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"
Sep 15 19:16:41.629758 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:41.629613    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30795f969fef670eaab7c9a65da9febc967ba20d6d21bc2f848d4127d73c5b43"
Sep 15 19:16:41.736114 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:41.736078    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:45.543954 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:45.543917    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:46.777026 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:46.776990    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:49.552469 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:49.552433    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:16:53.172145 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.172112    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:53.242596 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.242552    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:53.304921 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.304888    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:53.367127 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.367091    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"]
Sep 15 19:16:53.368773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.368749    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:53.369906 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.369885    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0a7ab7-2gb4m"]
Sep 15 19:16:53.426968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.426894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:53.564850 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.564815    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebc6a58e-5719-4a59-94c4-dae3ffb62957" path="/var/lib/kubelet/pods/ebc6a58e-5719-4a59-94c4-dae3ffb62957/volumes"
Sep 15 19:16:53.742830 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.742731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:53.800864 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:53.800832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:54.398998 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:54.398964    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:55.189556 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:55.189514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:55.731198 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:55.731161    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:56.394618 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:56.394580    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:59.516742 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:59.516705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:59.619087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:59.619054    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:16:59.762579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:59.762543    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"]
Sep 15 19:16:59.762781 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:59.762758    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy" containerID="cri-o://c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452" gracePeriod=30
Sep 15 19:16:59.788387 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:16:59.788308    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:00.149968 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.149886    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"]
Sep 15 19:17:00.150359 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.150342    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc6a58e-5719-4a59-94c4-dae3ffb62957" containerName="revoke-keys"
Sep 15 19:17:00.150399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.150360    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc6a58e-5719-4a59-94c4-dae3ffb62957" containerName="revoke-keys"
Sep 15 19:17:00.150446 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.150437    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc6a58e-5719-4a59-94c4-dae3ffb62957" containerName="revoke-keys"
Sep 15 19:17:00.153800 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.153772    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"
Sep 15 19:17:00.155996 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.155971    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:17:00.159528 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.159499    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"]
Sep 15 19:17:00.236330 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.236288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e1013e-ca0a-4e5a-8b1d-745048f0c313-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7\" (UID: \"15e1013e-ca0a-4e5a-8b1d-745048f0c313\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"
Sep 15 19:17:00.337641 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.337599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e1013e-ca0a-4e5a-8b1d-745048f0c313-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7\" (UID: \"15e1013e-ca0a-4e5a-8b1d-745048f0c313\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"
Sep 15 19:17:00.338309 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.338283    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e1013e-ca0a-4e5a-8b1d-745048f0c313-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7\" (UID: \"15e1013e-ca0a-4e5a-8b1d-745048f0c313\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"
Sep 15 19:17:00.467511 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.467464    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"
Sep 15 19:17:00.739239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.739204    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"]
Sep 15 19:17:00.740849 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:17:00.740820    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e1013e_ca0a_4e5a_8b1d_745048f0c313.slice/crio-4f00a9d5460a493a98cca322e6f0f47801f7d9b370d97efb9e080f2b4770bb0f WatchSource:0}: Error finding container 4f00a9d5460a493a98cca322e6f0f47801f7d9b370d97efb9e080f2b4770bb0f: Status 404 returned error can't find the container with id 4f00a9d5460a493a98cca322e6f0f47801f7d9b370d97efb9e080f2b4770bb0f
Sep 15 19:17:00.748625 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:00.748578    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7" event={"ID":"15e1013e-ca0a-4e5a-8b1d-745048f0c313","Type":"ContainerStarted","Data":"4f00a9d5460a493a98cca322e6f0f47801f7d9b370d97efb9e080f2b4770bb0f"}
Sep 15 19:17:01.015027 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:01.014998    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:01.600544 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:01.600460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:01.757069 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:01.757032    2572 generic.go:356] "Generic (PLEG): container finished" podID="15e1013e-ca0a-4e5a-8b1d-745048f0c313" containerID="4370c2dc0d98ab01fd728d5ead5c30f9ec31e4edb7f1104a79e1afd1c3aa5134" exitCode=0
Sep 15 19:17:01.757457 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:01.757074    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7" event={"ID":"15e1013e-ca0a-4e5a-8b1d-745048f0c313","Type":"ContainerDied","Data":"4370c2dc0d98ab01fd728d5ead5c30f9ec31e4edb7f1104a79e1afd1c3aa5134"}
Sep 15 19:17:02.353959 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:02.353924    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:02.902380 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:02.902351    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"
Sep 15 19:17:03.057701 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:03.057615    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:03.066928 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:03.066904    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e1013e-ca0a-4e5a-8b1d-745048f0c313-maas-api-service-ca\") pod \"15e1013e-ca0a-4e5a-8b1d-745048f0c313\" (UID: \"15e1013e-ca0a-4e5a-8b1d-745048f0c313\") "
Sep 15 19:17:03.067242 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:03.067221    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e1013e-ca0a-4e5a-8b1d-745048f0c313-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15e1013e-ca0a-4e5a-8b1d-745048f0c313" (UID: "15e1013e-ca0a-4e5a-8b1d-745048f0c313"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:03.167876 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:03.167837    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e1013e-ca0a-4e5a-8b1d-745048f0c313-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:03.503934 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:03.503902    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:03.771283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:03.771187    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"
Sep 15 19:17:03.771283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:03.771229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7" event={"ID":"15e1013e-ca0a-4e5a-8b1d-745048f0c313","Type":"ContainerDied","Data":"4f00a9d5460a493a98cca322e6f0f47801f7d9b370d97efb9e080f2b4770bb0f"}
Sep 15 19:17:03.771283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:03.771276    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f00a9d5460a493a98cca322e6f0f47801f7d9b370d97efb9e080f2b4770bb0f"
Sep 15 19:17:05.027052 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.026989    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:17:05.187651 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187605    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-data\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.187651 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187657    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwtqr\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-kube-api-access-fwtqr\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.187969 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187692    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-certs\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.187969 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187739    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94953562-b5b1-4f36-a0f6-9a9b216bf264-istiod-ca-cert\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.187969 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187767    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-credential-socket\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.187969 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187798    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-token\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.187969 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187899    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-envoy\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.187969 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187940    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-podinfo\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.187969 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187951    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-data" (OuterVolumeSpecName: "istio-data") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:05.188343 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.187989    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-socket\") pod \"94953562-b5b1-4f36-a0f6-9a9b216bf264\" (UID: \"94953562-b5b1-4f36-a0f6-9a9b216bf264\") "
Sep 15 19:17:05.188343 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188056    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:05.188343 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188098    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:05.188343 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188191    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94953562-b5b1-4f36-a0f6-9a9b216bf264-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:05.188343 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188276    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:05.188550 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188380    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94953562-b5b1-4f36-a0f6-9a9b216bf264-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.188550 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188402    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.188550 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188417    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.188550 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188432    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.188550 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.188446    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.190130 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.190105    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:05.190214 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.190184    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:17:05.190391 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.190372    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-kube-api-access-fwtqr" (OuterVolumeSpecName: "kube-api-access-fwtqr") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "kube-api-access-fwtqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:05.190513 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.190489    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-token" (OuterVolumeSpecName: "istio-token") pod "94953562-b5b1-4f36-a0f6-9a9b216bf264" (UID: "94953562-b5b1-4f36-a0f6-9a9b216bf264"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:05.290069 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.289960    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwtqr\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-kube-api-access-fwtqr\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.290069 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.290007    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.290069 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.290020    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.290069 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.290033    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94953562-b5b1-4f36-a0f6-9a9b216bf264-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:05.787913 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.787876    2572 generic.go:356] "Generic (PLEG): container finished" podID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerID="c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452" exitCode=0
Sep 15 19:17:05.788108 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.787924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" event={"ID":"94953562-b5b1-4f36-a0f6-9a9b216bf264","Type":"ContainerDied","Data":"c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452"}
Sep 15 19:17:05.788108 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.787980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq" event={"ID":"94953562-b5b1-4f36-a0f6-9a9b216bf264","Type":"ContainerDied","Data":"e8da3c33a1ca98cfd320533d62e460807cd0dff5da53e4eb431bcb28ee4b4e1e"}
Sep 15 19:17:05.788108 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.787929    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"
Sep 15 19:17:05.788108 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.788007    2572 scope.go:117] "RemoveContainer" containerID="c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452"
Sep 15 19:17:05.798001 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.797983    2572 scope.go:117] "RemoveContainer" containerID="ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d"
Sep 15 19:17:05.805325 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.805298    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"]
Sep 15 19:17:05.808179 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.808154    2572 scope.go:117] "RemoveContainer" containerID="c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452"
Sep 15 19:17:05.808473 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:05.808454    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452\": container with ID starting with c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452 not found: ID does not exist" containerID="c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452"
Sep 15 19:17:05.808533 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.808482    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452"} err="failed to get container status \"c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452\": rpc error: code = NotFound desc = could not find container \"c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452\": container with ID starting with c587b860e68762d02493ca122451e7057348f1700537bb994553a42a111ec452 not found: ID does not exist"
Sep 15 19:17:05.808533 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.808498    2572 scope.go:117] "RemoveContainer" containerID="ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d"
Sep 15 19:17:05.808736 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:05.808716    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d\": container with ID starting with ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d not found: ID does not exist" containerID="ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d"
Sep 15 19:17:05.808778 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.808741    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d"} err="failed to get container status \"ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d\": rpc error: code = NotFound desc = could not find container \"ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d\": container with ID starting with ab2036941331577028a1a28595e8bb4b565d508e15e83e665eefc1fd94bf2f6d not found: ID does not exist"
Sep 15 19:17:05.809663 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:05.809643    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0a7ab7-openshift-default-67697547c4-whgjq"]
Sep 15 19:17:07.558790 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:07.558750    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" path="/var/lib/kubelet/pods/94953562-b5b1-4f36-a0f6-9a9b216bf264/volumes"
Sep 15 19:17:09.562994 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:09.562963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:10.611355 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.611315    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"]
Sep 15 19:17:10.614669 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.614637    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-4d299f-29824995-6q2jc"]
Sep 15 19:17:10.614860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.614691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:10.638126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.638090    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"]
Sep 15 19:17:10.638483 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.638413    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb" podUID="83b84973-476f-41bf-b95e-09b513421ef6" containerName="payload-processing" containerID="cri-o://787b0e986079e3a59c2d0d4b3a76d2e9d0d2aa673d38b3377e002316f3b0e893" gracePeriod=30
Sep 15 19:17:10.646107 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.646080    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"]
Sep 15 19:17:10.646508 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.646479    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp" podUID="ed13c890-df39-4055-a275-7a36962495b1" containerName="payload-pre-processing" containerID="cri-o://20549bb71d2566da580f7d1ba3b454e5c627e5e17e746d4ba5eb040f6a2d9999" gracePeriod=30
Sep 15 19:17:10.688115 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.688032    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:10.759927 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:10.759893    2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b84973_476f_41bf_b95e_09b513421ef6.slice/crio-conmon-787b0e986079e3a59c2d0d4b3a76d2e9d0d2aa673d38b3377e002316f3b0e893.scope\": RecentStats: unable to find data in memory cache]"
Sep 15 19:17:10.789943 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.789890    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:10.801875 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.801842    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"]
Sep 15 19:17:10.804629 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.804601    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4d299f-bz9g7"]
Sep 15 19:17:10.831565 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.831533    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed13c890-df39-4055-a275-7a36962495b1" containerID="20549bb71d2566da580f7d1ba3b454e5c627e5e17e746d4ba5eb040f6a2d9999" exitCode=0
Sep 15 19:17:10.831738 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.831607    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp" event={"ID":"ed13c890-df39-4055-a275-7a36962495b1","Type":"ContainerDied","Data":"20549bb71d2566da580f7d1ba3b454e5c627e5e17e746d4ba5eb040f6a2d9999"}
Sep 15 19:17:10.833351 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.833330    2572 generic.go:356] "Generic (PLEG): container finished" podID="83b84973-476f-41bf-b95e-09b513421ef6" containerID="787b0e986079e3a59c2d0d4b3a76d2e9d0d2aa673d38b3377e002316f3b0e893" exitCode=0
Sep 15 19:17:10.833463 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.833372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb" event={"ID":"83b84973-476f-41bf-b95e-09b513421ef6","Type":"ContainerDied","Data":"787b0e986079e3a59c2d0d4b3a76d2e9d0d2aa673d38b3377e002316f3b0e893"}
Sep 15 19:17:10.866141 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.865832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:10.930424 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.930400    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:17:10.933570 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.933550    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:17:10.940472 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.940451    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpfm7\" (UniqueName: \"kubernetes.io/projected/83b84973-476f-41bf-b95e-09b513421ef6-kube-api-access-dpfm7\") pod \"83b84973-476f-41bf-b95e-09b513421ef6\" (UID: \"83b84973-476f-41bf-b95e-09b513421ef6\") "
Sep 15 19:17:10.940533 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.940518    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed13c890-df39-4055-a275-7a36962495b1-plugins-config-volume\") pod \"ed13c890-df39-4055-a275-7a36962495b1\" (UID: \"ed13c890-df39-4055-a275-7a36962495b1\") "
Sep 15 19:17:10.940600 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.940588    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlsk7\" (UniqueName: \"kubernetes.io/projected/ed13c890-df39-4055-a275-7a36962495b1-kube-api-access-wlsk7\") pod \"ed13c890-df39-4055-a275-7a36962495b1\" (UID: \"ed13c890-df39-4055-a275-7a36962495b1\") "
Sep 15 19:17:10.940646 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.940616    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83b84973-476f-41bf-b95e-09b513421ef6-plugins-config-volume\") pod \"83b84973-476f-41bf-b95e-09b513421ef6\" (UID: \"83b84973-476f-41bf-b95e-09b513421ef6\") "
Sep 15 19:17:10.940915 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.940887    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed13c890-df39-4055-a275-7a36962495b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed13c890-df39-4055-a275-7a36962495b1" (UID: "ed13c890-df39-4055-a275-7a36962495b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:10.941015 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.940995    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b84973-476f-41bf-b95e-09b513421ef6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83b84973-476f-41bf-b95e-09b513421ef6" (UID: "83b84973-476f-41bf-b95e-09b513421ef6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:10.942660 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.942639    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b84973-476f-41bf-b95e-09b513421ef6-kube-api-access-dpfm7" (OuterVolumeSpecName: "kube-api-access-dpfm7") pod "83b84973-476f-41bf-b95e-09b513421ef6" (UID: "83b84973-476f-41bf-b95e-09b513421ef6"). InnerVolumeSpecName "kube-api-access-dpfm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:10.942727 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:10.942677    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed13c890-df39-4055-a275-7a36962495b1-kube-api-access-wlsk7" (OuterVolumeSpecName: "kube-api-access-wlsk7") pod "ed13c890-df39-4055-a275-7a36962495b1" (UID: "ed13c890-df39-4055-a275-7a36962495b1"). InnerVolumeSpecName "kube-api-access-wlsk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:11.041344 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.041308    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpfm7\" (UniqueName: \"kubernetes.io/projected/83b84973-476f-41bf-b95e-09b513421ef6-kube-api-access-dpfm7\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:11.041344 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.041338    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed13c890-df39-4055-a275-7a36962495b1-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:11.041344 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.041347    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlsk7\" (UniqueName: \"kubernetes.io/projected/ed13c890-df39-4055-a275-7a36962495b1-kube-api-access-wlsk7\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:11.041751 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.041357    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83b84973-476f-41bf-b95e-09b513421ef6-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:11.558113 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.558077    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e1013e-ca0a-4e5a-8b1d-745048f0c313" path="/var/lib/kubelet/pods/15e1013e-ca0a-4e5a-8b1d-745048f0c313/volumes"
Sep 15 19:17:11.558364 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.558351    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b253d7a-3691-4964-8526-9b212d77a58b" path="/var/lib/kubelet/pods/3b253d7a-3691-4964-8526-9b212d77a58b/volumes"
Sep 15 19:17:11.841643 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.841556    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"
Sep 15 19:17:11.841643 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.841588    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp" event={"ID":"ed13c890-df39-4055-a275-7a36962495b1","Type":"ContainerDied","Data":"7cce0335aae798964cbc2392e7979a58ec78f977e4e91f7302b9aae65f6889c5"}
Sep 15 19:17:11.842155 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.841659    2572 scope.go:117] "RemoveContainer" containerID="20549bb71d2566da580f7d1ba3b454e5c627e5e17e746d4ba5eb040f6a2d9999"
Sep 15 19:17:11.843136 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.843116    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb" event={"ID":"83b84973-476f-41bf-b95e-09b513421ef6","Type":"ContainerDied","Data":"3b33671a3a104c341f34e6d09e399a8c2d9b07b2b9c09fac5d8ba8bd9da36071"}
Sep 15 19:17:11.843136 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.843130    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"
Sep 15 19:17:11.851565 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.851547    2572 scope.go:117] "RemoveContainer" containerID="787b0e986079e3a59c2d0d4b3a76d2e9d0d2aa673d38b3377e002316f3b0e893"
Sep 15 19:17:11.863374 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.863285    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"]
Sep 15 19:17:11.871174 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.871143    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4d299f-6bffb97986-9gcpp"]
Sep 15 19:17:11.876911 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.876889    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"]
Sep 15 19:17:11.880295 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:11.880267    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-4d299f-bfb7458f9-fdfhb"]
Sep 15 19:17:13.086619 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:13.086584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:13.187387 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:13.187351    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:13.287239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:13.287206    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:13.558300 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:13.558268    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b84973-476f-41bf-b95e-09b513421ef6" path="/var/lib/kubelet/pods/83b84973-476f-41bf-b95e-09b513421ef6/volumes"
Sep 15 19:17:13.558690 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:13.558676    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed13c890-df39-4055-a275-7a36962495b1" path="/var/lib/kubelet/pods/ed13c890-df39-4055-a275-7a36962495b1/volumes"
Sep 15 19:17:16.978931 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:16.978898    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:17.079644 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.079604    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:17.219187 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.219154    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"]
Sep 15 19:17:17.219448 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.219420    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy" containerID="cri-o://b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf" gracePeriod=30
Sep 15 19:17:17.245009 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.244922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:17.588779 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.588694    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"]
Sep 15 19:17:17.589148 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589134    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy"
Sep 15 19:17:17.589209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589150    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy"
Sep 15 19:17:17.589209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589164    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e1013e-ca0a-4e5a-8b1d-745048f0c313" containerName="revoke-keys"
Sep 15 19:17:17.589209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589170    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e1013e-ca0a-4e5a-8b1d-745048f0c313" containerName="revoke-keys"
Sep 15 19:17:17.589209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589178    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b84973-476f-41bf-b95e-09b513421ef6" containerName="payload-processing"
Sep 15 19:17:17.589209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589184    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b84973-476f-41bf-b95e-09b513421ef6" containerName="payload-processing"
Sep 15 19:17:17.589209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589196    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed13c890-df39-4055-a275-7a36962495b1" containerName="payload-pre-processing"
Sep 15 19:17:17.589209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589203    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed13c890-df39-4055-a275-7a36962495b1" containerName="payload-pre-processing"
Sep 15 19:17:17.589430 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589270    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed13c890-df39-4055-a275-7a36962495b1" containerName="payload-pre-processing"
Sep 15 19:17:17.589430 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589280    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b84973-476f-41bf-b95e-09b513421ef6" containerName="payload-processing"
Sep 15 19:17:17.589430 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589292    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy"
Sep 15 19:17:17.589430 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589298    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e1013e-ca0a-4e5a-8b1d-745048f0c313" containerName="revoke-keys"
Sep 15 19:17:17.589430 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.589305    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy"
Sep 15 19:17:17.593932 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.593915    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"
Sep 15 19:17:17.596166 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.596135    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:17:17.598670 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.598645    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"]
Sep 15 19:17:17.708917 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.708877    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4592077-ccf3-43e0-ae4e-bc011af77da6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj\" (UID: \"a4592077-ccf3-43e0-ae4e-bc011af77da6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"
Sep 15 19:17:17.810363 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.810326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4592077-ccf3-43e0-ae4e-bc011af77da6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj\" (UID: \"a4592077-ccf3-43e0-ae4e-bc011af77da6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"
Sep 15 19:17:17.810944 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.810923    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4592077-ccf3-43e0-ae4e-bc011af77da6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj\" (UID: \"a4592077-ccf3-43e0-ae4e-bc011af77da6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"
Sep 15 19:17:17.881344 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.881225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:17.905467 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:17.905441    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"
Sep 15 19:17:18.186128 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:18.186100    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"]
Sep 15 19:17:18.187165 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:17:18.187131    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4592077_ccf3_43e0_ae4e_bc011af77da6.slice/crio-98f279727ae27ca2be4f4aa3bf41eb8b4cb4bfab544b34ad6b99433ba67659a9 WatchSource:0}: Error finding container 98f279727ae27ca2be4f4aa3bf41eb8b4cb4bfab544b34ad6b99433ba67659a9: Status 404 returned error can't find the container with id 98f279727ae27ca2be4f4aa3bf41eb8b4cb4bfab544b34ad6b99433ba67659a9
Sep 15 19:17:18.657375 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:18.657333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:18.891900 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:18.891786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj" event={"ID":"a4592077-ccf3-43e0-ae4e-bc011af77da6","Type":"ContainerStarted","Data":"0e0560d2d7fc30b8580b1708fe0c38ad1a2bb05286b20d1475cc1ba190394de0"}
Sep 15 19:17:18.891900 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:18.891866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj" event={"ID":"a4592077-ccf3-43e0-ae4e-bc011af77da6","Type":"ContainerStarted","Data":"98f279727ae27ca2be4f4aa3bf41eb8b4cb4bfab544b34ad6b99433ba67659a9"}
Sep 15 19:17:18.908680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:18.908635    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj" podStartSLOduration=1.908621067 podStartE2EDuration="1.908621067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:17:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:17:18.907605213 +0000 UTC m=+1613.855833539" watchObservedRunningTime="2026-09-15 19:17:18.908621067 +0000 UTC m=+1613.856849392"
Sep 15 19:17:19.391308 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:19.391270    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:19.899765 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:19.899728    2572 generic.go:356] "Generic (PLEG): container finished" podID="a4592077-ccf3-43e0-ae4e-bc011af77da6" containerID="0e0560d2d7fc30b8580b1708fe0c38ad1a2bb05286b20d1475cc1ba190394de0" exitCode=0
Sep 15 19:17:19.899964 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:19.899785    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj" event={"ID":"a4592077-ccf3-43e0-ae4e-bc011af77da6","Type":"ContainerDied","Data":"0e0560d2d7fc30b8580b1708fe0c38ad1a2bb05286b20d1475cc1ba190394de0"}
Sep 15 19:17:19.920245 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:19.920210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:20.681231 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:20.681196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:21.044255 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:21.044228    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"
Sep 15 19:17:21.146042 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:21.146012    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4592077-ccf3-43e0-ae4e-bc011af77da6-maas-api-service-ca\") pod \"a4592077-ccf3-43e0-ae4e-bc011af77da6\" (UID: \"a4592077-ccf3-43e0-ae4e-bc011af77da6\") "
Sep 15 19:17:21.146381 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:21.146357    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4592077-ccf3-43e0-ae4e-bc011af77da6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4592077-ccf3-43e0-ae4e-bc011af77da6" (UID: "a4592077-ccf3-43e0-ae4e-bc011af77da6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:21.247111 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:21.247034    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4592077-ccf3-43e0-ae4e-bc011af77da6-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:21.913505 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:21.913478    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"
Sep 15 19:17:21.913933 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:21.913474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj" event={"ID":"a4592077-ccf3-43e0-ae4e-bc011af77da6","Type":"ContainerDied","Data":"98f279727ae27ca2be4f4aa3bf41eb8b4cb4bfab544b34ad6b99433ba67659a9"}
Sep 15 19:17:21.913933 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:21.913612    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98f279727ae27ca2be4f4aa3bf41eb8b4cb4bfab544b34ad6b99433ba67659a9"
Sep 15 19:17:22.097222 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.097174    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 19:17:22.097385 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.097253    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 19:17:22.484088 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.484029    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:17:22.559698 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.559663    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-podinfo\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.559923 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.559721    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istiod-ca-cert\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.559923 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.559770    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-certs\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.559923 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.559798    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-envoy\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.559923 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.559857    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-socket\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.559923 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.559909    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-data\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.560142 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.559958    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xczw6\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-kube-api-access-xczw6\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.560142 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560021    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-credential-socket\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.560142 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560044    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-token\") pod \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\" (UID: \"dbba9983-84fa-4c09-ae62-371dbd70a4f3\") "
Sep 15 19:17:22.560294 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560255    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:22.560349 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560289    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:22.560591 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560424    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.560591 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560554    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.560591 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560495    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:22.560591 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560558    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:22.560960 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.560759    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:22.562487 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.562459    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:22.562594 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.562562    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-kube-api-access-xczw6" (OuterVolumeSpecName: "kube-api-access-xczw6") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "kube-api-access-xczw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:22.562645 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.562629    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:22.562680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.562650    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbba9983-84fa-4c09-ae62-371dbd70a4f3" (UID: "dbba9983-84fa-4c09-ae62-371dbd70a4f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:17:22.661269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.661226    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.661269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.661259    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.661269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.661272    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.661521 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.661282    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.661521 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.661298    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xczw6\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-kube-api-access-xczw6\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.661521 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.661310    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbba9983-84fa-4c09-ae62-371dbd70a4f3-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.661521 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.661321    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbba9983-84fa-4c09-ae62-371dbd70a4f3-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:22.921079 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.921044    2572 generic.go:356] "Generic (PLEG): container finished" podID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerID="b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf" exitCode=0
Sep 15 19:17:22.921555 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.921096    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"
Sep 15 19:17:22.921555 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.921133    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" event={"ID":"dbba9983-84fa-4c09-ae62-371dbd70a4f3","Type":"ContainerDied","Data":"b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf"}
Sep 15 19:17:22.921555 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.921200    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l" event={"ID":"dbba9983-84fa-4c09-ae62-371dbd70a4f3","Type":"ContainerDied","Data":"8e934d03ac02c1b9a14428e37f62c3eea5b3962289e6b3753924d41455a24e3e"}
Sep 15 19:17:22.921555 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.921236    2572 scope.go:117] "RemoveContainer" containerID="b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf"
Sep 15 19:17:22.931560 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.931539    2572 scope.go:117] "RemoveContainer" containerID="da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015"
Sep 15 19:17:22.940577 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.940558    2572 scope.go:117] "RemoveContainer" containerID="b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf"
Sep 15 19:17:22.940901 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:22.940883    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf\": container with ID starting with b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf not found: ID does not exist" containerID="b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf"
Sep 15 19:17:22.941006 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.940912    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf"} err="failed to get container status \"b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf\": rpc error: code = NotFound desc = could not find container \"b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf\": container with ID starting with b5511c10b480310c5d8a9b9dd4e7a12b5dc5bbb52eb00b3a48371e1cf80108cf not found: ID does not exist"
Sep 15 19:17:22.941006 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.940928    2572 scope.go:117] "RemoveContainer" containerID="da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015"
Sep 15 19:17:22.941190 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:22.941170    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015\": container with ID starting with da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015 not found: ID does not exist" containerID="da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015"
Sep 15 19:17:22.941243 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.941199    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015"} err="failed to get container status \"da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015\": rpc error: code = NotFound desc = could not find container \"da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015\": container with ID starting with da0dcaa2ee802b2ba689ffb2476facb78bf0c89b29ed63912a7fef0d7ff65015 not found: ID does not exist"
Sep 15 19:17:22.943126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.943103    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"]
Sep 15 19:17:22.945973 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:22.945950    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4d299f-openshift-default-5677ddf4bd-2x25l"]
Sep 15 19:17:23.560972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:23.560939    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" path="/var/lib/kubelet/pods/dbba9983-84fa-4c09-ae62-371dbd70a4f3/volumes"
Sep 15 19:17:25.893686 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:25.893651    2572 scope.go:117] "RemoveContainer" containerID="ff5ad0d82be674508b409c0392d4f92374f8840694a03a128bc49b1290cb3db7"
Sep 15 19:17:28.066169 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.066120    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:28.067237 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.067215    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"]
Sep 15 19:17:28.069641 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.069619    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-501bed-29824995-r86cv"]
Sep 15 19:17:28.096054 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.096021    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"]
Sep 15 19:17:28.096313 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.096284    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn" podUID="2c11a4a1-5a39-451f-9af6-636159c3b2b8" containerName="payload-processing" containerID="cri-o://c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef" gracePeriod=30
Sep 15 19:17:28.102594 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.102314    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"]
Sep 15 19:17:28.103105 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.102888    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm" podUID="a21ed03a-7bd7-493c-a429-8c5808bf8740" containerName="payload-pre-processing" containerID="cri-o://037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2" gracePeriod=30
Sep 15 19:17:28.142016 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.141989    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:28.211871 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.211845    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:28.278126 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.278086    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"]
Sep 15 19:17:28.279905 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.279876    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:28.281202 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.281182    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-501bed-9qtqj"]
Sep 15 19:17:28.344066 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.343975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:28.378616 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.378594    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:17:28.381532 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.381511    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:17:28.527004 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.526973    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcqhd\" (UniqueName: \"kubernetes.io/projected/a21ed03a-7bd7-493c-a429-8c5808bf8740-kube-api-access-kcqhd\") pod \"a21ed03a-7bd7-493c-a429-8c5808bf8740\" (UID: \"a21ed03a-7bd7-493c-a429-8c5808bf8740\") "
Sep 15 19:17:28.527004 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.527008    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c11a4a1-5a39-451f-9af6-636159c3b2b8-plugins-config-volume\") pod \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\" (UID: \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\") "
Sep 15 19:17:28.527208 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.527053    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21ed03a-7bd7-493c-a429-8c5808bf8740-plugins-config-volume\") pod \"a21ed03a-7bd7-493c-a429-8c5808bf8740\" (UID: \"a21ed03a-7bd7-493c-a429-8c5808bf8740\") "
Sep 15 19:17:28.527208 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.527075    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l98bh\" (UniqueName: \"kubernetes.io/projected/2c11a4a1-5a39-451f-9af6-636159c3b2b8-kube-api-access-l98bh\") pod \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\" (UID: \"2c11a4a1-5a39-451f-9af6-636159c3b2b8\") "
Sep 15 19:17:28.527455 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.527416    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c11a4a1-5a39-451f-9af6-636159c3b2b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c11a4a1-5a39-451f-9af6-636159c3b2b8" (UID: "2c11a4a1-5a39-451f-9af6-636159c3b2b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:28.527578 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.527475    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a21ed03a-7bd7-493c-a429-8c5808bf8740-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a21ed03a-7bd7-493c-a429-8c5808bf8740" (UID: "a21ed03a-7bd7-493c-a429-8c5808bf8740"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:28.529169 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.529149    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21ed03a-7bd7-493c-a429-8c5808bf8740-kube-api-access-kcqhd" (OuterVolumeSpecName: "kube-api-access-kcqhd") pod "a21ed03a-7bd7-493c-a429-8c5808bf8740" (UID: "a21ed03a-7bd7-493c-a429-8c5808bf8740"). InnerVolumeSpecName "kube-api-access-kcqhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:28.529273 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.529226    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c11a4a1-5a39-451f-9af6-636159c3b2b8-kube-api-access-l98bh" (OuterVolumeSpecName: "kube-api-access-l98bh") pod "2c11a4a1-5a39-451f-9af6-636159c3b2b8" (UID: "2c11a4a1-5a39-451f-9af6-636159c3b2b8"). InnerVolumeSpecName "kube-api-access-l98bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:28.628562 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.628471    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c11a4a1-5a39-451f-9af6-636159c3b2b8-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:28.628562 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.628506    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21ed03a-7bd7-493c-a429-8c5808bf8740-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:28.628562 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.628515    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l98bh\" (UniqueName: \"kubernetes.io/projected/2c11a4a1-5a39-451f-9af6-636159c3b2b8-kube-api-access-l98bh\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:28.628562 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.628526    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcqhd\" (UniqueName: \"kubernetes.io/projected/a21ed03a-7bd7-493c-a429-8c5808bf8740-kube-api-access-kcqhd\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:28.654282 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.654240    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:28.732102 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.732060    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:28.960594 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.960559    2572 generic.go:356] "Generic (PLEG): container finished" podID="a21ed03a-7bd7-493c-a429-8c5808bf8740" containerID="037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2" exitCode=0
Sep 15 19:17:28.960800 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.960599    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"
Sep 15 19:17:28.960800 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.960645    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm" event={"ID":"a21ed03a-7bd7-493c-a429-8c5808bf8740","Type":"ContainerDied","Data":"037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2"}
Sep 15 19:17:28.960800 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.960706    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm" event={"ID":"a21ed03a-7bd7-493c-a429-8c5808bf8740","Type":"ContainerDied","Data":"9983d6f21d5dc489072b9525aea7275b7c542b3ad5fc9080104b0ebd446552fb"}
Sep 15 19:17:28.960800 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.960735    2572 scope.go:117] "RemoveContainer" containerID="037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2"
Sep 15 19:17:28.962158 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.962138    2572 generic.go:356] "Generic (PLEG): container finished" podID="2c11a4a1-5a39-451f-9af6-636159c3b2b8" containerID="c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef" exitCode=0
Sep 15 19:17:28.962253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.962185    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"
Sep 15 19:17:28.962253 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.962216    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn" event={"ID":"2c11a4a1-5a39-451f-9af6-636159c3b2b8","Type":"ContainerDied","Data":"c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef"}
Sep 15 19:17:28.962365 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.962268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn" event={"ID":"2c11a4a1-5a39-451f-9af6-636159c3b2b8","Type":"ContainerDied","Data":"70993fc967bc60b4a2bef13ffc8b712b308623fe4bf71c0638dcc73088391ce9"}
Sep 15 19:17:28.970886 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.970869    2572 scope.go:117] "RemoveContainer" containerID="037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2"
Sep 15 19:17:28.971231 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:28.971209    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2\": container with ID starting with 037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2 not found: ID does not exist" containerID="037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2"
Sep 15 19:17:28.971335 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.971235    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2"} err="failed to get container status \"037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2\": rpc error: code = NotFound desc = could not find container \"037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2\": container with ID starting with 037b2a26af2adaa1436220b675202fa0277d743153a4bbc4c721607a47cb2fd2 not found: ID does not exist"
Sep 15 19:17:28.971335 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.971253    2572 scope.go:117] "RemoveContainer" containerID="c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef"
Sep 15 19:17:28.980086 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.980071    2572 scope.go:117] "RemoveContainer" containerID="c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef"
Sep 15 19:17:28.980387 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:28.980366    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef\": container with ID starting with c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef not found: ID does not exist" containerID="c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef"
Sep 15 19:17:28.980478 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.980392    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef"} err="failed to get container status \"c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef\": rpc error: code = NotFound desc = could not find container \"c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef\": container with ID starting with c6b66c377c87bc60376a221a88a52e48825c7b25fff9ff9fd2fa13efcd4d15ef not found: ID does not exist"
Sep 15 19:17:28.985352 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.985330    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"]
Sep 15 19:17:28.989053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.989029    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-501bed-549f686bcd-q5sgm"]
Sep 15 19:17:28.998205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:28.998179    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"]
Sep 15 19:17:29.002294 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:29.002260    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-501bed-5b66848f59-x76qn"]
Sep 15 19:17:29.254378 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:29.254295    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:29.558385 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:29.558302    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c11a4a1-5a39-451f-9af6-636159c3b2b8" path="/var/lib/kubelet/pods/2c11a4a1-5a39-451f-9af6-636159c3b2b8/volumes"
Sep 15 19:17:29.558652 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:29.558634    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cebacbf-f190-454d-b5e3-52bde624f1b6" path="/var/lib/kubelet/pods/8cebacbf-f190-454d-b5e3-52bde624f1b6/volumes"
Sep 15 19:17:29.558979 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:29.558964    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a21ed03a-7bd7-493c-a429-8c5808bf8740" path="/var/lib/kubelet/pods/a21ed03a-7bd7-493c-a429-8c5808bf8740/volumes"
Sep 15 19:17:29.559288 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:29.559276    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4592077-ccf3-43e0-ae4e-bc011af77da6" path="/var/lib/kubelet/pods/a4592077-ccf3-43e0-ae4e-bc011af77da6/volumes"
Sep 15 19:17:30.070116 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:30.070081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:34.411388 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:34.411345    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:34.511450 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:34.511412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:34.666091 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:34.666009    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"]
Sep 15 19:17:34.666277 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:34.666253    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy" containerID="cri-o://8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c" gracePeriod=30
Sep 15 19:17:34.692553 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:34.692518    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:35.164542 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:35.164513    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:17:39.926654 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:39.926628    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:17:40.031358 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.031267    2572 generic.go:356] "Generic (PLEG): container finished" podID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerID="8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c" exitCode=0
Sep 15 19:17:40.031358 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.031320    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"
Sep 15 19:17:40.031613 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.031358    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" event={"ID":"1ba0b409-3253-44a1-a89b-4fc4bb835b01","Type":"ContainerDied","Data":"8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c"}
Sep 15 19:17:40.031613 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.031427    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr" event={"ID":"1ba0b409-3253-44a1-a89b-4fc4bb835b01","Type":"ContainerDied","Data":"1a8c9c5b3e14d56d2d905ae8290db44d03ab758de4abe2cf719ba596adb2bc38"}
Sep 15 19:17:40.031613 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.031458    2572 scope.go:117] "RemoveContainer" containerID="8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c"
Sep 15 19:17:40.037650 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037629    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-certs\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.037750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037664    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-token\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.037750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037727    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istiod-ca-cert\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.037910 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037776    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb8hv\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-kube-api-access-tb8hv\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.037910 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037826    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-data\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.037910 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037859    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-socket\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.038143 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037910    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-credential-socket\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.038143 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037954    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-envoy\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.038143 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037948    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:40.038143 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.037984    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-podinfo\") pod \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\" (UID: \"1ba0b409-3253-44a1-a89b-4fc4bb835b01\") "
Sep 15 19:17:40.038348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.038144    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:40.038348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.038179    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:40.038348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.038196    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:17:40.038498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.038368    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:40.038498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.038381    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.038498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.038401    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.038498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.038416    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.038498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.038430    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.040043 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.040013    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-kube-api-access-tb8hv" (OuterVolumeSpecName: "kube-api-access-tb8hv") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "kube-api-access-tb8hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:40.040496 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.040476    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:17:40.040603 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.040580    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:17:40.040661 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.040604    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ba0b409-3253-44a1-a89b-4fc4bb835b01" (UID: "1ba0b409-3253-44a1-a89b-4fc4bb835b01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:17:40.041761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.041737    2572 scope.go:117] "RemoveContainer" containerID="32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d"
Sep 15 19:17:40.059181 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.059160    2572 scope.go:117] "RemoveContainer" containerID="8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c"
Sep 15 19:17:40.059501 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:40.059480    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c\": container with ID starting with 8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c not found: ID does not exist" containerID="8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c"
Sep 15 19:17:40.059549 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.059510    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c"} err="failed to get container status \"8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c\": rpc error: code = NotFound desc = could not find container \"8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c\": container with ID starting with 8ffcb27976c78cef496fcea00fc9d9b773ac9363b4c7e5182397a252e9dc5f8c not found: ID does not exist"
Sep 15 19:17:40.059549 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.059530    2572 scope.go:117] "RemoveContainer" containerID="32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d"
Sep 15 19:17:40.059782 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:17:40.059764    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d\": container with ID starting with 32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d not found: ID does not exist" containerID="32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d"
Sep 15 19:17:40.059850 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.059787    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d"} err="failed to get container status \"32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d\": rpc error: code = NotFound desc = could not find container \"32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d\": container with ID starting with 32f1144333be7c5fd52eca26dad2f3da0df1ea18a76439654cb1038192192a0d not found: ID does not exist"
Sep 15 19:17:40.139375 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.139347    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb8hv\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-kube-api-access-tb8hv\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.139375 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.139374    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.139549 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.139385    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.139549 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.139394    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.139549 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.139402    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba0b409-3253-44a1-a89b-4fc4bb835b01-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:17:40.353675 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.353636    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"]
Sep 15 19:17:40.360205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:40.360176    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-501bed-openshift-default-6bf8d847d4-4rlgr"]
Sep 15 19:17:41.563693 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:17:41.563657    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" path="/var/lib/kubelet/pods/1ba0b409-3253-44a1-a89b-4fc4bb835b01/volumes"
Sep 15 19:18:04.552242 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:04.552208    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:18:08.551370 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:08.551334    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:18:12.123173 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:12.123139    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:12.934795 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:12.934744    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:13.034952 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.034916    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:13.239668 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.239581    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:13.536657 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.536568    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"]
Sep 15 19:18:13.536972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.536959    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.536973    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.536981    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.536987    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94953562-b5b1-4f36-a0f6-9a9b216bf264" containerName="istio-proxy"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.536994    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4592077-ccf3-43e0-ae4e-bc011af77da6" containerName="revoke-keys"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537000    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4592077-ccf3-43e0-ae4e-bc011af77da6" containerName="revoke-keys"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537008    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21ed03a-7bd7-493c-a429-8c5808bf8740" containerName="payload-pre-processing"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537013    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21ed03a-7bd7-493c-a429-8c5808bf8740" containerName="payload-pre-processing"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537032    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537037    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537044    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537050    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy"
Sep 15 19:18:13.537053 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537059    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c11a4a1-5a39-451f-9af6-636159c3b2b8" containerName="payload-processing"
Sep 15 19:18:13.537688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537064    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c11a4a1-5a39-451f-9af6-636159c3b2b8" containerName="payload-processing"
Sep 15 19:18:13.537688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537123    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy"
Sep 15 19:18:13.537688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537131    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy"
Sep 15 19:18:13.537688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537138    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c11a4a1-5a39-451f-9af6-636159c3b2b8" containerName="payload-processing"
Sep 15 19:18:13.537688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537144    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4592077-ccf3-43e0-ae4e-bc011af77da6" containerName="revoke-keys"
Sep 15 19:18:13.537688 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.537150    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a21ed03a-7bd7-493c-a429-8c5808bf8740" containerName="payload-pre-processing"
Sep 15 19:18:13.540230 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.540209    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.542694 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.542671    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-6eb41d-openshift-default-dockercfg-xwhm9\""
Sep 15 19:18:13.550901 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.550870    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"]
Sep 15 19:18:13.561636 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.557709    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:13.652220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652177    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-certs\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.652220 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-socket\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.652517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istiod-ca-cert\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.652517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652321    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-podinfo\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.652517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-credential-socket\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.652517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652372    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plfxb\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-kube-api-access-plfxb\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.652517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-token\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.652517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-data\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.652517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.652473    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-envoy\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.735467 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.735429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:13.753285 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753251    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-socket\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753308    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istiod-ca-cert\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-podinfo\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-credential-socket\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753402    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plfxb\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-kube-api-access-plfxb\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753427    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-token\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-data\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753517    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-envoy\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-certs\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.753972 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.753732    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-socket\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.754033 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.754014    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-data\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.754090 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.754060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-credential-socket\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.754145 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.754089    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istiod-ca-cert\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.754145 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.754124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-certs\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.755833 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.755798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-envoy\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.756042 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.756025    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-podinfo\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.760913 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.760883    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-token\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.761038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.761020    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plfxb\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-kube-api-access-plfxb\") pod \"e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") " pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:13.853651 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:13.853560    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:14.127668 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:14.127638    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"]
Sep 15 19:18:14.128965 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:18:14.128933    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332988e9_5d12_4d69_a57b_ff4b65baa7c9.slice/crio-55d644b3ce4b6b9f46b9e1ce515794005ac7c8262113a4a911dfaaa6a78d0691 WatchSource:0}: Error finding container 55d644b3ce4b6b9f46b9e1ce515794005ac7c8262113a4a911dfaaa6a78d0691: Status 404 returned error can't find the container with id 55d644b3ce4b6b9f46b9e1ce515794005ac7c8262113a4a911dfaaa6a78d0691
Sep 15 19:18:14.131065 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:14.131030    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:14.131171 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:14.131098    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:14.131171 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:14.131128    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:14.238238 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:14.238191    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" event={"ID":"332988e9-5d12-4d69-a57b-ff4b65baa7c9","Type":"ContainerStarted","Data":"d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd"}
Sep 15 19:18:14.238439 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:14.238257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" event={"ID":"332988e9-5d12-4d69-a57b-ff4b65baa7c9","Type":"ContainerStarted","Data":"55d644b3ce4b6b9f46b9e1ce515794005ac7c8262113a4a911dfaaa6a78d0691"}
Sep 15 19:18:14.258084 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:14.258026    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" podStartSLOduration=1.258011118 podStartE2EDuration="1.258011118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:18:14.255079077 +0000 UTC m=+1669.203307404" watchObservedRunningTime="2026-09-15 19:18:14.258011118 +0000 UTC m=+1669.206239444"
Sep 15 19:18:14.854565 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:14.854521    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:15.487616 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:15.487576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:15.860418 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:15.860334    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:16.154658 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:16.154557    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:16.250214 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:16.250172    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:16.251463 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:16.251420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:16.257530 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:16.257471    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:16.464296 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:16.464259    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:16.950411 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:16.950379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:17.873928 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:17.873893    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:17.974419 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:17.974385    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:18.287551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.287508    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:18.388033 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.387998    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:18.435716 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.435682    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"]
Sep 15 19:18:18.436094 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.436080    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy"
Sep 15 19:18:18.436094 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.436094    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy"
Sep 15 19:18:18.436182 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.436163    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba0b409-3253-44a1-a89b-4fc4bb835b01" containerName="istio-proxy"
Sep 15 19:18:18.436182 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.436172    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbba9983-84fa-4c09-ae62-371dbd70a4f3" containerName="istio-proxy"
Sep 15 19:18:18.439291 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.439273    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:18.443392 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.443366    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-6eb41d-dockercfg-7v9qb\""
Sep 15 19:18:18.443524 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.443394    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-6eb41d\""
Sep 15 19:18:18.452426 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.452402    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"]
Sep 15 19:18:18.461977 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.461949    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"]
Sep 15 19:18:18.465759 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.465741    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:18.476964 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.476941    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"]
Sep 15 19:18:18.478610 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.478585    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:18.601424 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.601339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjgxb\" (UniqueName: \"kubernetes.io/projected/df866bd6-0a34-41c1-a5f3-3d8ed311328a-kube-api-access-hjgxb\") pod \"payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg\" (UID: \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:18.601424 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.601385    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df866bd6-0a34-41c1-a5f3-3d8ed311328a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg\" (UID: \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:18.601424 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.601413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3e48c6-3d56-490f-a271-01fbf3464259-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h\" (UID: \"ca3e48c6-3d56-490f-a271-01fbf3464259\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:18.601705 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.601456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv2mh\" (UniqueName: \"kubernetes.io/projected/ca3e48c6-3d56-490f-a271-01fbf3464259-kube-api-access-zv2mh\") pod \"payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h\" (UID: \"ca3e48c6-3d56-490f-a271-01fbf3464259\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:18.703046 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.703007    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjgxb\" (UniqueName: \"kubernetes.io/projected/df866bd6-0a34-41c1-a5f3-3d8ed311328a-kube-api-access-hjgxb\") pod \"payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg\" (UID: \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:18.703245 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.703067    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df866bd6-0a34-41c1-a5f3-3d8ed311328a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg\" (UID: \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:18.703245 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.703103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3e48c6-3d56-490f-a271-01fbf3464259-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h\" (UID: \"ca3e48c6-3d56-490f-a271-01fbf3464259\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:18.703245 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.703129    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv2mh\" (UniqueName: \"kubernetes.io/projected/ca3e48c6-3d56-490f-a271-01fbf3464259-kube-api-access-zv2mh\") pod \"payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h\" (UID: \"ca3e48c6-3d56-490f-a271-01fbf3464259\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:18.703907 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.703885    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3e48c6-3d56-490f-a271-01fbf3464259-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h\" (UID: \"ca3e48c6-3d56-490f-a271-01fbf3464259\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:18.703989 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.703968    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df866bd6-0a34-41c1-a5f3-3d8ed311328a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg\" (UID: \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:18.710161 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.710138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv2mh\" (UniqueName: \"kubernetes.io/projected/ca3e48c6-3d56-490f-a271-01fbf3464259-kube-api-access-zv2mh\") pod \"payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h\" (UID: \"ca3e48c6-3d56-490f-a271-01fbf3464259\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:18.710260 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.710217    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjgxb\" (UniqueName: \"kubernetes.io/projected/df866bd6-0a34-41c1-a5f3-3d8ed311328a-kube-api-access-hjgxb\") pod \"payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg\" (UID: \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:18.751228 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.751201    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:18.777531 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:18.777494    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:19.028411 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.028383    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"]
Sep 15 19:18:19.031051 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:18:19.031022    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf866bd6_0a34_41c1_a5f3_3d8ed311328a.slice/crio-fe03f997755dc72407ba2466215901ac3002895225c4437b08b2407e66858f20 WatchSource:0}: Error finding container fe03f997755dc72407ba2466215901ac3002895225c4437b08b2407e66858f20: Status 404 returned error can't find the container with id fe03f997755dc72407ba2466215901ac3002895225c4437b08b2407e66858f20
Sep 15 19:18:19.059404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.059381    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"]
Sep 15 19:18:19.061888 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:18:19.061865    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3e48c6_3d56_490f_a271_01fbf3464259.slice/crio-83883f8ca863a95dd5b777b117c635e83b5b9fe53043f2aa907e9aee3966c884 WatchSource:0}: Error finding container 83883f8ca863a95dd5b777b117c635e83b5b9fe53043f2aa907e9aee3966c884: Status 404 returned error can't find the container with id 83883f8ca863a95dd5b777b117c635e83b5b9fe53043f2aa907e9aee3966c884
Sep 15 19:18:19.271209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.271163    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h" event={"ID":"ca3e48c6-3d56-490f-a271-01fbf3464259","Type":"ContainerStarted","Data":"5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed"}
Sep 15 19:18:19.271414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.271227    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:19.271414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.271252    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h" event={"ID":"ca3e48c6-3d56-490f-a271-01fbf3464259","Type":"ContainerStarted","Data":"83883f8ca863a95dd5b777b117c635e83b5b9fe53043f2aa907e9aee3966c884"}
Sep 15 19:18:19.273006 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.272980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg" event={"ID":"df866bd6-0a34-41c1-a5f3-3d8ed311328a","Type":"ContainerStarted","Data":"02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd"}
Sep 15 19:18:19.273113 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.273020    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg" event={"ID":"df866bd6-0a34-41c1-a5f3-3d8ed311328a","Type":"ContainerStarted","Data":"fe03f997755dc72407ba2466215901ac3002895225c4437b08b2407e66858f20"}
Sep 15 19:18:19.273154 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.273101    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:19.287932 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.287849    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h" podStartSLOduration=1.287827544 podStartE2EDuration="1.287827544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:18:19.287090995 +0000 UTC m=+1674.235319324" watchObservedRunningTime="2026-09-15 19:18:19.287827544 +0000 UTC m=+1674.236055869"
Sep 15 19:18:19.304388 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:19.304346    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg" podStartSLOduration=1.304331363 podStartE2EDuration="1.304331363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:18:19.302558063 +0000 UTC m=+1674.250786389" watchObservedRunningTime="2026-09-15 19:18:19.304331363 +0000 UTC m=+1674.252559688"
Sep 15 19:18:22.763234 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:22.763177    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:22.825919 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:22.825878    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:30.281461 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:30.281419    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:18:30.281862 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:30.281507    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:18:31.251704 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:31.251674    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 15 19:18:31.251889 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:31.251735    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 15 19:18:31.369588 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:31.369503    2572 generic.go:356] "Generic (PLEG): container finished" podID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerID="d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd" exitCode=0
Sep 15 19:18:31.369964 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:31.369579    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" event={"ID":"332988e9-5d12-4d69-a57b-ff4b65baa7c9","Type":"ContainerDied","Data":"d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd"}
Sep 15 19:18:31.370028 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:31.370009    2572 scope.go:117] "RemoveContainer" containerID="d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd"
Sep 15 19:18:31.371085 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:31.371053    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:31.371179 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:31.371119    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:31.371179 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:31.371155    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:32.377828 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:32.377784    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" event={"ID":"332988e9-5d12-4d69-a57b-ff4b65baa7c9","Type":"ContainerStarted","Data":"9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5"}
Sep 15 19:18:32.853872 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:32.853828    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:32.854134 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:32.854112    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 15 19:18:32.854185 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:32.854164    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 15 19:18:33.854761 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:33.854721    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 15 19:18:33.855197 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:33.854781    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 15 19:18:34.854322 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:34.854285    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 15 19:18:34.854509 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:34.854346    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 15 19:18:35.854775 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:35.854738    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 15 19:18:35.855201 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:35.854794    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 15 19:18:36.854188 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:36.854149    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 15 19:18:36.854414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:36.854213    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 15 19:18:37.354135 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:37.354102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:37.858360 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:37.858327    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:37.858617 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:37.858597    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:37.859191 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:37.859170    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:18:38.696619 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:38.696587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:40.740738 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:40.740694    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:40.840302 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:40.840267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:41.245999 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:41.245962    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:41.346583 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:41.346546    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:41.944454 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:41.944416    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:42.085472 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.085436    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:42.211733 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.211647    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"]
Sep 15 19:18:42.215720 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.215696    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.217695 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.217670    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-25b1b3-openshift-default-dockercfg-9tdtt\""
Sep 15 19:18:42.227170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.227141    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"]
Sep 15 19:18:42.243775 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.243738    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:42.332932 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.332899    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t65wc\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-kube-api-access-t65wc\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.333104 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.332945    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-podinfo\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.333104 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.333019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-socket\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.333104 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.333079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-data\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.333104 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.333101    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63562e92-1abb-452e-bb61-7cd040cfc1d0-istiod-ca-cert\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.333247 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.333129    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-envoy\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.333247 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.333181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-credential-socket\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.333247 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.333239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-certs\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.333348 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.333267    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-token\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.433827 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.433772    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-data\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434011 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.433851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63562e92-1abb-452e-bb61-7cd040cfc1d0-istiod-ca-cert\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434011 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.433894    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-envoy\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434011 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.433936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-credential-socket\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434011 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.433979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-certs\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434011 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-token\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434300 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434236    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-data\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434377 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434353    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-credential-socket\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434437 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434390    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t65wc\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-kube-api-access-t65wc\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-podinfo\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434486    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-certs\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434598 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-socket\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434654 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434632    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63562e92-1abb-452e-bb61-7cd040cfc1d0-istiod-ca-cert\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.434752 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.434730    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-socket\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.436349 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.436324    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-envoy\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.436795 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.436778    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-podinfo\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.447112 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.447089    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-token\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.447268 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.447251    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t65wc\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-kube-api-access-t65wc\") pod \"e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") " pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.528421 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.528325    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:42.565990 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.565952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:42.808073 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.808048    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"]
Sep 15 19:18:42.809167 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:18:42.809143    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63562e92_1abb_452e_bb61_7cd040cfc1d0.slice/crio-bdd5d3a8b4c73221e76ca033b537504061af6f048c5a122b2a140d4fabe4057c WatchSource:0}: Error finding container bdd5d3a8b4c73221e76ca033b537504061af6f048c5a122b2a140d4fabe4057c: Status 404 returned error can't find the container with id bdd5d3a8b4c73221e76ca033b537504061af6f048c5a122b2a140d4fabe4057c
Sep 15 19:18:42.811369 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.811338    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:42.811447 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.811401    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:42.811447 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:42.811435    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:18:43.446497 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:43.446456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" event={"ID":"63562e92-1abb-452e-bb61-7cd040cfc1d0","Type":"ContainerStarted","Data":"3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158"}
Sep 15 19:18:43.446878 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:43.446525    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" event={"ID":"63562e92-1abb-452e-bb61-7cd040cfc1d0","Type":"ContainerStarted","Data":"bdd5d3a8b4c73221e76ca033b537504061af6f048c5a122b2a140d4fabe4057c"}
Sep 15 19:18:43.467159 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:43.467107    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" podStartSLOduration=1.467092227 podStartE2EDuration="1.467092227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:18:43.465002091 +0000 UTC m=+1698.413230420" watchObservedRunningTime="2026-09-15 19:18:43.467092227 +0000 UTC m=+1698.415320597"
Sep 15 19:18:43.528506 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:43.528477    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:43.533669 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:43.533644    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:44.453306 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:44.453273    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:44.454292 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:44.454271    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:18:44.682672 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:44.682637    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:45.312554 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:45.312519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:45.412432 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:45.412390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:45.512353 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:45.512319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:46.263232 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:46.263189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:46.959345 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:46.959309    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:47.772070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:47.772042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:47.873614 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:47.873577    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:47.974069 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:47.973992    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:48.331822 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.331785    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:48.400294 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.400261    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"]
Sep 15 19:18:48.404890 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.404873    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:48.407510 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.407490    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-25b1b3\""
Sep 15 19:18:48.407624 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.407560    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-25b1b3-dockercfg-dmxlh\""
Sep 15 19:18:48.416756 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.416734    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"]
Sep 15 19:18:48.422874 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.422848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:18:48.491538 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.491497    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95p22\" (UniqueName: \"kubernetes.io/projected/75300cbd-c47c-457e-9e8f-41ddc00ec715-kube-api-access-95p22\") pod \"payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7\" (UID: \"75300cbd-c47c-457e-9e8f-41ddc00ec715\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:48.491738 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.491563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75300cbd-c47c-457e-9e8f-41ddc00ec715-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7\" (UID: \"75300cbd-c47c-457e-9e8f-41ddc00ec715\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:48.592533 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.592439    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75300cbd-c47c-457e-9e8f-41ddc00ec715-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7\" (UID: \"75300cbd-c47c-457e-9e8f-41ddc00ec715\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:48.592702 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.592565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95p22\" (UniqueName: \"kubernetes.io/projected/75300cbd-c47c-457e-9e8f-41ddc00ec715-kube-api-access-95p22\") pod \"payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7\" (UID: \"75300cbd-c47c-457e-9e8f-41ddc00ec715\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:48.593184 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.593159    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75300cbd-c47c-457e-9e8f-41ddc00ec715-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7\" (UID: \"75300cbd-c47c-457e-9e8f-41ddc00ec715\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:48.600261 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.600232    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95p22\" (UniqueName: \"kubernetes.io/projected/75300cbd-c47c-457e-9e8f-41ddc00ec715-kube-api-access-95p22\") pod \"payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7\" (UID: \"75300cbd-c47c-457e-9e8f-41ddc00ec715\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:48.717212 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.717185    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:48.993457 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:48.993420    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"]
Sep 15 19:18:48.995092 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:18:48.995067    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75300cbd_c47c_457e_9e8f_41ddc00ec715.slice/crio-8e77bf71e9963efdf62d73968b9f9e3b67d459da4e3be6791245a608912f011f WatchSource:0}: Error finding container 8e77bf71e9963efdf62d73968b9f9e3b67d459da4e3be6791245a608912f011f: Status 404 returned error can't find the container with id 8e77bf71e9963efdf62d73968b9f9e3b67d459da4e3be6791245a608912f011f
Sep 15 19:18:49.485789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:49.485748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7" event={"ID":"75300cbd-c47c-457e-9e8f-41ddc00ec715","Type":"ContainerStarted","Data":"9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377"}
Sep 15 19:18:49.485985 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:49.485801    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7" event={"ID":"75300cbd-c47c-457e-9e8f-41ddc00ec715","Type":"ContainerStarted","Data":"8e77bf71e9963efdf62d73968b9f9e3b67d459da4e3be6791245a608912f011f"}
Sep 15 19:18:49.485985 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:49.485864    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:18:49.504048 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:18:49.504007    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7" podStartSLOduration=1.503993619 podStartE2EDuration="1.503993619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:18:49.501124534 +0000 UTC m=+1704.449352861" watchObservedRunningTime="2026-09-15 19:18:49.503993619 +0000 UTC m=+1704.452221949"
Sep 15 19:19:00.494945 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:00.494911    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:19:02.924581 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:02.924546    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:03.031671 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:03.031641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:03.600564 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:03.600534    2572 generic.go:356] "Generic (PLEG): container finished" podID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerID="3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158" exitCode=0
Sep 15 19:19:03.600739 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:03.600607    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" event={"ID":"63562e92-1abb-452e-bb61-7cd040cfc1d0","Type":"ContainerDied","Data":"3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158"}
Sep 15 19:19:03.601051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:03.601037    2572 scope.go:117] "RemoveContainer" containerID="3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158"
Sep 15 19:19:03.602202 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:03.602177    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:19:03.602265 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:03.602241    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:19:03.602306 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:03.602271    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 19:19:04.608752 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:04.608715    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" event={"ID":"63562e92-1abb-452e-bb61-7cd040cfc1d0","Type":"ContainerStarted","Data":"52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6"}
Sep 15 19:19:05.529001 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:05.528961    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:19:05.529223 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:05.529093    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 19:19:05.529223 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:05.529147    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 19:19:06.529131 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:06.529083    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 19:19:06.529646 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:06.529156    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 19:19:07.529193 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:07.529137    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 19:19:07.529713 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:07.529212    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 19:19:08.529192 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:08.529150    2572 patch_prober.go:28] interesting pod/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Sep 15 19:19:08.529523 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:08.529489    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Sep 15 19:19:09.708697 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:09.708659    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:19:09.709189 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:09.709097    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:19:09.709907 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:09.709886    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:19:09.772914 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:09.772870    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:10.380799 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:10.380756    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:10.481652 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:10.481621    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:10.957720 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:10.957689    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:12.176268 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:12.176234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:12.275642 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:12.275594    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:15.701529 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:15.701504    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-tflk8_2dca0223-6688-4aed-a5ca-0f22cabeef5d/payload-processing/0.log"
Sep 15 19:19:15.830068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:15.830041    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-tflk8_2dca0223-6688-4aed-a5ca-0f22cabeef5d/payload-processing/0.log"
Sep 15 19:19:15.960089 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:15.960017    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7_75300cbd-c47c-457e-9e8f-41ddc00ec715/payload-processing/0.log"
Sep 15 19:19:18.961786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:18.961747    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:25.962063 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:25.962025    2572 scope.go:117] "RemoveContainer" containerID="0ce3ab9ffef6fe3ba9f496b0b9258e7a18a6d6076273039a0c63383873f626f9"
Sep 15 19:19:32.552263 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:32.552233    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:19:38.551729 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:38.551693    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:19:47.102350 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:47.102302    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h_ca3e48c6-3d56-490f-a271-01fbf3464259/payload-processing/0.log"
Sep 15 19:19:47.236198 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:47.236168    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-tflk8_2dca0223-6688-4aed-a5ca-0f22cabeef5d/payload-processing/0.log"
Sep 15 19:19:47.374196 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:47.374105    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-tflk8_2dca0223-6688-4aed-a5ca-0f22cabeef5d/payload-processing/0.log"
Sep 15 19:19:47.510696 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:47.510665    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7_75300cbd-c47c-457e-9e8f-41ddc00ec715/payload-processing/0.log"
Sep 15 19:19:47.809493 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:47.809450    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:48.144894 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:48.144762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:48.386280 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:48.386247    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:50.881380 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:50.881345    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:51.540013 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:51.539979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:51.639939 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:51.639908    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:51.740441 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:51.740410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:52.559320 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:52.559277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:53.138225 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:53.138195    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:53.875708 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:53.875674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:54.501836 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:54.501788    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:54.602029 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:54.601992    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:54.701576 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:54.701548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:54.951308 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:54.951272    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:55.045602 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.045566    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:19:55.047473 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.047452    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"]
Sep 15 19:19:55.051192 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.051176    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.053209 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.053183    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-93b6ef\""
Sep 15 19:19:55.053338 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.053266    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-93b6ef-dockercfg-bcfpr\""
Sep 15 19:19:55.062679 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.062646    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"]
Sep 15 19:19:55.128149 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.128118    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8905324d-5596-4bbc-a729-6b8264a7697e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm\" (UID: \"8905324d-5596-4bbc-a729-6b8264a7697e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.128285 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.128152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxcp4\" (UniqueName: \"kubernetes.io/projected/8905324d-5596-4bbc-a729-6b8264a7697e-kube-api-access-fxcp4\") pod \"payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm\" (UID: \"8905324d-5596-4bbc-a729-6b8264a7697e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.229729 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.229637    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8905324d-5596-4bbc-a729-6b8264a7697e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm\" (UID: \"8905324d-5596-4bbc-a729-6b8264a7697e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.229729 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.229684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcp4\" (UniqueName: \"kubernetes.io/projected/8905324d-5596-4bbc-a729-6b8264a7697e-kube-api-access-fxcp4\") pod \"payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm\" (UID: \"8905324d-5596-4bbc-a729-6b8264a7697e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.230398 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.230380    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8905324d-5596-4bbc-a729-6b8264a7697e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm\" (UID: \"8905324d-5596-4bbc-a729-6b8264a7697e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.236924 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.236905    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxcp4\" (UniqueName: \"kubernetes.io/projected/8905324d-5596-4bbc-a729-6b8264a7697e-kube-api-access-fxcp4\") pod \"payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm\" (UID: \"8905324d-5596-4bbc-a729-6b8264a7697e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.361951 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.361917    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.632462 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.632435    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"]
Sep 15 19:19:55.633430 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:19:55.633399    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8905324d_5596_4bbc_a729_6b8264a7697e.slice/crio-09af8bb537e47a6edc7e3cc5d8fa6580ff634c5ab1f9faa7e65a34c79d85e576 WatchSource:0}: Error finding container 09af8bb537e47a6edc7e3cc5d8fa6580ff634c5ab1f9faa7e65a34c79d85e576: Status 404 returned error can't find the container with id 09af8bb537e47a6edc7e3cc5d8fa6580ff634c5ab1f9faa7e65a34c79d85e576
Sep 15 19:19:55.927612 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.927571    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm" event={"ID":"8905324d-5596-4bbc-a729-6b8264a7697e","Type":"ContainerStarted","Data":"9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8"}
Sep 15 19:19:55.927789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.927626    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm" event={"ID":"8905324d-5596-4bbc-a729-6b8264a7697e","Type":"ContainerStarted","Data":"09af8bb537e47a6edc7e3cc5d8fa6580ff634c5ab1f9faa7e65a34c79d85e576"}
Sep 15 19:19:55.927789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.927682    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:19:55.943224 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:19:55.943179    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm" podStartSLOduration=0.94316301 podStartE2EDuration="943.16301ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:19:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:19:55.941792461 +0000 UTC m=+1770.890020787" watchObservedRunningTime="2026-09-15 19:19:55.94316301 +0000 UTC m=+1770.891391335"
Sep 15 19:20:06.936467 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:06.936431    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:20:16.556681 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:16.556643    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:16.726970 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:16.726934    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:17.396148 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.396113    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:17.464272 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.464242    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"]
Sep 15 19:20:17.467899 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.467879    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"
Sep 15 19:20:17.470109 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.470090    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:20:17.475589 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.475563    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"]
Sep 15 19:20:17.637963 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.637927    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45a9d41f-4193-4267-8d25-31e8059c5b37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9\" (UID: \"45a9d41f-4193-4267-8d25-31e8059c5b37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"
Sep 15 19:20:17.739238 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.739199    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45a9d41f-4193-4267-8d25-31e8059c5b37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9\" (UID: \"45a9d41f-4193-4267-8d25-31e8059c5b37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"
Sep 15 19:20:17.739829 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.739790    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45a9d41f-4193-4267-8d25-31e8059c5b37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9\" (UID: \"45a9d41f-4193-4267-8d25-31e8059c5b37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"
Sep 15 19:20:17.779919 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:17.779899    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"
Sep 15 19:20:18.053498 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:18.053467    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"]
Sep 15 19:20:18.054342 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:20:18.054315    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a9d41f_4193_4267_8d25_31e8059c5b37.slice/crio-eaeb14479bc05a0f6ad8c272c0db647254a900bea00fe503efa21deea4876371 WatchSource:0}: Error finding container eaeb14479bc05a0f6ad8c272c0db647254a900bea00fe503efa21deea4876371: Status 404 returned error can't find the container with id eaeb14479bc05a0f6ad8c272c0db647254a900bea00fe503efa21deea4876371
Sep 15 19:20:18.065612 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:18.065588    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9" event={"ID":"45a9d41f-4193-4267-8d25-31e8059c5b37","Type":"ContainerStarted","Data":"eaeb14479bc05a0f6ad8c272c0db647254a900bea00fe503efa21deea4876371"}
Sep 15 19:20:18.190855 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:18.190798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:18.843201 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:18.843171    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:19.073829 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:19.073726    2572 generic.go:356] "Generic (PLEG): container finished" podID="45a9d41f-4193-4267-8d25-31e8059c5b37" containerID="56416d1d94091127a8206fc954163469289178f146b35d30547027159978fe83" exitCode=0
Sep 15 19:20:19.074009 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:19.073823    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9" event={"ID":"45a9d41f-4193-4267-8d25-31e8059c5b37","Type":"ContainerDied","Data":"56416d1d94091127a8206fc954163469289178f146b35d30547027159978fe83"}
Sep 15 19:20:19.492255 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:19.492220    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:20.168448 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:20.168416    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:20.217773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:20.217745    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"
Sep 15 19:20:20.366300 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:20.366218    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45a9d41f-4193-4267-8d25-31e8059c5b37-maas-api-service-ca\") pod \"45a9d41f-4193-4267-8d25-31e8059c5b37\" (UID: \"45a9d41f-4193-4267-8d25-31e8059c5b37\") "
Sep 15 19:20:20.366561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:20.366539    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45a9d41f-4193-4267-8d25-31e8059c5b37-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45a9d41f-4193-4267-8d25-31e8059c5b37" (UID: "45a9d41f-4193-4267-8d25-31e8059c5b37"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:20:20.467625 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:20.467593    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45a9d41f-4193-4267-8d25-31e8059c5b37-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:20:20.780614 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:20.780585    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:20.881325 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:20.881292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:21.087605 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:21.087533    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"
Sep 15 19:20:21.087605 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:21.087575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9" event={"ID":"45a9d41f-4193-4267-8d25-31e8059c5b37","Type":"ContainerDied","Data":"eaeb14479bc05a0f6ad8c272c0db647254a900bea00fe503efa21deea4876371"}
Sep 15 19:20:21.087789 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:21.087620    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaeb14479bc05a0f6ad8c272c0db647254a900bea00fe503efa21deea4876371"
Sep 15 19:20:21.474645 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:21.474612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:22.178510 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:22.178474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:23.047197 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.047161    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:23.591883 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.591855    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:23.620735 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.620696    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"]
Sep 15 19:20:23.621005 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.620976    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm" podUID="8905324d-5596-4bbc-a729-6b8264a7697e" containerName="payload-pre-processing" containerID="cri-o://9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8" gracePeriod=30
Sep 15 19:20:23.692781 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.692748    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:23.766142 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.766085    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"]
Sep 15 19:20:23.766444 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.766412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:23.769773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.769744    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-93b6ef-sf7l9"]
Sep 15 19:20:23.828048 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.827974    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:23.884739 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.884716    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:20:23.999367 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.999333    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8905324d-5596-4bbc-a729-6b8264a7697e-plugins-config-volume\") pod \"8905324d-5596-4bbc-a729-6b8264a7697e\" (UID: \"8905324d-5596-4bbc-a729-6b8264a7697e\") "
Sep 15 19:20:23.999542 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.999433    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxcp4\" (UniqueName: \"kubernetes.io/projected/8905324d-5596-4bbc-a729-6b8264a7697e-kube-api-access-fxcp4\") pod \"8905324d-5596-4bbc-a729-6b8264a7697e\" (UID: \"8905324d-5596-4bbc-a729-6b8264a7697e\") "
Sep 15 19:20:23.999686 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:23.999663    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8905324d-5596-4bbc-a729-6b8264a7697e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8905324d-5596-4bbc-a729-6b8264a7697e" (UID: "8905324d-5596-4bbc-a729-6b8264a7697e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:20:24.001493 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.001474    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8905324d-5596-4bbc-a729-6b8264a7697e-kube-api-access-fxcp4" (OuterVolumeSpecName: "kube-api-access-fxcp4") pod "8905324d-5596-4bbc-a729-6b8264a7697e" (UID: "8905324d-5596-4bbc-a729-6b8264a7697e"). InnerVolumeSpecName "kube-api-access-fxcp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:20:24.100226 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.100197    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxcp4\" (UniqueName: \"kubernetes.io/projected/8905324d-5596-4bbc-a729-6b8264a7697e-kube-api-access-fxcp4\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:20:24.100226 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.100223    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8905324d-5596-4bbc-a729-6b8264a7697e-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:20:24.106683 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.106657    2572 generic.go:356] "Generic (PLEG): container finished" podID="8905324d-5596-4bbc-a729-6b8264a7697e" containerID="9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8" exitCode=0
Sep 15 19:20:24.106776 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.106712    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"
Sep 15 19:20:24.106776 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.106741    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm" event={"ID":"8905324d-5596-4bbc-a729-6b8264a7697e","Type":"ContainerDied","Data":"9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8"}
Sep 15 19:20:24.106888 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.106795    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm" event={"ID":"8905324d-5596-4bbc-a729-6b8264a7697e","Type":"ContainerDied","Data":"09af8bb537e47a6edc7e3cc5d8fa6580ff634c5ab1f9faa7e65a34c79d85e576"}
Sep 15 19:20:24.106888 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.106842    2572 scope.go:117] "RemoveContainer" containerID="9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8"
Sep 15 19:20:24.117061 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.117042    2572 scope.go:117] "RemoveContainer" containerID="9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8"
Sep 15 19:20:24.117334 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:20:24.117316    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8\": container with ID starting with 9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8 not found: ID does not exist" containerID="9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8"
Sep 15 19:20:24.117383 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.117343    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8"} err="failed to get container status \"9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8\": rpc error: code = NotFound desc = could not find container \"9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8\": container with ID starting with 9b48d31c0219164fe4cd210d30388974b56ff6b1598200a880d977afcc76f3d8 not found: ID does not exist"
Sep 15 19:20:24.129564 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.129536    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"]
Sep 15 19:20:24.135068 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.135048    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-93b6ef-dfc477694-strfm"]
Sep 15 19:20:24.176950 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.176925    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:24.276779 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:24.276746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:25.060919 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:25.060880    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:25.558820 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:25.558780    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45a9d41f-4193-4267-8d25-31e8059c5b37" path="/var/lib/kubelet/pods/45a9d41f-4193-4267-8d25-31e8059c5b37/volumes"
Sep 15 19:20:25.559160 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:25.559134    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8905324d-5596-4bbc-a729-6b8264a7697e" path="/var/lib/kubelet/pods/8905324d-5596-4bbc-a729-6b8264a7697e/volumes"
Sep 15 19:20:25.603288 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:25.603259    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:25.708798 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:25.708767    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:20:25.710329 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:25.710295    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:20:25.990743 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:25.990701    2572 scope.go:117] "RemoveContainer" containerID="001d95c7ab160c9f1909e4589784153abf2a009a4c75d9814fab94e5608128c7"
Sep 15 19:20:26.142037 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:26.141993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:26.874273 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:26.874238    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:29.856870 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:29.856837    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:29.958248 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:29.958217    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:30.137043 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:30.136954    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:34.003179 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.003136    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"]
Sep 15 19:20:34.003734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.003712    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8905324d-5596-4bbc-a729-6b8264a7697e" containerName="payload-pre-processing"
Sep 15 19:20:34.003857 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.003735    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8905324d-5596-4bbc-a729-6b8264a7697e" containerName="payload-pre-processing"
Sep 15 19:20:34.003857 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.003765    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a9d41f-4193-4267-8d25-31e8059c5b37" containerName="revoke-keys"
Sep 15 19:20:34.003857 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.003774    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a9d41f-4193-4267-8d25-31e8059c5b37" containerName="revoke-keys"
Sep 15 19:20:34.004023 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.003911    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8905324d-5596-4bbc-a729-6b8264a7697e" containerName="payload-pre-processing"
Sep 15 19:20:34.004023 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.003928    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a9d41f-4193-4267-8d25-31e8059c5b37" containerName="revoke-keys"
Sep 15 19:20:34.007045 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.007021    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"
Sep 15 19:20:34.009193 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.009173    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:20:34.014176 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.014152    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"]
Sep 15 19:20:34.093246 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.093217    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27f1d584-47b0-45be-840e-09e7cf4a67fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk\" (UID: \"27f1d584-47b0-45be-840e-09e7cf4a67fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"
Sep 15 19:20:34.151930 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.151900    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:34.194215 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.194146    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27f1d584-47b0-45be-840e-09e7cf4a67fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk\" (UID: \"27f1d584-47b0-45be-840e-09e7cf4a67fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"
Sep 15 19:20:34.194770 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.194743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27f1d584-47b0-45be-840e-09e7cf4a67fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk\" (UID: \"27f1d584-47b0-45be-840e-09e7cf4a67fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"
Sep 15 19:20:34.319148 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.319116    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"
Sep 15 19:20:34.592362 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:34.592335    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"]
Sep 15 19:20:34.594153 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:20:34.594127    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f1d584_47b0_45be_840e_09e7cf4a67fb.slice/crio-27d5ab9b97434c7f1525e28327f8039acc35ff2fbcecfd5e2c07155eda0032a3 WatchSource:0}: Error finding container 27d5ab9b97434c7f1525e28327f8039acc35ff2fbcecfd5e2c07155eda0032a3: Status 404 returned error can't find the container with id 27d5ab9b97434c7f1525e28327f8039acc35ff2fbcecfd5e2c07155eda0032a3
Sep 15 19:20:35.164574 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:35.164544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:35.173231 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:35.173157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk" event={"ID":"27f1d584-47b0-45be-840e-09e7cf4a67fb","Type":"ContainerStarted","Data":"f583fab19832fd44a02a2239bd600b75fe2d7401aa4824aee408e27cde42de58"}
Sep 15 19:20:35.173231 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:35.173219    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk" event={"ID":"27f1d584-47b0-45be-840e-09e7cf4a67fb","Type":"ContainerStarted","Data":"27d5ab9b97434c7f1525e28327f8039acc35ff2fbcecfd5e2c07155eda0032a3"}
Sep 15 19:20:35.195898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:35.195851    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk" podStartSLOduration=2.195836452 podStartE2EDuration="2.195836452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:20:35.193067138 +0000 UTC m=+1810.141295466" watchObservedRunningTime="2026-09-15 19:20:35.195836452 +0000 UTC m=+1810.144064778"
Sep 15 19:20:36.094614 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:36.094573    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:36.180878 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:36.180840    2572 generic.go:356] "Generic (PLEG): container finished" podID="27f1d584-47b0-45be-840e-09e7cf4a67fb" containerID="f583fab19832fd44a02a2239bd600b75fe2d7401aa4824aee408e27cde42de58" exitCode=0
Sep 15 19:20:36.181314 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:36.180916    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk" event={"ID":"27f1d584-47b0-45be-840e-09e7cf4a67fb","Type":"ContainerDied","Data":"f583fab19832fd44a02a2239bd600b75fe2d7401aa4824aee408e27cde42de58"}
Sep 15 19:20:36.552087 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:36.552054    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:20:36.662262 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:36.662230    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:37.304003 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:37.303974    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:37.323462 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:37.323439    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"
Sep 15 19:20:37.426367 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:37.426330    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27f1d584-47b0-45be-840e-09e7cf4a67fb-maas-api-service-ca\") pod \"27f1d584-47b0-45be-840e-09e7cf4a67fb\" (UID: \"27f1d584-47b0-45be-840e-09e7cf4a67fb\") "
Sep 15 19:20:37.426663 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:37.426640    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f1d584-47b0-45be-840e-09e7cf4a67fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27f1d584-47b0-45be-840e-09e7cf4a67fb" (UID: "27f1d584-47b0-45be-840e-09e7cf4a67fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:20:37.528215 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:37.528137    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27f1d584-47b0-45be-840e-09e7cf4a67fb-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:20:38.030643 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:38.030605    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:38.194579 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:38.194550    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"
Sep 15 19:20:38.194734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:38.194592    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk" event={"ID":"27f1d584-47b0-45be-840e-09e7cf4a67fb","Type":"ContainerDied","Data":"27d5ab9b97434c7f1525e28327f8039acc35ff2fbcecfd5e2c07155eda0032a3"}
Sep 15 19:20:38.194734 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:38.194643    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27d5ab9b97434c7f1525e28327f8039acc35ff2fbcecfd5e2c07155eda0032a3"
Sep 15 19:20:48.554339 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:48.554307    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:49.520721 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.520688    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:49.543509 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.543474    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"]
Sep 15 19:20:49.543743 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.543714    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h" podUID="ca3e48c6-3d56-490f-a271-01fbf3464259" containerName="payload-processing" containerID="cri-o://5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed" gracePeriod=30
Sep 15 19:20:49.560911 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.560881    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"]
Sep 15 19:20:49.561330 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.561122    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg" podUID="df866bd6-0a34-41c1-a5f3-3d8ed311328a" containerName="payload-pre-processing" containerID="cri-o://02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd" gracePeriod=30
Sep 15 19:20:49.656358 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.656333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:49.768506 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.768475    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:49.842726 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.842699    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:20:49.846025 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.846000    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:20:49.848489 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.848469    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"]
Sep 15 19:20:49.851005 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.850981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:49.852003 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.851981    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6eb41d-btlmk"]
Sep 15 19:20:49.911294 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.911264    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:49.938753 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.938714    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3e48c6-3d56-490f-a271-01fbf3464259-plugins-config-volume\") pod \"ca3e48c6-3d56-490f-a271-01fbf3464259\" (UID: \"ca3e48c6-3d56-490f-a271-01fbf3464259\") "
Sep 15 19:20:49.939281 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.939155    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3e48c6-3d56-490f-a271-01fbf3464259-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca3e48c6-3d56-490f-a271-01fbf3464259" (UID: "ca3e48c6-3d56-490f-a271-01fbf3464259"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:20:49.939408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.939326    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv2mh\" (UniqueName: \"kubernetes.io/projected/ca3e48c6-3d56-490f-a271-01fbf3464259-kube-api-access-zv2mh\") pod \"ca3e48c6-3d56-490f-a271-01fbf3464259\" (UID: \"ca3e48c6-3d56-490f-a271-01fbf3464259\") "
Sep 15 19:20:49.939725 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.939701    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjgxb\" (UniqueName: \"kubernetes.io/projected/df866bd6-0a34-41c1-a5f3-3d8ed311328a-kube-api-access-hjgxb\") pod \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\" (UID: \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\") "
Sep 15 19:20:49.939875 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.939752    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df866bd6-0a34-41c1-a5f3-3d8ed311328a-plugins-config-volume\") pod \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\" (UID: \"df866bd6-0a34-41c1-a5f3-3d8ed311328a\") "
Sep 15 19:20:49.940164 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.940114    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3e48c6-3d56-490f-a271-01fbf3464259-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:20:49.940467 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.940408    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df866bd6-0a34-41c1-a5f3-3d8ed311328a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "df866bd6-0a34-41c1-a5f3-3d8ed311328a" (UID: "df866bd6-0a34-41c1-a5f3-3d8ed311328a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:20:49.942038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.942013    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3e48c6-3d56-490f-a271-01fbf3464259-kube-api-access-zv2mh" (OuterVolumeSpecName: "kube-api-access-zv2mh") pod "ca3e48c6-3d56-490f-a271-01fbf3464259" (UID: "ca3e48c6-3d56-490f-a271-01fbf3464259"). InnerVolumeSpecName "kube-api-access-zv2mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:20:49.942309 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:49.942275    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df866bd6-0a34-41c1-a5f3-3d8ed311328a-kube-api-access-hjgxb" (OuterVolumeSpecName: "kube-api-access-hjgxb") pod "df866bd6-0a34-41c1-a5f3-3d8ed311328a" (UID: "df866bd6-0a34-41c1-a5f3-3d8ed311328a"). InnerVolumeSpecName "kube-api-access-hjgxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:20:50.041443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.041410    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv2mh\" (UniqueName: \"kubernetes.io/projected/ca3e48c6-3d56-490f-a271-01fbf3464259-kube-api-access-zv2mh\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:20:50.041443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.041439    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjgxb\" (UniqueName: \"kubernetes.io/projected/df866bd6-0a34-41c1-a5f3-3d8ed311328a-kube-api-access-hjgxb\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:20:50.041443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.041449    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df866bd6-0a34-41c1-a5f3-3d8ed311328a-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:20:50.228799 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.228747    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:50.273514 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.273480    2572 generic.go:356] "Generic (PLEG): container finished" podID="df866bd6-0a34-41c1-a5f3-3d8ed311328a" containerID="02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd" exitCode=0
Sep 15 19:20:50.273682 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.273526    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"
Sep 15 19:20:50.273682 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.273614    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg" event={"ID":"df866bd6-0a34-41c1-a5f3-3d8ed311328a","Type":"ContainerDied","Data":"02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd"}
Sep 15 19:20:50.273682 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.273671    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg" event={"ID":"df866bd6-0a34-41c1-a5f3-3d8ed311328a","Type":"ContainerDied","Data":"fe03f997755dc72407ba2466215901ac3002895225c4437b08b2407e66858f20"}
Sep 15 19:20:50.273874 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.273699    2572 scope.go:117] "RemoveContainer" containerID="02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd"
Sep 15 19:20:50.275266 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.275237    2572 generic.go:356] "Generic (PLEG): container finished" podID="ca3e48c6-3d56-490f-a271-01fbf3464259" containerID="5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed" exitCode=0
Sep 15 19:20:50.275408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.275277    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h" event={"ID":"ca3e48c6-3d56-490f-a271-01fbf3464259","Type":"ContainerDied","Data":"5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed"}
Sep 15 19:20:50.275408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.275319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h" event={"ID":"ca3e48c6-3d56-490f-a271-01fbf3464259","Type":"ContainerDied","Data":"83883f8ca863a95dd5b777b117c635e83b5b9fe53043f2aa907e9aee3966c884"}
Sep 15 19:20:50.275408 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.275281    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"
Sep 15 19:20:50.284290 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.284268    2572 scope.go:117] "RemoveContainer" containerID="02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd"
Sep 15 19:20:50.284605 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:20:50.284582    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd\": container with ID starting with 02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd not found: ID does not exist" containerID="02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd"
Sep 15 19:20:50.284685 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.284616    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd"} err="failed to get container status \"02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd\": rpc error: code = NotFound desc = could not find container \"02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd\": container with ID starting with 02d67f515c4dbfa2db2b0eb26dfa72423a74ba2bf60bc164d5aa43fe09af92fd not found: ID does not exist"
Sep 15 19:20:50.284685 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.284639    2572 scope.go:117] "RemoveContainer" containerID="5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed"
Sep 15 19:20:50.292861 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.292844    2572 scope.go:117] "RemoveContainer" containerID="5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed"
Sep 15 19:20:50.293143 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:20:50.293124    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed\": container with ID starting with 5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed not found: ID does not exist" containerID="5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed"
Sep 15 19:20:50.293205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.293149    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed"} err="failed to get container status \"5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed\": rpc error: code = NotFound desc = could not find container \"5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed\": container with ID starting with 5d8cbe0ef75ed048cd65063fa9abb43eaf9fad18aa882678aaef710b3cecbfed not found: ID does not exist"
Sep 15 19:20:50.297281 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.297256    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"]
Sep 15 19:20:50.300153 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.300131    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:50.303211 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.303192    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6eb41d-6d8f88b6bb-jlrfg"]
Sep 15 19:20:50.311839 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.311819    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"]
Sep 15 19:20:50.315353 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.315334    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6eb41d-77f5cf5fc7-jdc8h"]
Sep 15 19:20:50.787307 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:50.787276    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:51.517978 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:51.517943    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:51.564632 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:51.564594    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f1d584-47b0-45be-840e-09e7cf4a67fb" path="/var/lib/kubelet/pods/27f1d584-47b0-45be-840e-09e7cf4a67fb/volumes"
Sep 15 19:20:51.565060 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:51.565042    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3e48c6-3d56-490f-a271-01fbf3464259" path="/var/lib/kubelet/pods/ca3e48c6-3d56-490f-a271-01fbf3464259/volumes"
Sep 15 19:20:51.565367 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:51.565355    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df866bd6-0a34-41c1-a5f3-3d8ed311328a" path="/var/lib/kubelet/pods/df866bd6-0a34-41c1-a5f3-3d8ed311328a/volumes"
Sep 15 19:20:52.279119 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:52.279089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:20:55.307067 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:20:55.307031    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:05.556486 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:05.556452    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:21:26.017217 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:26.017181    2572 scope.go:117] "RemoveContainer" containerID="c2d2ae18c3b6fa95062e5a4730a942a19e17269995b4ccecc289882f97d865ee"
Sep 15 19:21:26.026902 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:26.026875    2572 scope.go:117] "RemoveContainer" containerID="f252c7e4f762de4a21a84239ec0533f9388f7f86c57b6c5730cd02da57a19383"
Sep 15 19:21:31.482198 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:31.482159    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:32.917216 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:32.917166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:37.901445 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:37.901403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:37.963343 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:37.963304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:38.142432 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.142376    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:38.174979 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.174938    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"]
Sep 15 19:21:38.175207 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.175180    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy" containerID="cri-o://9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5" gracePeriod=30
Sep 15 19:21:38.214484 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.214448    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:38.608452 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.608333    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"]
Sep 15 19:21:38.609283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609248    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3e48c6-3d56-490f-a271-01fbf3464259" containerName="payload-processing"
Sep 15 19:21:38.609283 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609284    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3e48c6-3d56-490f-a271-01fbf3464259" containerName="payload-processing"
Sep 15 19:21:38.609502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609328    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f1d584-47b0-45be-840e-09e7cf4a67fb" containerName="revoke-keys"
Sep 15 19:21:38.609502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609338    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f1d584-47b0-45be-840e-09e7cf4a67fb" containerName="revoke-keys"
Sep 15 19:21:38.609502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609357    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df866bd6-0a34-41c1-a5f3-3d8ed311328a" containerName="payload-pre-processing"
Sep 15 19:21:38.609502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609368    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="df866bd6-0a34-41c1-a5f3-3d8ed311328a" containerName="payload-pre-processing"
Sep 15 19:21:38.609680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609577    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3e48c6-3d56-490f-a271-01fbf3464259" containerName="payload-processing"
Sep 15 19:21:38.609680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609600    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="df866bd6-0a34-41c1-a5f3-3d8ed311328a" containerName="payload-pre-processing"
Sep 15 19:21:38.609680 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.609612    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="27f1d584-47b0-45be-840e-09e7cf4a67fb" containerName="revoke-keys"
Sep 15 19:21:38.614364 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.614322    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"
Sep 15 19:21:38.616800 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.616757    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:21:38.618058 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.618027    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"]
Sep 15 19:21:38.718062 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.718015    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaef9e5b-5e1f-4572-8902-41a5efa2b601-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq\" (UID: \"eaef9e5b-5e1f-4572-8902-41a5efa2b601\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"
Sep 15 19:21:38.779312 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.779275    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:38.819589 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.819540    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaef9e5b-5e1f-4572-8902-41a5efa2b601-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq\" (UID: \"eaef9e5b-5e1f-4572-8902-41a5efa2b601\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"
Sep 15 19:21:38.820266 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.820238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaef9e5b-5e1f-4572-8902-41a5efa2b601-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq\" (UID: \"eaef9e5b-5e1f-4572-8902-41a5efa2b601\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"
Sep 15 19:21:38.928005 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:38.927959    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"
Sep 15 19:21:39.206008 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:39.205972    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"]
Sep 15 19:21:39.207729 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:21:39.207699    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaef9e5b_5e1f_4572_8902_41a5efa2b601.slice/crio-a6bdaf1498b1c4f9b7560d9d07107d4f1514721bdb7cb9badc25da82d5e4e1d5 WatchSource:0}: Error finding container a6bdaf1498b1c4f9b7560d9d07107d4f1514721bdb7cb9badc25da82d5e4e1d5: Status 404 returned error can't find the container with id a6bdaf1498b1c4f9b7560d9d07107d4f1514721bdb7cb9badc25da82d5e4e1d5
Sep 15 19:21:39.561468 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:39.561435    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:39.588942 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:39.588905    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq" event={"ID":"eaef9e5b-5e1f-4572-8902-41a5efa2b601","Type":"ContainerStarted","Data":"4b1b0f0b2bb766803318e2cb6a96a10894e403aba8d2790186ce704326a2c280"}
Sep 15 19:21:39.589142 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:39.588962    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq" event={"ID":"eaef9e5b-5e1f-4572-8902-41a5efa2b601","Type":"ContainerStarted","Data":"a6bdaf1498b1c4f9b7560d9d07107d4f1514721bdb7cb9badc25da82d5e4e1d5"}
Sep 15 19:21:39.604737 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:39.604675    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq" podStartSLOduration=1.6046586569999999 podStartE2EDuration="1.604658657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:21:39.602881957 +0000 UTC m=+1874.551110284" watchObservedRunningTime="2026-09-15 19:21:39.604658657 +0000 UTC m=+1874.552887002"
Sep 15 19:21:40.168535 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:40.168500    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:40.597105 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:40.597010    2572 generic.go:356] "Generic (PLEG): container finished" podID="eaef9e5b-5e1f-4572-8902-41a5efa2b601" containerID="4b1b0f0b2bb766803318e2cb6a96a10894e403aba8d2790186ce704326a2c280" exitCode=0
Sep 15 19:21:40.597105 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:40.597093    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq" event={"ID":"eaef9e5b-5e1f-4572-8902-41a5efa2b601","Type":"ContainerDied","Data":"4b1b0f0b2bb766803318e2cb6a96a10894e403aba8d2790186ce704326a2c280"}
Sep 15 19:21:40.850918 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:40.850825    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:41.471382 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:41.471344    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:41.742371 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:41.742333    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"
Sep 15 19:21:41.852716 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:41.852665    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaef9e5b-5e1f-4572-8902-41a5efa2b601-maas-api-service-ca\") pod \"eaef9e5b-5e1f-4572-8902-41a5efa2b601\" (UID: \"eaef9e5b-5e1f-4572-8902-41a5efa2b601\") "
Sep 15 19:21:41.853144 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:41.853115    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaef9e5b-5e1f-4572-8902-41a5efa2b601-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eaef9e5b-5e1f-4572-8902-41a5efa2b601" (UID: "eaef9e5b-5e1f-4572-8902-41a5efa2b601"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:21:41.954414 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:41.954370    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaef9e5b-5e1f-4572-8902-41a5efa2b601-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:42.610339 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:42.610307    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"
Sep 15 19:21:42.610339 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:42.610329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq" event={"ID":"eaef9e5b-5e1f-4572-8902-41a5efa2b601","Type":"ContainerDied","Data":"a6bdaf1498b1c4f9b7560d9d07107d4f1514721bdb7cb9badc25da82d5e4e1d5"}
Sep 15 19:21:42.610786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:42.610382    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6bdaf1498b1c4f9b7560d9d07107d4f1514721bdb7cb9badc25da82d5e4e1d5"
Sep 15 19:21:43.447991 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.447918    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:21:43.568918 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.568881    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-token\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569114 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.568930    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-data\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569114 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569014    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istiod-ca-cert\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569114 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569045    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plfxb\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-kube-api-access-plfxb\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569114 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569069    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-podinfo\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569114 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569091    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-certs\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569177    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:21:43.569404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569234    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-socket\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569316    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-envoy\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569384    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-credential-socket\") pod \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\" (UID: \"332988e9-5d12-4d69-a57b-ff4b65baa7c9\") "
Sep 15 19:21:43.569625 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569494    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:21:43.569625 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569519    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:21:43.569773 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569750    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:21:43.569906 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569878    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:21:43.570061 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.569903    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:43.570205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.570183    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:43.570328 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.570208    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:43.570328 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.570253    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:43.571539 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.571505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:21:43.571539 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.571524    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-kube-api-access-plfxb" (OuterVolumeSpecName: "kube-api-access-plfxb") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "kube-api-access-plfxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:21:43.571703 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.571543    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:21:43.571703 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.571618    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "332988e9-5d12-4d69-a57b-ff4b65baa7c9" (UID: "332988e9-5d12-4d69-a57b-ff4b65baa7c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:21:43.621241 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.621203    2572 generic.go:356] "Generic (PLEG): container finished" podID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerID="9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5" exitCode=0
Sep 15 19:21:43.621664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.621271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" event={"ID":"332988e9-5d12-4d69-a57b-ff4b65baa7c9","Type":"ContainerDied","Data":"9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5"}
Sep 15 19:21:43.621664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.621319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552" event={"ID":"332988e9-5d12-4d69-a57b-ff4b65baa7c9","Type":"ContainerDied","Data":"55d644b3ce4b6b9f46b9e1ce515794005ac7c8262113a4a911dfaaa6a78d0691"}
Sep 15 19:21:43.621664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.621272    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"
Sep 15 19:21:43.621664 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.621345    2572 scope.go:117] "RemoveContainer" containerID="9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5"
Sep 15 19:21:43.632618 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.632580    2572 scope.go:117] "RemoveContainer" containerID="d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd"
Sep 15 19:21:43.643048 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.643021    2572 scope.go:117] "RemoveContainer" containerID="9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5"
Sep 15 19:21:43.643431 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:21:43.643404    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5\": container with ID starting with 9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5 not found: ID does not exist" containerID="9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5"
Sep 15 19:21:43.643486 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.643442    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5"} err="failed to get container status \"9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5\": rpc error: code = NotFound desc = could not find container \"9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5\": container with ID starting with 9f903d01db17b583729930e5d22ddc25776a28aadc137156e2538b9e209c57d5 not found: ID does not exist"
Sep 15 19:21:43.643486 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.643462    2572 scope.go:117] "RemoveContainer" containerID="d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd"
Sep 15 19:21:43.643855 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:21:43.643820    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd\": container with ID starting with d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd not found: ID does not exist" containerID="d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd"
Sep 15 19:21:43.643977 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.643858    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd"} err="failed to get container status \"d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd\": rpc error: code = NotFound desc = could not find container \"d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd\": container with ID starting with d108f4c114629dbc1da7edfcdd3f14ef55132480983ca3d5eea272bd09fcd1cd not found: ID does not exist"
Sep 15 19:21:43.644799 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.644773    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"]
Sep 15 19:21:43.647704 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.647669    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-6eb41d-openshift-default-8b94d9b66-xn552"]
Sep 15 19:21:43.671890 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.671851    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plfxb\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-kube-api-access-plfxb\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:43.671890 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.671890    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:43.672138 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.671910    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:43.672138 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.671924    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:43.672138 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:43.671937    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/332988e9-5d12-4d69-a57b-ff4b65baa7c9-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:45.558933 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:45.558894    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" path="/var/lib/kubelet/pods/332988e9-5d12-4d69-a57b-ff4b65baa7c9/volumes"
Sep 15 19:21:49.159285 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.159186    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:49.178545 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.178502    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"]
Sep 15 19:21:49.178846 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.178797    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7" podUID="75300cbd-c47c-457e-9e8f-41ddc00ec715" containerName="payload-processing" containerID="cri-o://9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377" gracePeriod=30
Sep 15 19:21:49.251117 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.251081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:49.319219 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.319167    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"]
Sep 15 19:21:49.320594 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.320555    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:49.322022 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.321999    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25b1b3-ds7gq"]
Sep 15 19:21:49.373360 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.373310    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:49.455183 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.455155    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:21:49.527662 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.527624    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95p22\" (UniqueName: \"kubernetes.io/projected/75300cbd-c47c-457e-9e8f-41ddc00ec715-kube-api-access-95p22\") pod \"75300cbd-c47c-457e-9e8f-41ddc00ec715\" (UID: \"75300cbd-c47c-457e-9e8f-41ddc00ec715\") "
Sep 15 19:21:49.527917 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.527692    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75300cbd-c47c-457e-9e8f-41ddc00ec715-plugins-config-volume\") pod \"75300cbd-c47c-457e-9e8f-41ddc00ec715\" (UID: \"75300cbd-c47c-457e-9e8f-41ddc00ec715\") "
Sep 15 19:21:49.528106 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.528071    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75300cbd-c47c-457e-9e8f-41ddc00ec715-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75300cbd-c47c-457e-9e8f-41ddc00ec715" (UID: "75300cbd-c47c-457e-9e8f-41ddc00ec715"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:21:49.529824 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.529783    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75300cbd-c47c-457e-9e8f-41ddc00ec715-kube-api-access-95p22" (OuterVolumeSpecName: "kube-api-access-95p22") pod "75300cbd-c47c-457e-9e8f-41ddc00ec715" (UID: "75300cbd-c47c-457e-9e8f-41ddc00ec715"). InnerVolumeSpecName "kube-api-access-95p22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:21:49.558767 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.558728    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaef9e5b-5e1f-4572-8902-41a5efa2b601" path="/var/lib/kubelet/pods/eaef9e5b-5e1f-4572-8902-41a5efa2b601/volumes"
Sep 15 19:21:49.629157 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.629106    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95p22\" (UniqueName: \"kubernetes.io/projected/75300cbd-c47c-457e-9e8f-41ddc00ec715-kube-api-access-95p22\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:49.629157 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.629147    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75300cbd-c47c-457e-9e8f-41ddc00ec715-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:49.665039 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.665004    2572 generic.go:356] "Generic (PLEG): container finished" podID="75300cbd-c47c-457e-9e8f-41ddc00ec715" containerID="9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377" exitCode=0
Sep 15 19:21:49.665229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.665068    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"
Sep 15 19:21:49.665229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.665081    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7" event={"ID":"75300cbd-c47c-457e-9e8f-41ddc00ec715","Type":"ContainerDied","Data":"9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377"}
Sep 15 19:21:49.665229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.665129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7" event={"ID":"75300cbd-c47c-457e-9e8f-41ddc00ec715","Type":"ContainerDied","Data":"8e77bf71e9963efdf62d73968b9f9e3b67d459da4e3be6791245a608912f011f"}
Sep 15 19:21:49.665229 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.665152    2572 scope.go:117] "RemoveContainer" containerID="9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377"
Sep 15 19:21:49.675527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.675491    2572 scope.go:117] "RemoveContainer" containerID="9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377"
Sep 15 19:21:49.675930 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:21:49.675899    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377\": container with ID starting with 9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377 not found: ID does not exist" containerID="9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377"
Sep 15 19:21:49.676010 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.675938    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377"} err="failed to get container status \"9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377\": rpc error: code = NotFound desc = could not find container \"9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377\": container with ID starting with 9d2135afa6b248274361bebf4110f9c9647d49c08fe14d03e6a60ce37c5ed377 not found: ID does not exist"
Sep 15 19:21:49.681679 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.681397    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"]
Sep 15 19:21:49.684310 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.684276    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25b1b3-5fbb75f6c7-r6dq7"]
Sep 15 19:21:49.731614 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.731582    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:49.833602 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:49.833561    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:50.290124 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:50.290089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:50.939853 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:50.939773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:51.558048 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:51.558011    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75300cbd-c47c-457e-9e8f-41ddc00ec715" path="/var/lib/kubelet/pods/75300cbd-c47c-457e-9e8f-41ddc00ec715/volumes"
Sep 15 19:21:55.709343 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:55.709309    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:55.809359 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:55.809321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:55.973000 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:55.972896    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"]
Sep 15 19:21:55.973204 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:55.973173    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy" containerID="cri-o://52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6" gracePeriod=30
Sep 15 19:21:55.998480 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:55.998439    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:56.349056 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.348947    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"]
Sep 15 19:21:56.349485 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349462    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy"
Sep 15 19:21:56.349587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349487    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy"
Sep 15 19:21:56.349587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349517    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaef9e5b-5e1f-4572-8902-41a5efa2b601" containerName="revoke-keys"
Sep 15 19:21:56.349587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349525    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaef9e5b-5e1f-4572-8902-41a5efa2b601" containerName="revoke-keys"
Sep 15 19:21:56.349587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349543    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy"
Sep 15 19:21:56.349587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349552    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy"
Sep 15 19:21:56.349587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349571    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75300cbd-c47c-457e-9e8f-41ddc00ec715" containerName="payload-processing"
Sep 15 19:21:56.349587 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349580    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="75300cbd-c47c-457e-9e8f-41ddc00ec715" containerName="payload-processing"
Sep 15 19:21:56.349987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349672    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="75300cbd-c47c-457e-9e8f-41ddc00ec715" containerName="payload-processing"
Sep 15 19:21:56.349987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349687    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaef9e5b-5e1f-4572-8902-41a5efa2b601" containerName="revoke-keys"
Sep 15 19:21:56.349987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349700    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy"
Sep 15 19:21:56.349987 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.349712    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="332988e9-5d12-4d69-a57b-ff4b65baa7c9" containerName="istio-proxy"
Sep 15 19:21:56.354322 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.354292    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"
Sep 15 19:21:56.356702 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.356676    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:21:56.359260 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.359234    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"]
Sep 15 19:21:56.401889 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.401854    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ca70c8-0832-4b69-b562-7f40c7fff6e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs\" (UID: \"c0ca70c8-0832-4b69-b562-7f40c7fff6e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"
Sep 15 19:21:56.502561 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.502521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ca70c8-0832-4b69-b562-7f40c7fff6e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs\" (UID: \"c0ca70c8-0832-4b69-b562-7f40c7fff6e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"
Sep 15 19:21:56.503218 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.503195    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ca70c8-0832-4b69-b562-7f40c7fff6e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs\" (UID: \"c0ca70c8-0832-4b69-b562-7f40c7fff6e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"
Sep 15 19:21:56.668898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.668855    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"
Sep 15 19:21:56.942911 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:56.942877    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"]
Sep 15 19:21:56.944449 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:21:56.944420    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ca70c8_0832_4b69_b562_7f40c7fff6e3.slice/crio-ba3c1235560f20dc5c9137b283b01078f5963acff60023f3de76f846f8ca5e5c WatchSource:0}: Error finding container ba3c1235560f20dc5c9137b283b01078f5963acff60023f3de76f846f8ca5e5c: Status 404 returned error can't find the container with id ba3c1235560f20dc5c9137b283b01078f5963acff60023f3de76f846f8ca5e5c
Sep 15 19:21:57.107935 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:57.107893    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:57.655517 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:57.655480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:57.719515 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:57.719476    2572 generic.go:356] "Generic (PLEG): container finished" podID="c0ca70c8-0832-4b69-b562-7f40c7fff6e3" containerID="a376651f09cc377c66b5e689e6e058d5d00de09fcb932f2146b59a83f2e0d7cd" exitCode=0
Sep 15 19:21:57.719708 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:57.719546    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs" event={"ID":"c0ca70c8-0832-4b69-b562-7f40c7fff6e3","Type":"ContainerDied","Data":"a376651f09cc377c66b5e689e6e058d5d00de09fcb932f2146b59a83f2e0d7cd"}
Sep 15 19:21:57.719708 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:57.719596    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs" event={"ID":"c0ca70c8-0832-4b69-b562-7f40c7fff6e3","Type":"ContainerStarted","Data":"ba3c1235560f20dc5c9137b283b01078f5963acff60023f3de76f846f8ca5e5c"}
Sep 15 19:21:58.390864 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:58.390792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:21:58.552010 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:58.551975    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:21:58.868188 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:58.868159    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"
Sep 15 19:21:58.926049 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:58.926012    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ca70c8-0832-4b69-b562-7f40c7fff6e3-maas-api-service-ca\") pod \"c0ca70c8-0832-4b69-b562-7f40c7fff6e3\" (UID: \"c0ca70c8-0832-4b69-b562-7f40c7fff6e3\") "
Sep 15 19:21:58.926440 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:58.926417    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ca70c8-0832-4b69-b562-7f40c7fff6e3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c0ca70c8-0832-4b69-b562-7f40c7fff6e3" (UID: "c0ca70c8-0832-4b69-b562-7f40c7fff6e3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:21:59.027596 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:59.027499    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ca70c8-0832-4b69-b562-7f40c7fff6e3-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:21:59.732581 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:59.732547    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"
Sep 15 19:21:59.733123 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:59.732585    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs" event={"ID":"c0ca70c8-0832-4b69-b562-7f40c7fff6e3","Type":"ContainerDied","Data":"ba3c1235560f20dc5c9137b283b01078f5963acff60023f3de76f846f8ca5e5c"}
Sep 15 19:21:59.733123 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:21:59.732668    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba3c1235560f20dc5c9137b283b01078f5963acff60023f3de76f846f8ca5e5c"
Sep 15 19:22:01.240124 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.240042    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:22:01.353867 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.353802    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-certs\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354052 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.353882    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-socket\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354052 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.353926    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63562e92-1abb-452e-bb61-7cd040cfc1d0-istiod-ca-cert\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354052 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.353950    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-token\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354052 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.353977    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-envoy\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354113    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-data\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354125    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:01.354239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354143    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-podinfo\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354239 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354225    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-credential-socket\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354240    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:01.354443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354263    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t65wc\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-kube-api-access-t65wc\") pod \"63562e92-1abb-452e-bb61-7cd040cfc1d0\" (UID: \"63562e92-1abb-452e-bb61-7cd040cfc1d0\") "
Sep 15 19:22:01.354443 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354343    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63562e92-1abb-452e-bb61-7cd040cfc1d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:22:01.354611 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354468    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:01.354702 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354671    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63562e92-1abb-452e-bb61-7cd040cfc1d0-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.354770 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354701    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.354770 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354716    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.354770 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354729    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.354959 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.354929    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:01.356259 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.356231    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:22:01.356330 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.356316    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:01.356633 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.356614    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:22:01.356705 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.356681    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-kube-api-access-t65wc" (OuterVolumeSpecName: "kube-api-access-t65wc") pod "63562e92-1abb-452e-bb61-7cd040cfc1d0" (UID: "63562e92-1abb-452e-bb61-7cd040cfc1d0"). InnerVolumeSpecName "kube-api-access-t65wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:22:01.455618 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.455572    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.455618 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.455612    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.455618 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.455630    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.455988 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.455638    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63562e92-1abb-452e-bb61-7cd040cfc1d0-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.455988 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.455647    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t65wc\" (UniqueName: \"kubernetes.io/projected/63562e92-1abb-452e-bb61-7cd040cfc1d0-kube-api-access-t65wc\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:01.747159 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.747125    2572 generic.go:356] "Generic (PLEG): container finished" podID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerID="52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6" exitCode=0
Sep 15 19:22:01.747341 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.747177    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"
Sep 15 19:22:01.747341 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.747206    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" event={"ID":"63562e92-1abb-452e-bb61-7cd040cfc1d0","Type":"ContainerDied","Data":"52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6"}
Sep 15 19:22:01.747341 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.747274    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d" event={"ID":"63562e92-1abb-452e-bb61-7cd040cfc1d0","Type":"ContainerDied","Data":"bdd5d3a8b4c73221e76ca033b537504061af6f048c5a122b2a140d4fabe4057c"}
Sep 15 19:22:01.747341 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.747305    2572 scope.go:117] "RemoveContainer" containerID="52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6"
Sep 15 19:22:01.757312 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.757287    2572 scope.go:117] "RemoveContainer" containerID="3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158"
Sep 15 19:22:01.764455 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.764423    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"]
Sep 15 19:22:01.767690 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.767662    2572 scope.go:117] "RemoveContainer" containerID="52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6"
Sep 15 19:22:01.768063 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:22:01.768039    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6\": container with ID starting with 52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6 not found: ID does not exist" containerID="52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6"
Sep 15 19:22:01.768155 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.768075    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6"} err="failed to get container status \"52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6\": rpc error: code = NotFound desc = could not find container \"52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6\": container with ID starting with 52ec750d593130cc8adf3aa91509e39a6dad86e1795573c92904faad534f38a6 not found: ID does not exist"
Sep 15 19:22:01.768155 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.768100    2572 scope.go:117] "RemoveContainer" containerID="3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158"
Sep 15 19:22:01.768446 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:22:01.768427    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158\": container with ID starting with 3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158 not found: ID does not exist" containerID="3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158"
Sep 15 19:22:01.768492 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.768454    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158"} err="failed to get container status \"3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158\": rpc error: code = NotFound desc = could not find container \"3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158\": container with ID starting with 3fcf21e7f95e86680f0c402ae691e8afb8744ca6b9a0a823d6ebbde33bea5158 not found: ID does not exist"
Sep 15 19:22:01.769617 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:01.769597    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-25b1b3-openshift-default-54975cf586-v6p5d"]
Sep 15 19:22:03.558676 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:03.558637    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" path="/var/lib/kubelet/pods/63562e92-1abb-452e-bb61-7cd040cfc1d0/volumes"
Sep 15 19:22:05.924781 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:05.924745    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:07.020750 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:07.020694    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"]
Sep 15 19:22:07.026778 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:07.026739    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7073b8-hq4fs"]
Sep 15 19:22:07.203711 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:07.203652    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:07.262712 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:07.262676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:07.445159 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:07.445119    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:07.543214 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:07.543177    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:07.557645 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:07.557606    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ca70c8-0832-4b69-b562-7f40c7fff6e3" path="/var/lib/kubelet/pods/c0ca70c8-0832-4b69-b562-7f40c7fff6e3/volumes"
Sep 15 19:22:08.312844 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:08.312793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:13.319602 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.319562    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:13.420021 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.419986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:13.574966 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.574869    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"]
Sep 15 19:22:13.575168 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.575131    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy" containerID="cri-o://b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b" gracePeriod=30
Sep 15 19:22:13.605293 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.605260    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:13.966264 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966221    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"]
Sep 15 19:22:13.966757 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966737    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy"
Sep 15 19:22:13.966904 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966760    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy"
Sep 15 19:22:13.966904 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966775    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy"
Sep 15 19:22:13.966904 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966783    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy"
Sep 15 19:22:13.966904 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966822    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ca70c8-0832-4b69-b562-7f40c7fff6e3" containerName="revoke-keys"
Sep 15 19:22:13.966904 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966831    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ca70c8-0832-4b69-b562-7f40c7fff6e3" containerName="revoke-keys"
Sep 15 19:22:13.967161 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966944    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy"
Sep 15 19:22:13.967161 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.966960    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ca70c8-0832-4b69-b562-7f40c7fff6e3" containerName="revoke-keys"
Sep 15 19:22:13.971672 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.971640    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"
Sep 15 19:22:13.974234 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.974194    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j7xzj\""
Sep 15 19:22:13.978413 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:13.978360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"]
Sep 15 19:22:14.087799 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.087759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/702500e3-d118-41ea-afc5-19766009a12f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x\" (UID: \"702500e3-d118-41ea-afc5-19766009a12f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"
Sep 15 19:22:14.188866 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.188787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/702500e3-d118-41ea-afc5-19766009a12f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x\" (UID: \"702500e3-d118-41ea-afc5-19766009a12f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"
Sep 15 19:22:14.189438 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.189419    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/702500e3-d118-41ea-afc5-19766009a12f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x\" (UID: \"702500e3-d118-41ea-afc5-19766009a12f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"
Sep 15 19:22:14.285556 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.285439    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"
Sep 15 19:22:14.561362 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.561331    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"]
Sep 15 19:22:14.563627 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:22:14.563595    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702500e3_d118_41ea_afc5_19766009a12f.slice/crio-c4ca8d11b8ea3792b28eb1418047581f72d19fd04729a9c1d080ce51a6739d9b WatchSource:0}: Error finding container c4ca8d11b8ea3792b28eb1418047581f72d19fd04729a9c1d080ce51a6739d9b: Status 404 returned error can't find the container with id c4ca8d11b8ea3792b28eb1418047581f72d19fd04729a9c1d080ce51a6739d9b
Sep 15 19:22:14.759468 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.759425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:14.838052 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.838011    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x" event={"ID":"702500e3-d118-41ea-afc5-19766009a12f","Type":"ContainerStarted","Data":"c0a8d7de0f0f30a28b843929f851bfb08aba495929c58d8daaca5f123c0aa7e5"}
Sep 15 19:22:14.838250 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.838074    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x" event={"ID":"702500e3-d118-41ea-afc5-19766009a12f","Type":"ContainerStarted","Data":"c4ca8d11b8ea3792b28eb1418047581f72d19fd04729a9c1d080ce51a6739d9b"}
Sep 15 19:22:14.854448 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:14.854377    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x" podStartSLOduration=1.8543581599999999 podStartE2EDuration="1.85435816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 19:22:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:22:14.851640397 +0000 UTC m=+1909.799868724" watchObservedRunningTime="2026-09-15 19:22:14.85435816 +0000 UTC m=+1909.802586485"
Sep 15 19:22:15.280851 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:15.280818    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:15.846429 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:15.846389    2572 generic.go:356] "Generic (PLEG): container finished" podID="702500e3-d118-41ea-afc5-19766009a12f" containerID="c0a8d7de0f0f30a28b843929f851bfb08aba495929c58d8daaca5f123c0aa7e5" exitCode=0
Sep 15 19:22:15.846878 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:15.846480    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x" event={"ID":"702500e3-d118-41ea-afc5-19766009a12f","Type":"ContainerDied","Data":"c0a8d7de0f0f30a28b843929f851bfb08aba495929c58d8daaca5f123c0aa7e5"}
Sep 15 19:22:16.552399 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:16.552365    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:22:16.992274 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:16.992246    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"
Sep 15 19:22:17.122260 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:17.122158    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/702500e3-d118-41ea-afc5-19766009a12f-maas-api-service-ca\") pod \"702500e3-d118-41ea-afc5-19766009a12f\" (UID: \"702500e3-d118-41ea-afc5-19766009a12f\") "
Sep 15 19:22:17.122535 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:17.122511    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/702500e3-d118-41ea-afc5-19766009a12f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "702500e3-d118-41ea-afc5-19766009a12f" (UID: "702500e3-d118-41ea-afc5-19766009a12f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:22:17.223340 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:17.223298    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/702500e3-d118-41ea-afc5-19766009a12f-maas-api-service-ca\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:17.860134 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:17.860036    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x" event={"ID":"702500e3-d118-41ea-afc5-19766009a12f","Type":"ContainerDied","Data":"c4ca8d11b8ea3792b28eb1418047581f72d19fd04729a9c1d080ce51a6739d9b"}
Sep 15 19:22:17.860134 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:17.860093    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4ca8d11b8ea3792b28eb1418047581f72d19fd04729a9c1d080ce51a6739d9b"
Sep 15 19:22:17.860134 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:17.860053    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"
Sep 15 19:22:18.841816 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.841729    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:22:18.869314 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.869278    2572 generic.go:356] "Generic (PLEG): container finished" podID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerID="b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b" exitCode=0
Sep 15 19:22:18.869502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.869349    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"
Sep 15 19:22:18.869502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.869363    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" event={"ID":"76953b1d-a90d-4dde-a950-c9b8c9618e50","Type":"ContainerDied","Data":"b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b"}
Sep 15 19:22:18.869502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.869447    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx" event={"ID":"76953b1d-a90d-4dde-a950-c9b8c9618e50","Type":"ContainerDied","Data":"2202eb1d0ad3a6c3b5609eafa4f7d0d772da9e4893b57d5b6188c2c3c58f17a6"}
Sep 15 19:22:18.869502 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.869483    2572 scope.go:117] "RemoveContainer" containerID="b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b"
Sep 15 19:22:18.880848 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.880821    2572 scope.go:117] "RemoveContainer" containerID="c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d"
Sep 15 19:22:18.890780 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.890752    2572 scope.go:117] "RemoveContainer" containerID="b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b"
Sep 15 19:22:18.891155 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:22:18.891132    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b\": container with ID starting with b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b not found: ID does not exist" containerID="b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b"
Sep 15 19:22:18.891269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.891164    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b"} err="failed to get container status \"b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b\": rpc error: code = NotFound desc = could not find container \"b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b\": container with ID starting with b99c21ce451be071a71c84b33bef2194eec646309205da3eac8dc6b99b71051b not found: ID does not exist"
Sep 15 19:22:18.891269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.891184    2572 scope.go:117] "RemoveContainer" containerID="c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d"
Sep 15 19:22:18.891493 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:22:18.891473    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d\": container with ID starting with c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d not found: ID does not exist" containerID="c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d"
Sep 15 19:22:18.891566 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.891502    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d"} err="failed to get container status \"c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d\": rpc error: code = NotFound desc = could not find container \"c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d\": container with ID starting with c8c20b9f00d470b4d7a7981fb106bba1439a2d108d63aeeb55aab79e106c159d not found: ID does not exist"
Sep 15 19:22:18.938575 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938540    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-envoy\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.938575 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938579    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2twwf\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-kube-api-access-2twwf\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.938869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938608    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-podinfo\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.938869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938632    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-data\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.938869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938676    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76953b1d-a90d-4dde-a950-c9b8c9618e50-istiod-ca-cert\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.938869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938720    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-token\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.938869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938777    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-credential-socket\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.938869 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938839    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-certs\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.939170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.938878    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-socket\") pod \"76953b1d-a90d-4dde-a950-c9b8c9618e50\" (UID: \"76953b1d-a90d-4dde-a950-c9b8c9618e50\") "
Sep 15 19:22:18.939170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939095    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-data" (OuterVolumeSpecName: "istio-data") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:18.939170 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939124    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76953b1d-a90d-4dde-a950-c9b8c9618e50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:22:18.939321 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939300    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:18.939378 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939318    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:18.939378 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939332    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:18.939488 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939412    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-data\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:18.939488 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939435    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76953b1d-a90d-4dde-a950-c9b8c9618e50-istiod-ca-cert\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:18.939488 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939449    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-credential-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:18.939488 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.939465    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-socket\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:18.941038 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.941014    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 19:22:18.941168 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.941054    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-kube-api-access-2twwf" (OuterVolumeSpecName: "kube-api-access-2twwf") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "kube-api-access-2twwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:22:18.941168 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.941072    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 19:22:18.941244 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:18.941184    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-token" (OuterVolumeSpecName: "istio-token") pod "76953b1d-a90d-4dde-a950-c9b8c9618e50" (UID: "76953b1d-a90d-4dde-a950-c9b8c9618e50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:22:19.039898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:19.039852    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-workload-certs\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:19.039898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:19.039889    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-envoy\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:19.039898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:19.039898    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2twwf\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-kube-api-access-2twwf\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:19.039898 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:19.039906    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-podinfo\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:19.040179 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:19.039915    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76953b1d-a90d-4dde-a950-c9b8c9618e50-istio-token\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:19.191600 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:19.191556    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"]
Sep 15 19:22:19.194796 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:19.194762    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7073b8-openshift-default-74b5b585bd-bpknx"]
Sep 15 19:22:19.557705 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:19.557597    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" path="/var/lib/kubelet/pods/76953b1d-a90d-4dde-a950-c9b8c9618e50/volumes"
Sep 15 19:22:24.484243 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.484201    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"]
Sep 15 19:22:24.486567 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.486541    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-33ff04-29824995-7cw8x"]
Sep 15 19:22:24.488496 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.488463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:24.513572 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.513527    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"]
Sep 15 19:22:24.513888 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.513853    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9" podUID="cdd18f23-9f51-4e18-8b1a-a88a105797c8" containerName="payload-pre-processing" containerID="cri-o://c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395" gracePeriod=30
Sep 15 19:22:24.551929 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.551884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:24.655556 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.655522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:24.664553 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.664516    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"]
Sep 15 19:22:24.667961 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.667927    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-33ff04-4mw4x"]
Sep 15 19:22:24.722161 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.722108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:24.779674 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.779640    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:22:24.791083 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.791041    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdd18f23-9f51-4e18-8b1a-a88a105797c8-plugins-config-volume\") pod \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\" (UID: \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\") "
Sep 15 19:22:24.791269 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.791098    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzdhb\" (UniqueName: \"kubernetes.io/projected/cdd18f23-9f51-4e18-8b1a-a88a105797c8-kube-api-access-hzdhb\") pod \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\" (UID: \"cdd18f23-9f51-4e18-8b1a-a88a105797c8\") "
Sep 15 19:22:24.791489 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.791460    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdd18f23-9f51-4e18-8b1a-a88a105797c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cdd18f23-9f51-4e18-8b1a-a88a105797c8" (UID: "cdd18f23-9f51-4e18-8b1a-a88a105797c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 19:22:24.793455 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.793419    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd18f23-9f51-4e18-8b1a-a88a105797c8-kube-api-access-hzdhb" (OuterVolumeSpecName: "kube-api-access-hzdhb") pod "cdd18f23-9f51-4e18-8b1a-a88a105797c8" (UID: "cdd18f23-9f51-4e18-8b1a-a88a105797c8"). InnerVolumeSpecName "kube-api-access-hzdhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 19:22:24.892468 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.892419    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdd18f23-9f51-4e18-8b1a-a88a105797c8-plugins-config-volume\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:24.892468 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.892459    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzdhb\" (UniqueName: \"kubernetes.io/projected/cdd18f23-9f51-4e18-8b1a-a88a105797c8-kube-api-access-hzdhb\") on node \"ip-10-0-129-252.ec2.internal\" DevicePath \"\""
Sep 15 19:22:24.909835 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.909764    2572 generic.go:356] "Generic (PLEG): container finished" podID="cdd18f23-9f51-4e18-8b1a-a88a105797c8" containerID="c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395" exitCode=0
Sep 15 19:22:24.910040 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.909846    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"
Sep 15 19:22:24.910040 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.909845    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9" event={"ID":"cdd18f23-9f51-4e18-8b1a-a88a105797c8","Type":"ContainerDied","Data":"c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395"}
Sep 15 19:22:24.910040 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.909973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9" event={"ID":"cdd18f23-9f51-4e18-8b1a-a88a105797c8","Type":"ContainerDied","Data":"1460fa5056cb0b060cb9c71001377df372228a83ac23bac4ac349f7482a651c8"}
Sep 15 19:22:24.910040 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.909997    2572 scope.go:117] "RemoveContainer" containerID="c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395"
Sep 15 19:22:24.920425 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.920403    2572 scope.go:117] "RemoveContainer" containerID="c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395"
Sep 15 19:22:24.920779 ip-10-0-129-252 kubenswrapper[2572]: E0915 19:22:24.920756    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395\": container with ID starting with c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395 not found: ID does not exist" containerID="c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395"
Sep 15 19:22:24.920862 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.920789    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395"} err="failed to get container status \"c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395\": rpc error: code = NotFound desc = could not find container \"c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395\": container with ID starting with c3d4eb92241d7a8b551314ef4fae0725a27afc86a554a730fa0e8b7652c65395 not found: ID does not exist"
Sep 15 19:22:24.932951 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.932902    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"]
Sep 15 19:22:24.937203 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.937157    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-33ff04-87579c798-xvxc9"]
Sep 15 19:22:24.994705 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:24.994668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:25.095051 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:25.094944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:25.559572 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:25.559537    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="702500e3-d118-41ea-afc5-19766009a12f" path="/var/lib/kubelet/pods/702500e3-d118-41ea-afc5-19766009a12f/volumes"
Sep 15 19:22:25.559964 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:25.559861    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75320e1-ab8b-4434-bb56-a768a6fb9aed" path="/var/lib/kubelet/pods/b75320e1-ab8b-4434-bb56-a768a6fb9aed/volumes"
Sep 15 19:22:25.560149 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:25.560135    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdd18f23-9f51-4e18-8b1a-a88a105797c8" path="/var/lib/kubelet/pods/cdd18f23-9f51-4e18-8b1a-a88a105797c8/volumes"
Sep 15 19:22:26.064927 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:26.064893    2572 scope.go:117] "RemoveContainer" containerID="167f595921d369528dc42daf9c8a193d846304216494755ae72d22a52416500d"
Sep 15 19:22:26.074159 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:26.074138    2572 scope.go:117] "RemoveContainer" containerID="a2f05f66b33cceb0fcd6dd07486c79848cc0bbecceebccfbff55b1e01ced048b"
Sep 15 19:22:30.863575 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:30.863538    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:30.923900 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:30.923866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:22:31.140070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:22:31.139948    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:23:18.551506 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:23:18.551408    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:23:26.126097 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:23:26.126061    2572 scope.go:117] "RemoveContainer" containerID="4370c2dc0d98ab01fd728d5ead5c30f9ec31e4edb7f1104a79e1afd1c3aa5134"
Sep 15 19:23:26.135453 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:23:26.135424    2572 scope.go:117] "RemoveContainer" containerID="0ec8f11e96bd232ff1881324f66b781ec1fc3d95c2df40fc0e2be716fe62a4ad"
Sep 15 19:23:26.146177 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:23:26.146113    2572 scope.go:117] "RemoveContainer" containerID="0e0560d2d7fc30b8580b1708fe0c38ad1a2bb05286b20d1475cc1ba190394de0"
Sep 15 19:23:38.552169 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:23:38.552130    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:23:43.968401 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:23:43.968356    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:23:59.148497 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:23:59.148451    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:24:00.551404 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:24:00.551358    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:24:04.131324 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:24:04.131286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:24:12.118992 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:24:12.118950    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:24:12.200027 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:24:12.199977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:24:44.551728 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:24:44.551678    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:24:52.551597 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:24:52.551508    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:25:25.748767 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:25:25.748734    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:25:25.752206 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:25:25.752181    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:25:57.552476 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:25:57.552434    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:26:04.552070 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:26:04.552025    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:26:26.195872 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:26:26.195773    2572 scope.go:117] "RemoveContainer" containerID="56416d1d94091127a8206fc954163469289178f146b35d30547027159978fe83"
Sep 15 19:26:52.386662 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:26:52.386624    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:27:08.665322 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:27:08.665273    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:27:23.356961 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:27:23.356925    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:27:24.222136 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:27:24.222104    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:27:25.554855 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:27:25.554799    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-558d9b8847-2lchj" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:27:26.219054 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:27:26.219022    2572 scope.go:117] "RemoveContainer" containerID="f583fab19832fd44a02a2239bd600b75fe2d7401aa4824aee408e27cde42de58"
Sep 15 19:27:31.551979 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:27:31.551945    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-74969cc5f8-tflk8" secret="" err="secret \"payload-processing-dockercfg-zkwlt\" not found"
Sep 15 19:27:34.789947 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:27:34.789894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:27:48.725529 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:27:48.725425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:28:11.471057 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:11.471024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:28:11.548871 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:11.548837    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:28:14.604867 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:14.604828    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-krv8r_dc04cb5c-5790-4e11-b945-7bbee9ec032f/global-pull-secret-syncer/0.log"
Sep 15 19:28:14.712444 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:14.712411    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log"
Sep 15 19:28:14.842131 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:14.842099    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-252.ec2.internal_878442b3229afc76d9706c25b8cfca80/haproxy/0.log"
Sep 15 19:28:21.267621 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:21.267585    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-bq8tq_7c5b5d43-1a3b-46a1-ba33-acd3a6f0ad60/cluster-monitoring-operator/0.log"
Sep 15 19:28:21.468673 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:21.468643    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wz5c_90ff6b82-6462-4527-96bd-98038fd999aa/node-exporter/0.log"
Sep 15 19:28:21.492842 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:21.492797    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wz5c_90ff6b82-6462-4527-96bd-98038fd999aa/kube-rbac-proxy/0.log"
Sep 15 19:28:21.515910 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:21.515886    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wz5c_90ff6b82-6462-4527-96bd-98038fd999aa/init-textfile/0.log"
Sep 15 19:28:22.113484 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:22.113394    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-djvk7_c754dc23-0268-4a6a-b2fc-6e69edce5a70/prometheus-operator-admission-webhook/0.log"
Sep 15 19:28:23.878777 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:23.878730    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-2zgjc_bd7bfb06-40d9-4a17-bb64-bb61eb77901b/networking-console-plugin/0.log"
Sep 15 19:28:24.498718 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.498689    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/2.log"
Sep 15 19:28:24.503132 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.503111    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5j4nh_5efaf851-b1f7-477c-b7ec-c7ff8aabd0f3/console-operator/3.log"
Sep 15 19:28:24.976915 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.976879    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"]
Sep 15 19:28:24.977438 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977417    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdd18f23-9f51-4e18-8b1a-a88a105797c8" containerName="payload-pre-processing"
Sep 15 19:28:24.977527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977440    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd18f23-9f51-4e18-8b1a-a88a105797c8" containerName="payload-pre-processing"
Sep 15 19:28:24.977527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977464    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="702500e3-d118-41ea-afc5-19766009a12f" containerName="revoke-keys"
Sep 15 19:28:24.977527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977473    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="702500e3-d118-41ea-afc5-19766009a12f" containerName="revoke-keys"
Sep 15 19:28:24.977527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977490    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy"
Sep 15 19:28:24.977527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977498    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy"
Sep 15 19:28:24.977527 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977513    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy"
Sep 15 19:28:24.977860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977554    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy"
Sep 15 19:28:24.977860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977688    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdd18f23-9f51-4e18-8b1a-a88a105797c8" containerName="payload-pre-processing"
Sep 15 19:28:24.977860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977702    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63562e92-1abb-452e-bb61-7cd040cfc1d0" containerName="istio-proxy"
Sep 15 19:28:24.977860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977713    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy"
Sep 15 19:28:24.977860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977723    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="76953b1d-a90d-4dde-a950-c9b8c9618e50" containerName="istio-proxy"
Sep 15 19:28:24.977860 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.977732    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="702500e3-d118-41ea-afc5-19766009a12f" containerName="revoke-keys"
Sep 15 19:28:24.980771 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.980750    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:24.983459 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.983437    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7s247\"/\"default-dockercfg-jg7th\""
Sep 15 19:28:24.983551 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.983436    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7s247\"/\"openshift-service-ca.crt\""
Sep 15 19:28:24.983937 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.983921    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7s247\"/\"kube-root-ca.crt\""
Sep 15 19:28:24.990243 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:24.990220    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"]
Sep 15 19:28:25.043656 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.043618    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-podres\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.043786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.043662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-proc\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.043786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.043690    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-lib-modules\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.043786 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.043762    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-sys\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.044004 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.043797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgqm\" (UniqueName: \"kubernetes.io/projected/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-kube-api-access-zbgqm\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.054300 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.054279    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657b8d88f6-xmrsh_b5a54cd6-99e0-417e-99bc-7acf2e2ba71f/console/0.log"
Sep 15 19:28:25.090678 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.090654    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-52pt2_8a3dabb2-1e7e-4e1d-9d3d-47d75d6b874a/download-server/0.log"
Sep 15 19:28:25.144420 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-proc\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.144537 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-lib-modules\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.144537 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-sys\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.144537 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgqm\" (UniqueName: \"kubernetes.io/projected/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-kube-api-access-zbgqm\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.144537 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144510    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-proc\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.144752 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144569    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-lib-modules\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.144752 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144588    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-sys\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.144752 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144617    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-podres\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.144752 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.144704    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-podres\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.153103 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.153084    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgqm\" (UniqueName: \"kubernetes.io/projected/730495bd-4fee-45cf-90b3-2d4fe8e6e7cb-kube-api-access-zbgqm\") pod \"perf-node-gather-daemonset-d7k8c\" (UID: \"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb\") " pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.291331 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.291264    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.560177 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.560155    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"]
Sep 15 19:28:25.561672 ip-10-0-129-252 kubenswrapper[2572]: W0915 19:28:25.561643    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod730495bd_4fee_45cf_90b3_2d4fe8e6e7cb.slice/crio-995281885fd4706dcb83cacccfdf9ece4794c0a780bf209028cc565a859efedf WatchSource:0}: Error finding container 995281885fd4706dcb83cacccfdf9ece4794c0a780bf209028cc565a859efedf: Status 404 returned error can't find the container with id 995281885fd4706dcb83cacccfdf9ece4794c0a780bf209028cc565a859efedf
Sep 15 19:28:25.854153 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.854074    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-2sbnz_2fd39fb6-e22e-44cd-b437-62da746705b7/volume-data-source-validator/0.log"
Sep 15 19:28:25.922427 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.922394    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c" event={"ID":"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb","Type":"ContainerStarted","Data":"ac213dd9cb9a0b19da72010bae04779c8ec57b12daeebeff663d3776840d9c85"}
Sep 15 19:28:25.922596 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.922445    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c" event={"ID":"730495bd-4fee-45cf-90b3-2d4fe8e6e7cb","Type":"ContainerStarted","Data":"995281885fd4706dcb83cacccfdf9ece4794c0a780bf209028cc565a859efedf"}
Sep 15 19:28:25.922596 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.922561    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:25.942402 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:25.940138    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c" podStartSLOduration=1.940118094 podStartE2EDuration="1.940118094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 19:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 19:28:25.937025541 +0000 UTC m=+2280.885253880" watchObservedRunningTime="2026-09-15 19:28:25.940118094 +0000 UTC m=+2280.888346422"
Sep 15 19:28:26.240715 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:26.240682    2572 scope.go:117] "RemoveContainer" containerID="a376651f09cc377c66b5e689e6e058d5d00de09fcb932f2146b59a83f2e0d7cd"
Sep 15 19:28:26.250059 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:26.250043    2572 scope.go:117] "RemoveContainer" containerID="c0a8d7de0f0f30a28b843929f851bfb08aba495929c58d8daaca5f123c0aa7e5"
Sep 15 19:28:26.257878 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:26.257858    2572 scope.go:117] "RemoveContainer" containerID="4b1b0f0b2bb766803318e2cb6a96a10894e403aba8d2790186ce704326a2c280"
Sep 15 19:28:26.987340 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:26.987312    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pntg8_8a7de796-7968-4885-a149-1b9fdcb8ead3/dns/0.log"
Sep 15 19:28:27.009530 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:27.009501    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pntg8_8a7de796-7968-4885-a149-1b9fdcb8ead3/kube-rbac-proxy/0.log"
Sep 15 19:28:27.135665 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:27.135633    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-skgjx_35059c7d-0268-4441-aa2d-31c14f50358b/dns-node-resolver/0.log"
Sep 15 19:28:27.733989 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:27.733957    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q4w7m_31a96b62-7d42-46e3-953f-7bf8307c9ce1/node-ca/0.log"
Sep 15 19:28:28.711613 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:28.711575    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf_713773c8-4fb7-4cdc-a907-39774841a097/istio-proxy/0.log"
Sep 15 19:28:29.041205 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:29.041125    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mv7q9_e54897df-1b71-44fa-9e68-0615b1ea8e3f/discovery/0.log"
Sep 15 19:28:29.143967 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:29.143939    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-558d9b8847-2lchj_918bc418-41b7-453a-b300-e73efce2e434/payload-pre-processing/0.log"
Sep 15 19:28:29.170640 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:29.170617    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-tflk8_2dca0223-6688-4aed-a5ca-0f22cabeef5d/payload-processing/0.log"
Sep 15 19:28:29.198798 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:29.198770    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79988fc9d-2hkvw_af5b55b6-64de-4833-8abe-2a0b0f5ba519/router/0.log"
Sep 15 19:28:30.059787 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:30.059758    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nk72_01df7f55-d8f9-4e3b-8633-91fa6c8de669/serve-healthcheck-canary/0.log"
Sep 15 19:28:30.565200 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:30.565167    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-b7x59_f5880853-f8ef-48cc-af5a-47ed879d1cbf/insights-operator/0.log"
Sep 15 19:28:30.565917 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:30.565899    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-b7x59_f5880853-f8ef-48cc-af5a-47ed879d1cbf/insights-operator/1.log"
Sep 15 19:28:30.586935 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:30.586912    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b65x6_02baeeee-715d-447a-b611-0cb7ff968801/kube-rbac-proxy/0.log"
Sep 15 19:28:30.606127 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:30.606106    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b65x6_02baeeee-715d-447a-b611-0cb7ff968801/exporter/0.log"
Sep 15 19:28:30.624815 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:30.624792    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b65x6_02baeeee-715d-447a-b611-0cb7ff968801/extractor/0.log"
Sep 15 19:28:31.937475 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:31.937437    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7s247/perf-node-gather-daemonset-d7k8c"
Sep 15 19:28:33.457649 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:33.457614    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8llcc_77aa8897-a755-481f-8588-7bbee6dc57a2/manager/0.log"
Sep 15 19:28:33.537793 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:33.537770    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7467f6b4cf-tdzbw_60e32ebd-bf9f-48d6-a2bc-206b75c18165/manager/0.log"
Sep 15 19:28:33.567651 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:33.567627    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7467f6b4cf-tdzbw_60e32ebd-bf9f-48d6-a2bc-206b75c18165/copy-manifests/0.log"
Sep 15 19:28:35.196048 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:35.196024    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cb45c66cf-v9t5c_69f1e7dd-0bbd-4565-9ea2-1fff1d5dcca2/manager/0.log"
Sep 15 19:28:35.452223 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:35.452151    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf_713773c8-4fb7-4cdc-a907-39774841a097/istio-proxy/0.log"
Sep 15 19:28:35.780912 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:35.780823    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mv7q9_e54897df-1b71-44fa-9e68-0615b1ea8e3f/discovery/0.log"
Sep 15 19:28:35.847698 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:35.847668    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-558d9b8847-2lchj_918bc418-41b7-453a-b300-e73efce2e434/payload-pre-processing/0.log"
Sep 15 19:28:35.862740 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:35.862715    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-tflk8_2dca0223-6688-4aed-a5ca-0f22cabeef5d/payload-processing/0.log"
Sep 15 19:28:35.880168 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:35.880148    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79988fc9d-2hkvw_af5b55b6-64de-4833-8abe-2a0b0f5ba519/router/0.log"
Sep 15 19:28:37.359678 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:37.359649    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-k6ksf_713773c8-4fb7-4cdc-a907-39774841a097/istio-proxy/0.log"
Sep 15 19:28:37.716332 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:37.716301    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mv7q9_e54897df-1b71-44fa-9e68-0615b1ea8e3f/discovery/0.log"
Sep 15 19:28:37.783227 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:37.783201    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-558d9b8847-2lchj_918bc418-41b7-453a-b300-e73efce2e434/payload-pre-processing/0.log"
Sep 15 19:28:37.800120 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:37.800099    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-tflk8_2dca0223-6688-4aed-a5ca-0f22cabeef5d/payload-processing/0.log"
Sep 15 19:28:37.820387 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:37.820364    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79988fc9d-2hkvw_af5b55b6-64de-4833-8abe-2a0b0f5ba519/router/0.log"
Sep 15 19:28:39.190113 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:39.190081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:28:39.244485 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:39.244455    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cs2c_6ad4e021-957c-4b7c-bab5-79a1bbdd6601/konnectivity-agent/0.log" limit=1024
Sep 15 19:28:40.673440 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:40.673410    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-2pj2t_d894b34b-bb7a-410e-b2d4-a575f914a913/kube-storage-version-migrator-operator/1.log"
Sep 15 19:28:40.674387 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:40.674368    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-2pj2t_d894b34b-bb7a-410e-b2d4-a575f914a913/kube-storage-version-migrator-operator/0.log"
Sep 15 19:28:41.907956 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:41.907928    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2grv_e2c60d2c-6078-48ea-ae82-1f246ce0da13/kube-multus-additional-cni-plugins/0.log"
Sep 15 19:28:41.926221 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:41.926199    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2grv_e2c60d2c-6078-48ea-ae82-1f246ce0da13/egress-router-binary-copy/0.log"
Sep 15 19:28:41.943926 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:41.943903    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2grv_e2c60d2c-6078-48ea-ae82-1f246ce0da13/cni-plugins/0.log"
Sep 15 19:28:41.962738 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:41.962719    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2grv_e2c60d2c-6078-48ea-ae82-1f246ce0da13/bond-cni-plugin/0.log"
Sep 15 19:28:41.982578 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:41.982558    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2grv_e2c60d2c-6078-48ea-ae82-1f246ce0da13/routeoverride-cni/0.log"
Sep 15 19:28:42.000847 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:42.000825    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2grv_e2c60d2c-6078-48ea-ae82-1f246ce0da13/whereabouts-cni-bincopy/0.log"
Sep 15 19:28:42.019421 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:42.019397    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2grv_e2c60d2c-6078-48ea-ae82-1f246ce0da13/whereabouts-cni/0.log"
Sep 15 19:28:42.124192 ip-10-0-129-252 kubenswrapper[2572]: I0915 19:28:42.124167    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w7dsq_8a02bee1-859c-448c-88bf-6522ac1d6023/kube-multus/0.log"