Jul 29 08:45:48.035923 ip-10-0-131-230 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 08:45:48.035936 ip-10-0-131-230 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 08:45:48.035946 ip-10-0-131-230 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 08:45:48.036259 ip-10-0-131-230 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 08:45:58.236944 ip-10-0-131-230 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 08:45:58.236961 ip-10-0-131-230 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 88b3f2110d2c46c3a3676d228be00947 --
Jul 29 08:47:29.335952 ip-10-0-131-230 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 08:47:29.773307 ip-10-0-131-230 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 08:47:29.773307 ip-10-0-131-230 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 08:47:29.773307 ip-10-0-131-230 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 08:47:29.773307 ip-10-0-131-230 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 08:47:29.773307 ip-10-0-131-230 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 08:47:29.774501 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.774415    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 08:47:29.779182 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779166    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:29.779182 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779182    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779186    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779189    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779192    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779195    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779198    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779200    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779203    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779206    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779209    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779211    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779215    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779218    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779221    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779223    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779226    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779228    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779231    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779234    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779237    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:29.779247 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779239    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779242    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779245    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779248    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779250    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779253    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779256    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779264    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779268    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779270    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779273    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779276    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779278    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779281    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779283    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779286    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779288    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779291    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779293    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779296    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:29.779745 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779298    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779301    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779304    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779306    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779309    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779312    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779314    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779317    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779319    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779322    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779324    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779327    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779329    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779332    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779335    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779338    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779341    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779344    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779346    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779349    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:29.780234 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779352    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779354    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779357    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779360    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779362    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779364    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779367    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779370    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779374    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779378    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779381    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779384    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779387    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779390    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779392    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779395    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779398    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779400    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779403    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:29.780785 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779406    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779410    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779414    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779417    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779419    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779422    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779425    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779428    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779431    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779434    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779438    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779442    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779446    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779449    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779452    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779454    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779457    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779460    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.779462    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:29.781249 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780185    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780192    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780195    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780197    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780200    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780203    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780206    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780208    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780211    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780214    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780217    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780220    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780223    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780226    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780228    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780231    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780233    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780236    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780239    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780242    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:29.781737 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780246    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780249    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780252    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780255    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780258    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780260    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780265    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780268    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780271    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780274    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780277    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780279    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780282    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780284    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780287    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780289    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780292    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780294    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780297    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:29.782232 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780299    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780302    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780305    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780307    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780310    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780313    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780315    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780319    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780322    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780326    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780328    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780331    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780334    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780339    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780343    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780346    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780349    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780352    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780354    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:29.782723 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780356    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780359    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780362    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780364    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780367    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780370    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780372    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780374    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780377    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780379    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780382    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780384    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780387    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780390    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780392    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780395    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780397    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780400    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780403    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780406    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:29.783186 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780409    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780411    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780414    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780417    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780419    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780422    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780426    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780429    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780431    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780434    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780437    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780440    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780442    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780445    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780447    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780449    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780452    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780455    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780457    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780460    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:29.783685 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780462    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780857    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780862    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780864    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780868    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780871    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780874    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780876    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780879    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780881    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780884    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780887    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780890    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780893    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780897    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780900    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780903    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780906    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780909    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:29.784170 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780912    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780917    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780920    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780924    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780927    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780929    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780932    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780935    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780937    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780940    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780942    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780945    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780948    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780950    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780953    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780955    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780957    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780960    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780962    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780965    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:29.784630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780967    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780970    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780972    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780975    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780977    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780981    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780983    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780986    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780988    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780991    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780994    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780997    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.780999    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781002    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781005    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781007    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781010    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781012    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781015    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781018    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:29.785128 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781020    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781022    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781025    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781027    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781030    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781032    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781035    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781037    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781041    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781044    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781048    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781051    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781054    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781056    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781059    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781062    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781065    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781067    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781071    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:29.785750 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781073    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781076    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781078    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781083    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781086    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781089    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781091    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781094    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781097    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781099    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781102    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781104    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781107    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781109    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781112    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781114    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781117    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781119    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781122    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781125    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:29.786202 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781127    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781130    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781198    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781205    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781212    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781216    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781222    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781225    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781231    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781236    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781240    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781246    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781250    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781254    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781257    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781261    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781265    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781268    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781271    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781273    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781277    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781280    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781283    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781286    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 08:47:29.786727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781296    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781300    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781303    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781306    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781309    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781313    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781316    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781320    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781323    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781326    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781330    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781333    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781336    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781339    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781342    2564 flags.go:64] FLAG: --enable-server="true"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781345    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781349    2564 flags.go:64] FLAG: --event-burst="100"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781352    2564 flags.go:64] FLAG: --event-qps="50"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781355    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781358    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781361    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781370    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781374    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781377    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781380    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 29 08:47:29.787380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781383    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781386    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781389    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781392    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781395    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781398    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781401    2564 flags.go:64] FLAG: --feature-gates=""
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781405    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781408    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781411    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781415    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781418    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781421    2564 flags.go:64] FLAG: --help="false"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781425    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-230.ec2.internal"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781429    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781432    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781434    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781438    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781442    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781445    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781448    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781451    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781454    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 08:47:29.788005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781457    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781460    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781463    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781466    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781469    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781471    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781475    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781478    2564 flags.go:64] FLAG: --lock-file=""
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781481    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781484    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781487    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781493    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781495    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781498    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781501    2564 flags.go:64] FLAG: --logging-format="text"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781504    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781508    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781511    2564 flags.go:64] FLAG: --manifest-url=""
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781514    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781518    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781521    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781525    2564 flags.go:64] FLAG: --max-pods="110"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781529    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781532    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781535    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 08:47:29.788589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781538    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781541    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781544    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781547    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781554    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781557    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781560    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781563    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781566    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781571    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781574    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781578    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781581    2564 flags.go:64] FLAG: --port="10250"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781584    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781587    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b154722df2b49855"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781591    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781594    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781596    2564 flags.go:64] FLAG: --register-node="true"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781599    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781603    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781605    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781608    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781611    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781615    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781618    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 08:47:29.789263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781621    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781624    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781626    2564 flags.go:64] FLAG: --runonce="false"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781629    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781634    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781638    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781641    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781644    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781647    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781650    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781665    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781668    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781671    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781674    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781677    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781680    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781683    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781685    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781691    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781694    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781697    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781701    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781709    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781712    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781715    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 08:47:29.789892 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781718    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781721    2564 flags.go:64] FLAG: --v="2"
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781725    2564 flags.go:64] FLAG: --version="false"
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781729    2564 flags.go:64] FLAG: --vmodule=""
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781733    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.781737    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781855    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781859    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781862    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781864    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781867    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781871    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781874    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781876    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781879    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781882    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781884    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781886    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781889    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781892    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781894    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:29.790505 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781897    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781900    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781903    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781906    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781908    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781911    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781913    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781916    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781920    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781928    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781931    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781933    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781936    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781938    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781941    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781944    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781946    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781949    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781952    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781954    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781957    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:29.791052 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781959    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781963    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781966    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781968    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781970    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781973    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781976    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781978    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781981    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781983    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781986    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781988    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781991    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781994    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.781996    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782000    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782004    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782007    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782009    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:29.791563 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782014    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782017    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782026    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782029    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782032    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782035    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782037    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782040    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782043    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782045    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782048    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782051    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782054    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782056    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782060    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782063    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782065    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782068    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782071    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782073    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:29.792142 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782076    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782079    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782081    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782084    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782086    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782089    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782091    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782094    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782096    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782099    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782101    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782104    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782108    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782110    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782113    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782117    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782122    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782125    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:29.792630 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782129    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782132    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782135    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782137    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782140    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.782143    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.783049    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.790210    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.790225    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.790244    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.790253    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790310    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790316    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790319    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790322    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:29.793081 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790325    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790328    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790331    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790333    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790336    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790339    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790342    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790345    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790347    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790350    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790353    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790355    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790358    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790361    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790368    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790371    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790374    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790376    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790379    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790382    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:29.793468 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790385    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790387    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790390    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790392    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790395    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790398    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790401    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790404    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790407    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790409    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790412    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790415    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790418    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790420    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790423    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790426    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790428    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790431    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790433    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790436    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:29.793966 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790438    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790441    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790444    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790447    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790449    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790452    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790455    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790458    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790461    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790463    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790466    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790468    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790471    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790473    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790477    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790482    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790485    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790488    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790492    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790494    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:29.794456 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790498    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790500    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790503    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790506    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790509    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790511    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790514    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790517    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790520    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790522    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790525    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790528    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790530    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790535    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790538    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790541    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790545    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790547    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790550    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:29.794994 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790553    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790556    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790559    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790563    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790566    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790569    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790572    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790575    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790578    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790581    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790583    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790587    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790589    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790592    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790595    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:29.795470 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790597    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.790603    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790738    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790744    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790748    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790751    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790754    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790757    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790760    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790762    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790765    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790767    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790770    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790772    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 08:47:29.795922 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790776    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790778    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790780    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790783    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790786    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790790    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790793    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790796    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790798    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790801    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790804    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790806    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790809    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790812    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790815    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790817    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790820    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790823    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790825    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 08:47:29.796273 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790828    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790831    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790833    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790836    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790838    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790842    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790845    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790848    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790850    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790853    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790855    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790858    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790861    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790863    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790866    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790868    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790871    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790873    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790876    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790879    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 08:47:29.796755 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790882    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790885    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790889    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790892    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790895    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790898    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790901    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790904    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790906    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790909    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790912    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790914    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790917    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790919    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790922    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790925    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790927    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790930    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790932    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790935    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 08:47:29.797241 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790937    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790940    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790942    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790945    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790948    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790950    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790953    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790955    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790958    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790960    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790963    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790965    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790969    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790971    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790974    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790976    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790979    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790981    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790984    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790987    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790990    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 08:47:29.797727 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790992    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790995    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.790997    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.791000    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.791002    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.791005    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:29.791007    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.791013    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.791123    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.793471    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.795070    2564 server.go:1019] "Starting client certificate rotation"
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.795169    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 08:47:29.798237 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.795990    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 08:47:29.798570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.798544    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 08:47:29.803927 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.803904    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 08:47:29.816421 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.816403    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 29 08:47:29.818834 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.818820    2564 log.go:25] "Validated CRI v1 image API"
Jul 29 08:47:29.819585 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.819570    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 08:47:29.822172 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.822146    2564 fs.go:135] Filesystem UUIDs: map[255867ef-4357-440a-9c9e-3b006cb9ec1b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 937e3270-f212-4824-981b-9d29aa545c0a:/dev/nvme0n1p4]
Jul 29 08:47:29.822239 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.822171    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 08:47:29.826735 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.826618    2564 manager.go:216] Machine: {Timestamp:2026-07-29 08:47:29.826155215 +0000 UTC m=+0.360483569 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3084824 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec258270aa00a3836a3bbc2ffaec0770 SystemUUID:ec258270-aa00-a383-6a3b-bc2ffaec0770 BootID:88b3f211-0d2c-46c3-a367-6d228be00947 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8e:b1:ec:37:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8e:b1:ec:37:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:50:be:03:69:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 08:47:29.826735 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.826729    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 08:47:29.826842 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.826804    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 08:47:29.827083 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.827066    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 08:47:29.830259 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.830230    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 08:47:29.830390 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.830263    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-230.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 08:47:29.831146 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.831135    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 08:47:29.831182 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.831148    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 08:47:29.831182 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.831161    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 08:47:29.831182 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.831173    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 08:47:29.832335 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.832325    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 08:47:29.834251 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834240    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 08:47:29.834383 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834374    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 08:47:29.834421 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834406    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 08:47:29.834421 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834416    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 08:47:29.834472 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834439    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 08:47:29.834472 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834449    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 29 08:47:29.834472 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834463    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 08:47:29.834818 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834807    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 08:47:29.834858 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.834831    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 08:47:29.837296 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.837276    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 08:47:29.839889 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.839873    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 08:47:29.839970 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.839912    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 08:47:29.841932 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.841918    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 08:47:29.841999 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.841940    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 08:47:29.841999 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.841950    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 08:47:29.841999 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.841958    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 08:47:29.841999 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.841971    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 08:47:29.841999 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.841979    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 08:47:29.841999 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.841991    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 08:47:29.841999 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.841999    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 08:47:29.842286 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.842010    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 08:47:29.842286 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.842019    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 08:47:29.842286 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.842042    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 08:47:29.842286 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.842052    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 08:47:29.842286 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.842083    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 08:47:29.842286 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.842091    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 08:47:29.844191 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.844162    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 08:47:29.844374 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.844343    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 08:47:29.846899 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.846883    2564 server.go:1268] "Started kubelet"
Jul 29 08:47:29.847010 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.846982    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 08:47:29.847129 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.846970    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 08:47:29.847201 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.847158    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 08:47:29.847525 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.847501    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-230.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 08:47:29.847951 ip-10-0-131-230 systemd[1]: Started Kubernetes Kubelet.
Jul 29 08:47:29.848836 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.848822    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 08:47:29.849510 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.849480    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 08:47:29.853485 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.853463    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 08:47:29.859439 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.858406    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-230.ec2.internal.18c6b6659d59ccde  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-230.ec2.internal,UID:ip-10-0-131-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-230.ec2.internal,},FirstTimestamp:2026-07-29 08:47:29.846840542 +0000 UTC m=+0.381168875,LastTimestamp:2026-07-29 08:47:29.846840542 +0000 UTC m=+0.381168875,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-230.ec2.internal,}"
Jul 29 08:47:29.861935 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.861919    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 08:47:29.861935 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.861922    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 08:47:29.862053 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.861981    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:29.862642 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.862624    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 08:47:29.863498 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.863478    2564 factory.go:55] Registering systemd factory
Jul 29 08:47:29.863590 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.863499    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 29 08:47:29.863805 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.863784    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 08:47:29.863932 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.863894    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 08:47:29.864021 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864009    2564 factory.go:153] Registering CRI-O factory
Jul 29 08:47:29.864072 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864026    2564 factory.go:223] Registration of the crio container factory successfully
Jul 29 08:47:29.864120 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864087    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 08:47:29.864120 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864110    2564 factory.go:103] Registering Raw factory
Jul 29 08:47:29.864210 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864123    2564 manager.go:1196] Started watching for new ooms in manager
Jul 29 08:47:29.864264 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864249    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 08:47:29.864328 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864269    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 08:47:29.864428 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864412    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 08:47:29.864428 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864426    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 08:47:29.864604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.864591    2564 manager.go:349] Starting recovery of all containers
Jul 29 08:47:29.870331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.870304    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 08:47:29.875320 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.875295    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wblr7"
Jul 29 08:47:29.875906 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.875893    2564 manager.go:354] Recovery completed
Jul 29 08:47:29.877321 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.877305    2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 29 08:47:29.880522 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.880504    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:29.881209 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.881192    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wblr7"
Jul 29 08:47:29.882280 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.882263    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:29.882357 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.882293    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:29.882357 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.882305    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:29.883005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.882877    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 08:47:29.883005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.882888    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:29.883005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.882893    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 08:47:29.883005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.882962    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 08:47:29.883591 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.883572    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:29.883682 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.883607    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:29.883682 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.883621    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:29.885350 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.885335    2564 policy_none.go:49] "None policy: Start"
Jul 29 08:47:29.885350 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.885352    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 08:47:29.885436 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.885362    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 08:47:29.886434 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.886420    2564 policy_none.go:47] "Start"
Jul 29 08:47:29.928216 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.928201    2564 manager.go:337] "Starting Device Plugin manager"
Jul 29 08:47:29.928307 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.928233    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 08:47:29.928307 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.928246    2564 server.go:87] "Starting device plugin registration server"
Jul 29 08:47:29.928517 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.928500    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 08:47:29.928651 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.928516    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 08:47:29.928651 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.928614    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 08:47:29.928805 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.928708    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 08:47:29.928805 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.928717    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 08:47:29.929160 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.929144    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 08:47:29.929213 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.929186    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:29.991493 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.991471    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 08:47:29.991630 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.991510    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 08:47:29.991630 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.991529    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 08:47:29.991630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:29.991558    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 08:47:29.994172 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:29.994153    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:30.030890 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.030806    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:30.031759 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.031744    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:30.031827 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.031775    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:30.031827 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.031792    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:30.031827 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.031817    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.041841 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.041689    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.041948 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.041844    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-230.ec2.internal\": node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.071335 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.071315    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.091825 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.091802    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal"]
Jul 29 08:47:30.091912 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.091869    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:30.093212 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.093189    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:30.093299 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.093221    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:30.093299 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.093231    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:30.094666 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.094647    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:30.094770 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.094757    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.094803 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.094785    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:30.095361 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.095348    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:30.095411 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.095386    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:30.095411 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.095396    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:30.095473 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.095348    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:30.095473 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.095447    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:30.095473 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.095457    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:30.096630 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.096616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.096697 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.096641    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 08:47:30.097314 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.097299    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 08:47:30.097416 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.097322    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 08:47:30.097416 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.097336    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID"
Jul 29 08:47:30.121232 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.121209    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-230.ec2.internal\" not found" node="ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.125644 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.125628    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-230.ec2.internal\" not found" node="ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.166847 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.166813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7e2f0e0d351ab3984231d25ad22a404-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"d7e2f0e0d351ab3984231d25ad22a404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.166847 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.166846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7e2f0e0d351ab3984231d25ad22a404-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"d7e2f0e0d351ab3984231d25ad22a404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.166987 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.166865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7c0b67d46e1779681af76760bb73d6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-230.ec2.internal\" (UID: \"3a7c0b67d46e1779681af76760bb73d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.171918 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.171902    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.267322 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.267290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7e2f0e0d351ab3984231d25ad22a404-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"d7e2f0e0d351ab3984231d25ad22a404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.267494 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.267341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7e2f0e0d351ab3984231d25ad22a404-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"d7e2f0e0d351ab3984231d25ad22a404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.267494 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.267382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7c0b67d46e1779681af76760bb73d6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-230.ec2.internal\" (UID: \"3a7c0b67d46e1779681af76760bb73d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.267494 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.267401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7e2f0e0d351ab3984231d25ad22a404-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"d7e2f0e0d351ab3984231d25ad22a404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.267494 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.267424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a7c0b67d46e1779681af76760bb73d6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-230.ec2.internal\" (UID: \"3a7c0b67d46e1779681af76760bb73d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.267494 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.267461    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7e2f0e0d351ab3984231d25ad22a404-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"d7e2f0e0d351ab3984231d25ad22a404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.272415 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.272397    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.373242 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.373167    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.424371 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.424336    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.430216 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.430201    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:30.473575 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.473546    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.574021 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.573999    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.674592 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.674531    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.703723 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.703704    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:30.775468 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:30.775438    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:30.794608 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.794586    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 08:47:30.794749 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.794730    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 08:47:30.794809 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:30.794755    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 08:47:32.638573 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:32.638549    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:32.649739 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:32.649694    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 08:42:31 +0000 UTC" deadline="2028-04-26 19:50:35.3465226 +0000 UTC"
Jul 29 08:47:32.649739 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:32.649737    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15299h3m2.696789293s"
Jul 29 08:47:32.739398 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:32.739371    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:32.816276 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:32.816245    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7c0b67d46e1779681af76760bb73d6.slice/crio-79c0da8bb603d2583d1bfd3eb4fcc5432d56a01423a3372f794629440a688fca WatchSource:0}: Error finding container 79c0da8bb603d2583d1bfd3eb4fcc5432d56a01423a3372f794629440a688fca: Status 404 returned error can't find the container with id 79c0da8bb603d2583d1bfd3eb4fcc5432d56a01423a3372f794629440a688fca
Jul 29 08:47:32.823415 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:32.823394    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 08:47:32.826260 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:32.826238    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e2f0e0d351ab3984231d25ad22a404.slice/crio-60c0c0931ccfa2d933819ce40ce9fad1863f488980dd28902e7a0e46b2319e41 WatchSource:0}: Error finding container 60c0c0931ccfa2d933819ce40ce9fad1863f488980dd28902e7a0e46b2319e41: Status 404 returned error can't find the container with id 60c0c0931ccfa2d933819ce40ce9fad1863f488980dd28902e7a0e46b2319e41
Jul 29 08:47:32.840260 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:32.840234    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:32.940896 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:32.940843    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found"
Jul 29 08:47:32.998066 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:32.997987    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:33.025727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.025700    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:33.040404 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.040386    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 08:47:33.041305 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.041293    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal"
Jul 29 08:47:33.052089 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.052064    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 08:47:33.095459 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.095437    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:33.487077 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.487003    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:33.598894 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.598860    2564 apiserver.go:52] "Watching apiserver"
Jul 29 08:47:33.605402 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.605376    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 08:47:33.606470 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.606440    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms","openshift-cluster-node-tuning-operator/tuned-spjwk","openshift-dns/node-resolver-l8f5l","openshift-image-registry/node-ca-rt4j6","openshift-network-diagnostics/network-check-target-966d4","openshift-network-operator/iptables-alerter-zgg6g","openshift-ovn-kubernetes/ovnkube-node-5n6lx","kube-system/global-pull-secret-syncer-cj752","kube-system/konnectivity-agent-cz9pq","kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal","openshift-multus/multus-additional-cni-plugins-vjrw8","openshift-multus/multus-ktxzb","openshift-multus/network-metrics-daemon-6t59m"]
Jul 29 08:47:33.608189 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.607915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:33.608189 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.607996    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:33.609114 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.609095    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:33.609209 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.609162    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:33.610279 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.610259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.611754 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.611734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.612528 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.612507    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 08:47:33.612642 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.612625    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 08:47:33.612901 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.612746    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g25pz\""
Jul 29 08:47:33.612901 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.612868    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:47:33.613710 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.613693    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 08:47:33.613936 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.613918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n9xdh\""
Jul 29 08:47:33.614125 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.614109    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 08:47:33.614194 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.614163    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 08:47:33.615183 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.615163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.616439 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.616418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.616933 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.616910    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 08:47:33.617366 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.617348    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 08:47:33.617911 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.617633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.617911 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.617654    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 08:47:33.618845 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.618169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 08:47:33.618845 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.618193    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 08:47:33.618845 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.618307    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qjsd5\""
Jul 29 08:47:33.618845 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.618361    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 08:47:33.618845 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.618598    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vx29d\""
Jul 29 08:47:33.618845 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.618667    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 08:47:33.618845 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.618700    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 08:47:33.619889 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.619597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.619889 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.619653    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:33.620879 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.620698    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sbht5\""
Jul 29 08:47:33.620968 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.620872    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 08:47:33.621402 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.621234    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 08:47:33.621773 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.621704    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 08:47:33.625263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.624764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:33.625263 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.625172    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 08:47:33.625957 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.625938    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.627335 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.627169    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 08:47:33.627446 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.627428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.627660 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.627644    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 08:47:33.628201 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.627693    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lhdzr\""
Jul 29 08:47:33.628491 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.628336    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 08:47:33.628491 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.628372    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 08:47:33.628491 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.628382    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 08:47:33.628673 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.628532    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdz2x\""
Jul 29 08:47:33.628673 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.628548    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 08:47:33.629467 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.628893    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.629467 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.629268    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 08:47:33.629467 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.629316    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-npfdz\""
Jul 29 08:47:33.629705 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.629685    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 08:47:33.630966 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.630930    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lkkjz\""
Jul 29 08:47:33.631249 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.631231    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:47:33.632215 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.632196    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 08:47:33.634913 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.634892    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 08:47:33.638964 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.638943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfwdl\" (UniqueName: \"kubernetes.io/projected/070166e9-6136-4d20-87cc-733c41984af8-kube-api-access-nfwdl\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.639048 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.638977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-kubelet\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.639048 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-run-ovn-kubernetes\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.639048 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9-agent-certs\") pod \"konnectivity-agent-cz9pq\" (UID: \"50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9\") " pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:33.639202 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9-konnectivity-ca\") pod \"konnectivity-agent-cz9pq\" (UID: \"50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9\") " pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:33.639202 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.639202 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-tmp-dir\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.639202 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovn-node-metrics-cert\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.639202 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbbd44c8-eb7e-4b15-a132-dff805cb3756-iptables-alerter-script\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-system-cni-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-netns\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-kubelet\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-hostroot\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-conf-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-systemd-units\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-var-lib-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-systemd\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.639447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-socket-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.639990 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-device-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.639990 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-os-release\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.639990 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.639990 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.639990 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-etc-kubernetes\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.639990 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7ss8\" (UniqueName: \"kubernetes.io/projected/7c6f3949-db62-4697-a719-ac1d98d16bfb-kube-api-access-w7ss8\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.639990 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.639781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-cni-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.640316 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-os-release\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.640316 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.640316 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-sys-fs\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.640316 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-system-cni-dir\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.640505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq65w\" (UniqueName: \"kubernetes.io/projected/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-kube-api-access-qq65w\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.640505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-cnibin\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.640505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-node-log\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.640505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-cnibin\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.640505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbd44c8-eb7e-4b15-a132-dff805cb3756-host-slash\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.640749 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6185707-adc6-43fa-8a8b-a95116106b5a-host\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.640749 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/070166e9-6136-4d20-87cc-733c41984af8-multus-daemon-config\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.640749 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-log-socket\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.640749 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.640939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.640939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-dbus\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.640939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-k8s-cni-cncf-io\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.640939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-run-netns\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.640939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-slash\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.640939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-etc-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.640939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk75h\" (UniqueName: \"kubernetes.io/projected/fbbd44c8-eb7e-4b15-a132-dff805cb3756-kube-api-access-gk75h\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.640939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-socket-dir-parent\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.641298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.640975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74qmb\" (UniqueName: \"kubernetes.io/projected/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-kube-api-access-74qmb\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:33.641298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/070166e9-6136-4d20-87cc-733c41984af8-cni-binary-copy\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.641298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641038    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-cni-bin\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.641298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-multus-certs\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.641298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:33.641298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovnkube-config\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-hosts-file\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-cni-bin\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-cni-netd\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq95v\" (UniqueName: \"kubernetes.io/projected/87195c10-240f-4c70-b2de-61406d6a7bae-kube-api-access-vq95v\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m67tw\" (UniqueName: \"kubernetes.io/projected/b6185707-adc6-43fa-8a8b-a95116106b5a-kube-api-access-m67tw\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-ovn\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-env-overrides\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.641570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.642031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-kubelet-config\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.642031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xrxp\" (UniqueName: \"kubernetes.io/projected/3e48e194-1cfe-4370-adf3-d8636d7ef840-kube-api-access-9xrxp\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.642031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-registration-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.642031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovnkube-script-lib\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.642031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6185707-adc6-43fa-8a8b-a95116106b5a-serviceca\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.642031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.642031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.641818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-cni-multus\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.658417 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.658391    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c6sbd"
Jul 29 08:47:33.667703 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.667677    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c6sbd"
Jul 29 08:47:33.727551 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.727523    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 08:47:33.742429 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-cni-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.742429 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-os-release\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.742429 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-sys-fs\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-system-cni-dir\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-sys\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq65w\" (UniqueName: \"kubernetes.io/projected/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-kube-api-access-qq65w\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-cnibin\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-node-log\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-cnibin\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-os-release\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-sys-fs\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-cni-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742629    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-cnibin\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbd44c8-eb7e-4b15-a132-dff805cb3756-host-slash\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-node-log\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbbd44c8-eb7e-4b15-a132-dff805cb3756-host-slash\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6185707-adc6-43fa-8a8b-a95116106b5a-host\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.742670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-system-cni-dir\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6185707-adc6-43fa-8a8b-a95116106b5a-host\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742695    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-cnibin\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f730eb39-c3c5-406b-9f81-8b7752882075-tmp\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/070166e9-6136-4d20-87cc-733c41984af8-multus-daemon-config\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-log-socket\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-log-socket\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-kubernetes\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742938    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-var-lib-kubelet\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.742975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f730eb39-c3c5-406b-9f81-8b7752882075-etc-tuned\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-dbus\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-k8s-cni-cncf-io\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-run-netns\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.743481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysctl-d\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-dbus\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-run\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-slash\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-run-netns\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-etc-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-k8s-cni-cncf-io\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk75h\" (UniqueName: \"kubernetes.io/projected/fbbd44c8-eb7e-4b15-a132-dff805cb3756-kube-api-access-gk75h\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-socket-dir-parent\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74qmb\" (UniqueName: \"kubernetes.io/projected/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-kube-api-access-74qmb\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldkwf\" (UniqueName: \"kubernetes.io/projected/f730eb39-c3c5-406b-9f81-8b7752882075-kube-api-access-ldkwf\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/070166e9-6136-4d20-87cc-733c41984af8-cni-binary-copy\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-cni-bin\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-multus-certs\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743385    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/070166e9-6136-4d20-87cc-733c41984af8-multus-daemon-config\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743406    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-slash\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.744331 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovnkube-config\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-etc-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-systemd\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-socket-dir-parent\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-hosts-file\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-multus-certs\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-cni-bin\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-cni-bin\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-cni-netd\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-hosts-file\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq95v\" (UniqueName: \"kubernetes.io/projected/87195c10-240f-4c70-b2de-61406d6a7bae-kube-api-access-vq95v\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.743983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m67tw\" (UniqueName: \"kubernetes.io/projected/b6185707-adc6-43fa-8a8b-a95116106b5a-kube-api-access-m67tw\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-ovn\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-env-overrides\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-kubelet-config\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.745297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xrxp\" (UniqueName: \"kubernetes.io/projected/3e48e194-1cfe-4370-adf3-d8636d7ef840-kube-api-access-9xrxp\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-registration-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-lib-modules\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovnkube-script-lib\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6185707-adc6-43fa-8a8b-a95116106b5a-serviceca\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-cni-multus\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/070166e9-6136-4d20-87cc-733c41984af8-cni-binary-copy\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovnkube-config\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfwdl\" (UniqueName: \"kubernetes.io/projected/070166e9-6136-4d20-87cc-733c41984af8-kube-api-access-nfwdl\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744405    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-registration-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-kubelet\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744470    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-env-overrides\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-cni-bin\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-kubelet-config\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-kubelet\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-cni-netd\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-ovn\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-cni-multus\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.744757    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.744826    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret podName:e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:34.244804907 +0000 UTC m=+3.016074967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret") pod "global-pull-secret-syncer-cj752" (UID: "e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-run-ovn-kubernetes\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6185707-adc6-43fa-8a8b-a95116106b5a-serviceca\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-host-run-ovn-kubernetes\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9-agent-certs\") pod \"konnectivity-agent-cz9pq\" (UID: \"50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9\") " pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9-konnectivity-ca\") pod \"konnectivity-agent-cz9pq\" (UID: \"50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9\") " pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.744983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-tmp-dir\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovn-node-metrics-cert\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovnkube-script-lib\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbbd44c8-eb7e-4b15-a132-dff805cb3756-iptables-alerter-script\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.745121    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:33.746956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-system-cni-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.745166    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs podName:e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:34.245151459 +0000 UTC m=+3.016421514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs") pod "network-metrics-daemon-6t59m" (UID: "e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-netns\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-system-cni-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-kubelet\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-var-lib-kubelet\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745254    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-host-run-netns\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-tmp-dir\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-hostroot\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-conf-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-systemd-units\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745547    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9-konnectivity-ca\") pod \"konnectivity-agent-cz9pq\" (UID: \"50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9\") " pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-var-lib-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-multus-conf-dir\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.747782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-var-lib-openvswitch\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-systemd\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-hostroot\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-socket-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-run-systemd\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-device-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-os-release\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-device-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745633    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e48e194-1cfe-4370-adf3-d8636d7ef840-systemd-units\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c6f3949-db62-4697-a719-ac1d98d16bfb-socket-dir\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745742    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-modprobe-d\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysconfig\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-etc-kubernetes\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87195c10-240f-4c70-b2de-61406d6a7bae-os-release\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.748604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbbd44c8-eb7e-4b15-a132-dff805cb3756-iptables-alerter-script\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.749457 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7ss8\" (UniqueName: \"kubernetes.io/projected/7c6f3949-db62-4697-a719-ac1d98d16bfb-kube-api-access-w7ss8\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.749457 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/070166e9-6136-4d20-87cc-733c41984af8-etc-kubernetes\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.749457 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.745963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysctl-conf\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.749457 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.746063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-host\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.749457 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.746210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87195c10-240f-4c70-b2de-61406d6a7bae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.749704 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.749476    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:33.749704 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.749494    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:33.749704 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.749510    2564 projected.go:196] Error preparing data for projected volume kube-api-access-xck4p for pod openshift-network-diagnostics/network-check-target-966d4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:33.749704 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:33.749573    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p podName:2da5d93a-aaa5-4289-91a3-fe09bae3ec7d nodeName:}" failed. No retries permitted until 2026-07-29 08:47:34.249556577 +0000 UTC m=+3.020826621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xck4p" (UniqueName: "kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p") pod "network-check-target-966d4" (UID: "2da5d93a-aaa5-4289-91a3-fe09bae3ec7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:33.751551 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.751523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e48e194-1cfe-4370-adf3-d8636d7ef840-ovn-node-metrics-cert\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.752518 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.752493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9-agent-certs\") pod \"konnectivity-agent-cz9pq\" (UID: \"50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9\") " pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:33.753395 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.753370    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq65w\" (UniqueName: \"kubernetes.io/projected/1fb8c2ee-ea91-4d57-b2dc-9653bb23c901-kube-api-access-qq65w\") pod \"node-resolver-l8f5l\" (UID: \"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901\") " pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.753539 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.753516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfwdl\" (UniqueName: \"kubernetes.io/projected/070166e9-6136-4d20-87cc-733c41984af8-kube-api-access-nfwdl\") pod \"multus-ktxzb\" (UID: \"070166e9-6136-4d20-87cc-733c41984af8\") " pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.755974 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.755939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk75h\" (UniqueName: \"kubernetes.io/projected/fbbd44c8-eb7e-4b15-a132-dff805cb3756-kube-api-access-gk75h\") pod \"iptables-alerter-zgg6g\" (UID: \"fbbd44c8-eb7e-4b15-a132-dff805cb3756\") " pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.756635 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.756587    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq95v\" (UniqueName: \"kubernetes.io/projected/87195c10-240f-4c70-b2de-61406d6a7bae-kube-api-access-vq95v\") pod \"multus-additional-cni-plugins-vjrw8\" (UID: \"87195c10-240f-4c70-b2de-61406d6a7bae\") " pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.756966 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.756945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m67tw\" (UniqueName: \"kubernetes.io/projected/b6185707-adc6-43fa-8a8b-a95116106b5a-kube-api-access-m67tw\") pod \"node-ca-rt4j6\" (UID: \"b6185707-adc6-43fa-8a8b-a95116106b5a\") " pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.757084 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.757062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xrxp\" (UniqueName: \"kubernetes.io/projected/3e48e194-1cfe-4370-adf3-d8636d7ef840-kube-api-access-9xrxp\") pod \"ovnkube-node-5n6lx\" (UID: \"3e48e194-1cfe-4370-adf3-d8636d7ef840\") " pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.757784 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.757485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7ss8\" (UniqueName: \"kubernetes.io/projected/7c6f3949-db62-4697-a719-ac1d98d16bfb-kube-api-access-w7ss8\") pod \"aws-ebs-csi-driver-node-gblms\" (UID: \"7c6f3949-db62-4697-a719-ac1d98d16bfb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.758890 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.758870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74qmb\" (UniqueName: \"kubernetes.io/projected/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-kube-api-access-74qmb\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:33.760418 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.760324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" event={"ID":"d7e2f0e0d351ab3984231d25ad22a404","Type":"ContainerStarted","Data":"60c0c0931ccfa2d933819ce40ce9fad1863f488980dd28902e7a0e46b2319e41"}
Jul 29 08:47:33.761913 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.761889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" event={"ID":"3a7c0b67d46e1779681af76760bb73d6","Type":"ContainerStarted","Data":"79c0da8bb603d2583d1bfd3eb4fcc5432d56a01423a3372f794629440a688fca"}
Jul 29 08:47:33.847384 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-modprobe-d\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847384 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysconfig\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysctl-conf\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-host\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-sys\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f730eb39-c3c5-406b-9f81-8b7752882075-tmp\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-kubernetes\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-var-lib-kubelet\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-modprobe-d\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f730eb39-c3c5-406b-9f81-8b7752882075-etc-tuned\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-host\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-sys\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847586    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysconfig\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.847627 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysctl-d\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysctl-conf\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-var-lib-kubelet\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-run\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847671    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-sysctl-d\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-run\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldkwf\" (UniqueName: \"kubernetes.io/projected/f730eb39-c3c5-406b-9f81-8b7752882075-kube-api-access-ldkwf\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847737    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-kubernetes\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-systemd\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-lib-modules\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-etc-systemd\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.848238 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.847955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f730eb39-c3c5-406b-9f81-8b7752882075-lib-modules\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.850276 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.850255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f730eb39-c3c5-406b-9f81-8b7752882075-tmp\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.850381 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.850307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f730eb39-c3c5-406b-9f81-8b7752882075-etc-tuned\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.856094 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.856070    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldkwf\" (UniqueName: \"kubernetes.io/projected/f730eb39-c3c5-406b-9f81-8b7752882075-kube-api-access-ldkwf\") pod \"tuned-spjwk\" (UID: \"f730eb39-c3c5-406b-9f81-8b7752882075\") " pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:33.928028 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.927984    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zgg6g"
Jul 29 08:47:33.937266 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.937236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rt4j6"
Jul 29 08:47:33.946871 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.946850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:33.955442 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.955416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8f5l"
Jul 29 08:47:33.963092 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.963070    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms"
Jul 29 08:47:33.970982 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.970961    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:33.979630 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.979601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjrw8"
Jul 29 08:47:33.989399 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.989370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ktxzb"
Jul 29 08:47:33.994089 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:33.994031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-spjwk"
Jul 29 08:47:34.250504 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.250416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:34.250504 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.250471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:34.250504 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.250500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:34.250797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:34.250602    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:34.250797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:34.250616    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:34.250797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:34.250628    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:34.250797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:34.250643    2564 projected.go:196] Error preparing data for projected volume kube-api-access-xck4p for pod openshift-network-diagnostics/network-check-target-966d4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:34.250797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:34.250617    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:34.250797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:34.250681    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs podName:e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:35.250662733 +0000 UTC m=+4.021932792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs") pod "network-metrics-daemon-6t59m" (UID: "e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:34.250797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:34.250704    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret podName:e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:35.250688473 +0000 UTC m=+4.021958524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret") pod "global-pull-secret-syncer-cj752" (UID: "e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:34.250797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:34.250736    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p podName:2da5d93a-aaa5-4289-91a3-fe09bae3ec7d nodeName:}" failed. No retries permitted until 2026-07-29 08:47:35.250725202 +0000 UTC m=+4.021995258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xck4p" (UniqueName: "kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p") pod "network-check-target-966d4" (UID: "2da5d93a-aaa5-4289-91a3-fe09bae3ec7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:34.669808 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.669687    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 08:42:33 +0000 UTC" deadline="2028-04-08 04:43:17.030458608 +0000 UTC"
Jul 29 08:47:34.669808 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.669745    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14851h55m42.360716495s"
Jul 29 08:47:34.715944 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:34.715916    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6185707_adc6_43fa_8a8b_a95116106b5a.slice/crio-916cb2ffaf181d11abb085b3c85f6182953633e9b4d6c73f2450234ee985a300 WatchSource:0}: Error finding container 916cb2ffaf181d11abb085b3c85f6182953633e9b4d6c73f2450234ee985a300: Status 404 returned error can't find the container with id 916cb2ffaf181d11abb085b3c85f6182953633e9b4d6c73f2450234ee985a300
Jul 29 08:47:34.717947 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:34.717919    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070166e9_6136_4d20_87cc_733c41984af8.slice/crio-6a5287dcff2defcbf950760338ced8740d2c62864647eb8e14b1635d923d76d1 WatchSource:0}: Error finding container 6a5287dcff2defcbf950760338ced8740d2c62864647eb8e14b1635d923d76d1: Status 404 returned error can't find the container with id 6a5287dcff2defcbf950760338ced8740d2c62864647eb8e14b1635d923d76d1
Jul 29 08:47:34.719340 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:34.719248    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e40ff2_c7cb_4a2f_bd59_0e14f5167ad9.slice/crio-2dc97b850d2e08dcc86cff3c8e68a944c8127b77e2b14ff49fa134765ef1d51c WatchSource:0}: Error finding container 2dc97b850d2e08dcc86cff3c8e68a944c8127b77e2b14ff49fa134765ef1d51c: Status 404 returned error can't find the container with id 2dc97b850d2e08dcc86cff3c8e68a944c8127b77e2b14ff49fa134765ef1d51c
Jul 29 08:47:34.725827 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:34.725242    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbd44c8_eb7e_4b15_a132_dff805cb3756.slice/crio-7027a2e3a4e239390b922d506bef5df49b2755cffe6811c123ebb64a7a94daef WatchSource:0}: Error finding container 7027a2e3a4e239390b922d506bef5df49b2755cffe6811c123ebb64a7a94daef: Status 404 returned error can't find the container with id 7027a2e3a4e239390b922d506bef5df49b2755cffe6811c123ebb64a7a94daef
Jul 29 08:47:34.725827 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:34.725663    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e48e194_1cfe_4370_adf3_d8636d7ef840.slice/crio-ea663d5d30ae6a0fe08925cfafb8b7e208a482aea22f22d401ea807fe4030b0e WatchSource:0}: Error finding container ea663d5d30ae6a0fe08925cfafb8b7e208a482aea22f22d401ea807fe4030b0e: Status 404 returned error can't find the container with id ea663d5d30ae6a0fe08925cfafb8b7e208a482aea22f22d401ea807fe4030b0e
Jul 29 08:47:34.728060 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:34.727990    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87195c10_240f_4c70_b2de_61406d6a7bae.slice/crio-8a212031ccb780e492ae16b9bb1f8dbbc6918024a9230ebc5916a791ea91e0ae WatchSource:0}: Error finding container 8a212031ccb780e492ae16b9bb1f8dbbc6918024a9230ebc5916a791ea91e0ae: Status 404 returned error can't find the container with id 8a212031ccb780e492ae16b9bb1f8dbbc6918024a9230ebc5916a791ea91e0ae
Jul 29 08:47:34.730626 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:47:34.730021    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6f3949_db62_4697_a719_ac1d98d16bfb.slice/crio-dafa56e23ad56c2d1f5c689079ee559a3dbcbf9136906a05400ff2407176860b WatchSource:0}: Error finding container dafa56e23ad56c2d1f5c689079ee559a3dbcbf9136906a05400ff2407176860b: Status 404 returned error can't find the container with id dafa56e23ad56c2d1f5c689079ee559a3dbcbf9136906a05400ff2407176860b
Jul 29 08:47:34.747024 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.746997    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 08:47:34.764545 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.764520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rt4j6" event={"ID":"b6185707-adc6-43fa-8a8b-a95116106b5a","Type":"ContainerStarted","Data":"916cb2ffaf181d11abb085b3c85f6182953633e9b4d6c73f2450234ee985a300"}
Jul 29 08:47:34.765555 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.765531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms" event={"ID":"7c6f3949-db62-4697-a719-ac1d98d16bfb","Type":"ContainerStarted","Data":"dafa56e23ad56c2d1f5c689079ee559a3dbcbf9136906a05400ff2407176860b"}
Jul 29 08:47:34.766504 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.766484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-spjwk" event={"ID":"f730eb39-c3c5-406b-9f81-8b7752882075","Type":"ContainerStarted","Data":"a5703df2cafd1cd5e08a6a8d84427a7e4cc3a6ba4f3e863287c93527f359d1c2"}
Jul 29 08:47:34.767443 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.767424    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zgg6g" event={"ID":"fbbd44c8-eb7e-4b15-a132-dff805cb3756","Type":"ContainerStarted","Data":"7027a2e3a4e239390b922d506bef5df49b2755cffe6811c123ebb64a7a94daef"}
Jul 29 08:47:34.770746 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.770694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"ea663d5d30ae6a0fe08925cfafb8b7e208a482aea22f22d401ea807fe4030b0e"}
Jul 29 08:47:34.773065 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.773045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" event={"ID":"87195c10-240f-4c70-b2de-61406d6a7bae","Type":"ContainerStarted","Data":"8a212031ccb780e492ae16b9bb1f8dbbc6918024a9230ebc5916a791ea91e0ae"}
Jul 29 08:47:34.773978 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.773957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8f5l" event={"ID":"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901","Type":"ContainerStarted","Data":"34492d0a0c526a2b839f01b09465e8a4cc71b622ef8cd5e8514d10f809ec58ac"}
Jul 29 08:47:34.774940 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.774922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cz9pq" event={"ID":"50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9","Type":"ContainerStarted","Data":"2dc97b850d2e08dcc86cff3c8e68a944c8127b77e2b14ff49fa134765ef1d51c"}
Jul 29 08:47:34.776101 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:34.776078    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ktxzb" event={"ID":"070166e9-6136-4d20-87cc-733c41984af8","Type":"ContainerStarted","Data":"6a5287dcff2defcbf950760338ced8740d2c62864647eb8e14b1635d923d76d1"}
Jul 29 08:47:35.257823 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.257736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:35.257823 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.257801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:35.258031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.257865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:35.258031 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.258015    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:35.258136 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.258051    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:35.258136 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.258064    2564 projected.go:196] Error preparing data for projected volume kube-api-access-xck4p for pod openshift-network-diagnostics/network-check-target-966d4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:35.258136 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.258126    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p podName:2da5d93a-aaa5-4289-91a3-fe09bae3ec7d nodeName:}" failed. No retries permitted until 2026-07-29 08:47:37.258107105 +0000 UTC m=+6.029377161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xck4p" (UniqueName: "kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p") pod "network-check-target-966d4" (UID: "2da5d93a-aaa5-4289-91a3-fe09bae3ec7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:35.258733 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.258545    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:35.258733 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.258582    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:35.258733 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.258600    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret podName:e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:37.258584929 +0000 UTC m=+6.029854989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret") pod "global-pull-secret-syncer-cj752" (UID: "e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:35.258733 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.258648    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs podName:e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:37.258630742 +0000 UTC m=+6.029900787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs") pod "network-metrics-daemon-6t59m" (UID: "e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:35.671179 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.671085    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 08:42:33 +0000 UTC" deadline="2028-03-04 20:14:18.289939671 +0000 UTC"
Jul 29 08:47:35.671179 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.671129    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14027h26m42.618814896s"
Jul 29 08:47:35.757412 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.757382    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:35.757592 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.757509    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:35.758000 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.757958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:35.758104 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.758056    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:35.758212 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.758195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:35.758309 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:35.758290    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:35.789085 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.789051    2564 generic.go:356] "Generic (PLEG): container finished" podID="d7e2f0e0d351ab3984231d25ad22a404" containerID="2ec8d9670519656e6eba3a26e024061c34fb5c6ed42a0fb732557ea2cde2a2d1" exitCode=0
Jul 29 08:47:35.789242 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.789138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" event={"ID":"d7e2f0e0d351ab3984231d25ad22a404","Type":"ContainerDied","Data":"2ec8d9670519656e6eba3a26e024061c34fb5c6ed42a0fb732557ea2cde2a2d1"}
Jul 29 08:47:35.792736 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.792695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" event={"ID":"3a7c0b67d46e1779681af76760bb73d6","Type":"ContainerStarted","Data":"deb46f75e8f176a9d57dbd05b8645249ddfde356962fcbf2802298a5044ad16d"}
Jul 29 08:47:35.828411 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:35.827822    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" podStartSLOduration=2.827803247 podStartE2EDuration="2.827803247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:35.827224917 +0000 UTC m=+4.598495013" watchObservedRunningTime="2026-07-29 08:47:35.827803247 +0000 UTC m=+4.599073314"
Jul 29 08:47:36.822867 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:36.822330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" event={"ID":"d7e2f0e0d351ab3984231d25ad22a404","Type":"ContainerStarted","Data":"cd74c42d8fe424dfa8953dc79b285d71190e0441242b793781e3850515ac8d3a"}
Jul 29 08:47:37.275221 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:37.275182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:37.275403 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:37.275248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:37.275403 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:37.275277    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:37.275510 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.275409    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:37.275510 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.275472    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs podName:e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:41.275453502 +0000 UTC m=+10.046723562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs") pod "network-metrics-daemon-6t59m" (UID: "e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:37.275949 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.275928    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:37.276058 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.275963    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:37.276058 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.275976    2564 projected.go:196] Error preparing data for projected volume kube-api-access-xck4p for pod openshift-network-diagnostics/network-check-target-966d4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:37.276058 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.276023    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p podName:2da5d93a-aaa5-4289-91a3-fe09bae3ec7d nodeName:}" failed. No retries permitted until 2026-07-29 08:47:41.276007671 +0000 UTC m=+10.047277730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xck4p" (UniqueName: "kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p") pod "network-check-target-966d4" (UID: "2da5d93a-aaa5-4289-91a3-fe09bae3ec7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:37.276221 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.276095    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:37.276221 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.276130    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret podName:e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:41.276119318 +0000 UTC m=+10.047389361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret") pod "global-pull-secret-syncer-cj752" (UID: "e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:37.755518 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:37.755431    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:37.755681 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.755644    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:37.756080 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:37.756060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:37.756188 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.756157    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:37.756295 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:37.756279    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:37.756386 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:37.756368    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:39.756063 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:39.755489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:39.756063 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:39.755639    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:39.756063 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:39.755973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:39.756063 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:39.755997    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:39.759875 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:39.757440    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:39.759875 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:39.757578    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:41.308178 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:41.308142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:41.308199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:41.308231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.308327    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.308330    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.308364    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.308328    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.308389    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs podName:e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:49.308370556 +0000 UTC m=+18.079640602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs") pod "network-metrics-daemon-6t59m" (UID: "e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.308438    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret podName:e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43 nodeName:}" failed. No retries permitted until 2026-07-29 08:47:49.308416412 +0000 UTC m=+18.079686483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret") pod "global-pull-secret-syncer-cj752" (UID: "e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.308375    2564 projected.go:196] Error preparing data for projected volume kube-api-access-xck4p for pod openshift-network-diagnostics/network-check-target-966d4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:41.308630 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.308507    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p podName:2da5d93a-aaa5-4289-91a3-fe09bae3ec7d nodeName:}" failed. No retries permitted until 2026-07-29 08:47:49.308496055 +0000 UTC m=+18.079766096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xck4p" (UniqueName: "kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p") pod "network-check-target-966d4" (UID: "2da5d93a-aaa5-4289-91a3-fe09bae3ec7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:41.755774 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:41.755676    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:41.755922 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.755874    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:41.756319 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:41.756299    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:41.756441 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.756417    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:41.756582 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:41.756564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:41.757797 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:41.757764    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:43.755729 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:43.755694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:43.755729 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:43.755710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:43.756234 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:43.755692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:43.756234 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:43.755883    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:43.756234 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:43.755955    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:43.756234 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:43.756042    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:45.755277 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:45.755237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:45.755277 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:45.755259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:45.755824 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:45.755237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:45.755824 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:45.755394    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:45.755824 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:45.755506    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:45.755824 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:45.755596    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:47.755706 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:47.755661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:47.756209 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:47.755661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:47.756209 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:47.755662    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:47.756209 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:47.755815    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:47.756209 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:47.755902    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:47.756209 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:47.755975    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:49.377437 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:49.377385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:49.377452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:49.377487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.377572    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.377597    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.377617    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.377634    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.377647    2564 projected.go:196] Error preparing data for projected volume kube-api-access-xck4p for pod openshift-network-diagnostics/network-check-target-966d4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.377653    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs podName:e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:05.377632996 +0000 UTC m=+34.148903052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs") pod "network-metrics-daemon-6t59m" (UID: "e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.377671    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret podName:e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:05.377661158 +0000 UTC m=+34.148931207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret") pod "global-pull-secret-syncer-cj752" (UID: "e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:47:49.377910 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.377686    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p podName:2da5d93a-aaa5-4289-91a3-fe09bae3ec7d nodeName:}" failed. No retries permitted until 2026-07-29 08:48:05.377677558 +0000 UTC m=+34.148947604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xck4p" (UniqueName: "kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p") pod "network-check-target-966d4" (UID: "2da5d93a-aaa5-4289-91a3-fe09bae3ec7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:47:49.755799 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:49.755694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:49.755799 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:49.755761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:49.756005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:49.755694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:49.756005 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.755842    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:49.756005 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.755941    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:49.756168 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:49.756015    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:51.756188 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:51.756154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:51.756629 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:51.756266    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:51.756629 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:51.756312    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:51.756629 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:51.756345    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:51.756629 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:51.756371    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:51.756629 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:51.756446    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:53.755640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.755377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:53.756470 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.755436    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:53.756470 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:53.755777    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:53.756470 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.755447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:53.756470 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:53.755827    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:53.756470 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:53.755890    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:53.856325 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.856290    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms" event={"ID":"7c6f3949-db62-4697-a719-ac1d98d16bfb","Type":"ContainerStarted","Data":"cdc375e02158623db85010abc7908b8aa033a8a1377c4ec68fc3466ef276e8ac"}
Jul 29 08:47:53.857762 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.857739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-spjwk" event={"ID":"f730eb39-c3c5-406b-9f81-8b7752882075","Type":"ContainerStarted","Data":"267c1230a800765d2fe7349d7a7b14cfdab1b187d027854e64605203f5cbf93e"}
Jul 29 08:47:53.860474 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.860451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"e95784cd311cae8ed32adc5a3a40c9c8cb386669d0d6707b9dd8076bd37d7821"}
Jul 29 08:47:53.860592 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.860512    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"5809ad43705ab02a2a152d81a14976d9ca6c1be92e65332692c2a2d0e46e5ca8"}
Jul 29 08:47:53.860592 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.860554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"5df9b5a64cd3a5c39c59bc75df8ddf543d3177eee251b140cf2ab76bfb0fdf06"}
Jul 29 08:47:53.860592 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.860584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"b064734f7d8760fbc649352503e0ecb2567f43d071db92c1906a1465f5da1ce6"}
Jul 29 08:47:53.862032 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.861990    2564 generic.go:356] "Generic (PLEG): container finished" podID="87195c10-240f-4c70-b2de-61406d6a7bae" containerID="f9f49d4dbcc2507bc2d3a429ab6c40c02c70231add540d7612243549da6c8f84" exitCode=0
Jul 29 08:47:53.862128 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.862080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" event={"ID":"87195c10-240f-4c70-b2de-61406d6a7bae","Type":"ContainerDied","Data":"f9f49d4dbcc2507bc2d3a429ab6c40c02c70231add540d7612243549da6c8f84"}
Jul 29 08:47:53.863583 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.863535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8f5l" event={"ID":"1fb8c2ee-ea91-4d57-b2dc-9653bb23c901","Type":"ContainerStarted","Data":"ca0564deebdbfa8457560f00c26d81a3214068216623c969a3cb60ec219de6c4"}
Jul 29 08:47:53.865193 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.865175    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cz9pq" event={"ID":"50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9","Type":"ContainerStarted","Data":"915b44d51af17851705b5cb22e96cd8b6df4bb858976ef33e051f0571050dd6b"}
Jul 29 08:47:53.866854 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.866831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ktxzb" event={"ID":"070166e9-6136-4d20-87cc-733c41984af8","Type":"ContainerStarted","Data":"a46070773971fe6b58bf3bf585270c666edd2077e85718c908f513424190c708"}
Jul 29 08:47:53.868413 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.868388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rt4j6" event={"ID":"b6185707-adc6-43fa-8a8b-a95116106b5a","Type":"ContainerStarted","Data":"d20efb0462804824150abe2b0cddc46f894cae96593aae2693e441bc30c57cbd"}
Jul 29 08:47:53.874519 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.874482    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" podStartSLOduration=20.87445333 podStartE2EDuration="20.87445333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:36.841555755 +0000 UTC m=+5.612825818" watchObservedRunningTime="2026-07-29 08:47:53.87445333 +0000 UTC m=+22.645723388"
Jul 29 08:47:53.874830 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.874808    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-spjwk" podStartSLOduration=3.288084252 podStartE2EDuration="21.874800875s" totalImagesPullingTime="18.586716623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:53.874637006 +0000 UTC m=+22.645907069" watchObservedRunningTime="2026-07-29 08:47:53.874800875 +0000 UTC m=+22.646070956"
Jul 29 08:47:53.915513 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.915461    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cz9pq" podStartSLOduration=11.460361785 podStartE2EDuration="21.915441653s" totalImagesPullingTime="10.455079868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:53.888202569 +0000 UTC m=+22.659472633" watchObservedRunningTime="2026-07-29 08:47:53.915441653 +0000 UTC m=+22.686711718"
Jul 29 08:47:53.933787 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.933753    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ktxzb" podStartSLOduration=3.096604466 podStartE2EDuration="21.933739105s" totalImagesPullingTime="18.837134639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:53.933423595 +0000 UTC m=+22.704693670" watchObservedRunningTime="2026-07-29 08:47:53.933739105 +0000 UTC m=+22.705009166"
Jul 29 08:47:53.954248 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.954207    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rt4j6" podStartSLOduration=4.358013726 podStartE2EDuration="22.954193729s" totalImagesPullingTime="18.596180003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:53.949071779 +0000 UTC m=+22.720341864" watchObservedRunningTime="2026-07-29 08:47:53.954193729 +0000 UTC m=+22.725463793"
Jul 29 08:47:53.963975 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:53.963941    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l8f5l" podStartSLOduration=3.37475002 podStartE2EDuration="21.963928754s" totalImagesPullingTime="18.589178734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:53.963836296 +0000 UTC m=+22.735106360" watchObservedRunningTime="2026-07-29 08:47:53.963928754 +0000 UTC m=+22.735198819"
Jul 29 08:47:54.873910 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:54.873874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"f4ec194b64f32506293c66f4c72edfa80fb8de272b81f952a7942367a314460e"}
Jul 29 08:47:54.874392 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:54.873965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"3f26844ac8a293b807b8c88818979d7767dd654779ca07963affc40007d6ec1f"}
Jul 29 08:47:54.875445 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:54.875417    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zgg6g" event={"ID":"fbbd44c8-eb7e-4b15-a132-dff805cb3756","Type":"ContainerStarted","Data":"67fffce111cc1c0d9f662b463128436e96710917f1e669c30e9825b5569ef3e2"}
Jul 29 08:47:54.890474 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:54.890421    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zgg6g" podStartSLOduration=5.304593995 podStartE2EDuration="23.890406689s" totalImagesPullingTime="18.585812694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:54.890025293 +0000 UTC m=+23.661295381" watchObservedRunningTime="2026-07-29 08:47:54.890406689 +0000 UTC m=+23.661676753"
Jul 29 08:47:55.145646 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:55.145620    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 08:47:55.706561 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:55.706447    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T08:47:55.145639642Z","UUID":"232c1f9a-8609-4572-ac03-77980d6bc3d3","Handler":null,"Name":"","Endpoint":""}
Jul 29 08:47:55.708515 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:55.708481    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 08:47:55.708640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:55.708526    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 08:47:55.755626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:55.755496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:55.755817 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:55.755496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:55.755817 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:55.755642    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:55.755817 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:55.755757    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:55.755817 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:55.755814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:55.756006 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:55.755882    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:55.880945 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:55.880790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms" event={"ID":"7c6f3949-db62-4697-a719-ac1d98d16bfb","Type":"ContainerStarted","Data":"4de8602de7467900348593016c68407abca3c9fabb1ff8d36171d27662fd2d95"}
Jul 29 08:47:56.886392 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:56.886313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"9380124e108c712794639fc116570afc45329555e6ed0f579a116d80c9d67798"}
Jul 29 08:47:57.755563 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:57.755285    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:57.755761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:57.755285    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:57.755761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:57.755336    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:57.755761 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:57.755699    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:57.755931 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:57.755831    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:57.755931 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:57.755913    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:58.502882 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.502663    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:58.503594 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.503255    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:58.892207 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.892173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms" event={"ID":"7c6f3949-db62-4697-a719-ac1d98d16bfb","Type":"ContainerStarted","Data":"662f6fdc05fc6a2e7ca5a7b884edb6a2b39a4079fcc4fd3429afd89e031c7de3"}
Jul 29 08:47:58.895497 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.895473    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" event={"ID":"3e48e194-1cfe-4370-adf3-d8636d7ef840","Type":"ContainerStarted","Data":"5822fc9893494446805e0a16daca9c67f338e3565839671d4a95dda7d4e3d5d4"}
Jul 29 08:47:58.895645 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.895629    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:58.895737 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.895687    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:58.897232 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.897210    2564 generic.go:356] "Generic (PLEG): container finished" podID="87195c10-240f-4c70-b2de-61406d6a7bae" containerID="217e3f4e8f51049cbb02f282cebd8577e05931d0cac1fbd98562c45b2437c397" exitCode=0
Jul 29 08:47:58.897329 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.897284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" event={"ID":"87195c10-240f-4c70-b2de-61406d6a7bae","Type":"ContainerDied","Data":"217e3f4e8f51049cbb02f282cebd8577e05931d0cac1fbd98562c45b2437c397"}
Jul 29 08:47:58.897499 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.897463    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:58.897968 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.897951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cz9pq"
Jul 29 08:47:58.909619 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.909581    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gblms" podStartSLOduration=3.937633693 podStartE2EDuration="26.909567095s" totalImagesPullingTime="22.971933402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:58.909301296 +0000 UTC m=+27.680571361" watchObservedRunningTime="2026-07-29 08:47:58.909567095 +0000 UTC m=+27.680837159"
Jul 29 08:47:58.911842 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.911823    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:58.966167 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:58.966124    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx" podStartSLOduration=8.341244084 podStartE2EDuration="26.966109721s" totalImagesPullingTime="18.624865637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:47:58.965477842 +0000 UTC m=+27.736747907" watchObservedRunningTime="2026-07-29 08:47:58.966109721 +0000 UTC m=+27.737379785"
Jul 29 08:47:59.755311 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:59.755278    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:47:59.755788 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:59.755278    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:47:59.755788 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:59.755421    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:47:59.755788 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:59.755462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:47:59.755788 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:59.755549    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:47:59.755788 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:47:59.755613    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:47:59.900619 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:59.900565    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:47:59.915640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:47:59.915605    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:48:00.359311 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:00.359271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-966d4"]
Jul 29 08:48:00.359497 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:00.359374    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:00.359497 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:00.359476    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:48:00.362099 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:00.362071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cj752"]
Jul 29 08:48:00.362237 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:00.362168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:00.362304 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:00.362283    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:48:00.362593 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:00.362572    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6t59m"]
Jul 29 08:48:00.362665 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:00.362653    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:48:00.362773 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:00.362756    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:48:00.904231 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:00.904194    2564 generic.go:356] "Generic (PLEG): container finished" podID="87195c10-240f-4c70-b2de-61406d6a7bae" containerID="91a5c834ef64e2ca8907d2ebf3333e263db801f5bfc2f40441d5d0d7722a0971" exitCode=0
Jul 29 08:48:00.904608 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:00.904276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" event={"ID":"87195c10-240f-4c70-b2de-61406d6a7bae","Type":"ContainerDied","Data":"91a5c834ef64e2ca8907d2ebf3333e263db801f5bfc2f40441d5d0d7722a0971"}
Jul 29 08:48:01.756666 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:01.756630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:48:01.756833 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:01.756753    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:01.756833 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:01.756794    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:01.756833 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:01.756786    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:48:01.756954 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:01.756873    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:48:01.756995 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:01.756961    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:48:02.910469 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:02.910293    2564 generic.go:356] "Generic (PLEG): container finished" podID="87195c10-240f-4c70-b2de-61406d6a7bae" containerID="4a391d3cdc2cbe81342153531e35d311d83d9952793a8214d5a7b3e69cf728ae" exitCode=0
Jul 29 08:48:02.910834 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:02.910367    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" event={"ID":"87195c10-240f-4c70-b2de-61406d6a7bae","Type":"ContainerDied","Data":"4a391d3cdc2cbe81342153531e35d311d83d9952793a8214d5a7b3e69cf728ae"}
Jul 29 08:48:03.755094 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:03.755063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:03.755313 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:03.755063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:48:03.755313 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:03.755193    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:48:03.755313 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:03.755067    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:03.755474 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:03.755313    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:48:03.755474 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:03.755398    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:48:05.389882 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:05.389847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:05.389890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:05.389918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.390005    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.390013    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.390017    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.390058    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs podName:e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:37.390042707 +0000 UTC m=+66.161312754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs") pod "network-metrics-daemon-6t59m" (UID: "e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.390030    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.390072    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret podName:e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:37.390065619 +0000 UTC m=+66.161335660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret") pod "global-pull-secret-syncer-cj752" (UID: "e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43") : object "kube-system"/"original-pull-secret" not registered
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.390079    2564 projected.go:196] Error preparing data for projected volume kube-api-access-xck4p for pod openshift-network-diagnostics/network-check-target-966d4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:48:05.390533 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.390129    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p podName:2da5d93a-aaa5-4289-91a3-fe09bae3ec7d nodeName:}" failed. No retries permitted until 2026-07-29 08:48:37.39010989 +0000 UTC m=+66.161379939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xck4p" (UniqueName: "kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p") pod "network-check-target-966d4" (UID: "2da5d93a-aaa5-4289-91a3-fe09bae3ec7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 08:48:05.755802 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:05.755705    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:05.755802 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:05.755761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:05.756021 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:05.755710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:48:05.756021 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.755848    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-966d4" podUID="2da5d93a-aaa5-4289-91a3-fe09bae3ec7d"
Jul 29 08:48:05.756021 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.755932    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6t59m" podUID="e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8"
Jul 29 08:48:05.756021 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:05.755998    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cj752" podUID="e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43"
Jul 29 08:48:06.592095 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.592062    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeReady"
Jul 29 08:48:06.592537 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.592229    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 08:48:06.632599 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.632563    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c458b65fd-ddlrg"]
Jul 29 08:48:06.635759 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.635726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.637964 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.637937    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 08:48:06.638080 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.637997    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 08:48:06.638080 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.637943    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t2qgg\""
Jul 29 08:48:06.638468 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.638421    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 08:48:06.642832 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.642776    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 08:48:06.664312 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.664280    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c458b65fd-ddlrg"]
Jul 29 08:48:06.682489 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.682392    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5hmg8"]
Jul 29 08:48:06.684453 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.684434    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pb44v"]
Jul 29 08:48:06.684604 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.684577    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5hmg8"
Jul 29 08:48:06.686417 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.686396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.687739 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.687467    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 08:48:06.687739 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.687537    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wb7dl\""
Jul 29 08:48:06.687739 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.687587    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 08:48:06.687923 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.687778    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 08:48:06.690212 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.688987    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-68zl6\""
Jul 29 08:48:06.692763 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.692644    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 08:48:06.692941 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.692889    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 08:48:06.710550 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.710525    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pb44v"]
Jul 29 08:48:06.711179 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.711159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5hmg8"]
Jul 29 08:48:06.800343 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-bound-sa-token\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.800523 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq8d6\" (UniqueName: \"kubernetes.io/projected/535222c0-a409-4022-99bc-dc2512cdfc07-kube-api-access-nq8d6\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.800523 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq8pp\" (UniqueName: \"kubernetes.io/projected/902e3875-27f9-4c3e-8e9c-937846e72c03-kube-api-access-qq8pp\") pod \"ingress-canary-5hmg8\" (UID: \"902e3875-27f9-4c3e-8e9c-937846e72c03\") " pod="openshift-ingress-canary/ingress-canary-5hmg8"
Jul 29 08:48:06.800523 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.800523 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-trusted-ca\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.800762 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535222c0-a409-4022-99bc-dc2512cdfc07-tmp-dir\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.800762 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-certificates\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.800762 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.800762 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/535222c0-a409-4022-99bc-dc2512cdfc07-config-volume\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.800956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-image-registry-private-configuration\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.800956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcdhd\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-kube-api-access-jcdhd\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.800956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-ca-trust-extracted\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.800956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-installation-pull-secrets\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.800956 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.800929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902e3875-27f9-4c3e-8e9c-937846e72c03-cert\") pod \"ingress-canary-5hmg8\" (UID: \"902e3875-27f9-4c3e-8e9c-937846e72c03\") " pod="openshift-ingress-canary/ingress-canary-5hmg8"
Jul 29 08:48:06.902182 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq8pp\" (UniqueName: \"kubernetes.io/projected/902e3875-27f9-4c3e-8e9c-937846e72c03-kube-api-access-qq8pp\") pod \"ingress-canary-5hmg8\" (UID: \"902e3875-27f9-4c3e-8e9c-937846e72c03\") " pod="openshift-ingress-canary/ingress-canary-5hmg8"
Jul 29 08:48:06.902182 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.902182 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-trusted-ca\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535222c0-a409-4022-99bc-dc2512cdfc07-tmp-dir\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-certificates\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/535222c0-a409-4022-99bc-dc2512cdfc07-config-volume\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-image-registry-private-configuration\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcdhd\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-kube-api-access-jcdhd\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-ca-trust-extracted\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-installation-pull-secrets\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.902465 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902e3875-27f9-4c3e-8e9c-937846e72c03-cert\") pod \"ingress-canary-5hmg8\" (UID: \"902e3875-27f9-4c3e-8e9c-937846e72c03\") " pod="openshift-ingress-canary/ingress-canary-5hmg8"
Jul 29 08:48:06.902924 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-bound-sa-token\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.902924 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.902531    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq8d6\" (UniqueName: \"kubernetes.io/projected/535222c0-a409-4022-99bc-dc2512cdfc07-kube-api-access-nq8d6\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.903178 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.903025    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-certificates\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.903178 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:06.902289    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 08:48:06.903323 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:06.903185    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c458b65fd-ddlrg: secret "image-registry-tls" not found
Jul 29 08:48:06.903323 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:06.903265    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls podName:c1ed4873-0915-4ad8-8a3d-9c935c19cbbe nodeName:}" failed. No retries permitted until 2026-07-29 08:48:07.403244412 +0000 UTC m=+36.174514473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls") pod "image-registry-6c458b65fd-ddlrg" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe") : secret "image-registry-tls" not found
Jul 29 08:48:06.903323 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.903308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-trusted-ca\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.903523 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:06.903161    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:06.903523 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.903351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-ca-trust-extracted\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.903523 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.903388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535222c0-a409-4022-99bc-dc2512cdfc07-tmp-dir\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.903523 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:06.903417    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls podName:535222c0-a409-4022-99bc-dc2512cdfc07 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:07.403392249 +0000 UTC m=+36.174662300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls") pod "dns-default-pb44v" (UID: "535222c0-a409-4022-99bc-dc2512cdfc07") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:06.904001 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.903980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/535222c0-a409-4022-99bc-dc2512cdfc07-config-volume\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.907621 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.907600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-image-registry-private-configuration\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.907761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.907617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-installation-pull-secrets\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.907761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.907622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902e3875-27f9-4c3e-8e9c-937846e72c03-cert\") pod \"ingress-canary-5hmg8\" (UID: \"902e3875-27f9-4c3e-8e9c-937846e72c03\") " pod="openshift-ingress-canary/ingress-canary-5hmg8"
Jul 29 08:48:06.910927 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.910903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq8d6\" (UniqueName: \"kubernetes.io/projected/535222c0-a409-4022-99bc-dc2512cdfc07-kube-api-access-nq8d6\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:06.911016 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.910949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcdhd\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-kube-api-access-jcdhd\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.911073 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.911031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-bound-sa-token\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:06.911137 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.911121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq8pp\" (UniqueName: \"kubernetes.io/projected/902e3875-27f9-4c3e-8e9c-937846e72c03-kube-api-access-qq8pp\") pod \"ingress-canary-5hmg8\" (UID: \"902e3875-27f9-4c3e-8e9c-937846e72c03\") " pod="openshift-ingress-canary/ingress-canary-5hmg8"
Jul 29 08:48:06.998394 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:06.998354    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5hmg8"
Jul 29 08:48:07.137568 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.137523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5hmg8"]
Jul 29 08:48:07.142138 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:48:07.142107    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902e3875_27f9_4c3e_8e9c_937846e72c03.slice/crio-8a47a53d81985115937fb4aed3f69716f03bb7fec7e2eda191371f00e8f58ecc WatchSource:0}: Error finding container 8a47a53d81985115937fb4aed3f69716f03bb7fec7e2eda191371f00e8f58ecc: Status 404 returned error can't find the container with id 8a47a53d81985115937fb4aed3f69716f03bb7fec7e2eda191371f00e8f58ecc
Jul 29 08:48:07.406699 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.406661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:07.406882 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.406731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:07.406882 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:07.406811    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 08:48:07.406882 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:07.406829    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c458b65fd-ddlrg: secret "image-registry-tls" not found
Jul 29 08:48:07.406882 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:07.406856    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:07.406882 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:07.406883    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls podName:c1ed4873-0915-4ad8-8a3d-9c935c19cbbe nodeName:}" failed. No retries permitted until 2026-07-29 08:48:08.406868928 +0000 UTC m=+37.178138971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls") pod "image-registry-6c458b65fd-ddlrg" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe") : secret "image-registry-tls" not found
Jul 29 08:48:07.407075 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:07.406904    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls podName:535222c0-a409-4022-99bc-dc2512cdfc07 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:08.406889165 +0000 UTC m=+37.178159228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls") pod "dns-default-pb44v" (UID: "535222c0-a409-4022-99bc-dc2512cdfc07") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:07.755543 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.755511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:07.756215 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.755511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:48:07.756215 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.755645    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:07.758205 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.758178    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 08:48:07.758924 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.758698    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dmmnd\""
Jul 29 08:48:07.758924 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.758710    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 08:48:07.758924 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.758782    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hkhb\""
Jul 29 08:48:07.758924 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.758871    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 08:48:07.758924 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.758883    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 08:48:07.925040 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.925007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5hmg8" event={"ID":"902e3875-27f9-4c3e-8e9c-937846e72c03","Type":"ContainerStarted","Data":"8a47a53d81985115937fb4aed3f69716f03bb7fec7e2eda191371f00e8f58ecc"}
Jul 29 08:48:07.928060 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.927989    2564 generic.go:356] "Generic (PLEG): container finished" podID="87195c10-240f-4c70-b2de-61406d6a7bae" containerID="7f809f9ec0dd06a8dbd0db83661880d02625b215ac745150eb96a74371aa218f" exitCode=0
Jul 29 08:48:07.928060 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:07.928031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" event={"ID":"87195c10-240f-4c70-b2de-61406d6a7bae","Type":"ContainerDied","Data":"7f809f9ec0dd06a8dbd0db83661880d02625b215ac745150eb96a74371aa218f"}
Jul 29 08:48:08.112146 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.112113    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:08.264926 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.264850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:08.376959 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.376930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:08.415925 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.415893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:08.416075 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.415935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:08.418981 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:08.416397    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 08:48:08.418981 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:08.416424    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c458b65fd-ddlrg: secret "image-registry-tls" not found
Jul 29 08:48:08.418981 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:08.416512    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls podName:c1ed4873-0915-4ad8-8a3d-9c935c19cbbe nodeName:}" failed. No retries permitted until 2026-07-29 08:48:10.416483528 +0000 UTC m=+39.187753587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls") pod "image-registry-6c458b65fd-ddlrg" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe") : secret "image-registry-tls" not found
Jul 29 08:48:08.418981 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:08.416543    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:08.418981 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:08.416591    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls podName:535222c0-a409-4022-99bc-dc2512cdfc07 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:10.416578764 +0000 UTC m=+39.187848812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls") pod "dns-default-pb44v" (UID: "535222c0-a409-4022-99bc-dc2512cdfc07") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:08.476131 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.476092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:08.591239 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.591156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:08.692345 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.692302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:08.934042 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.934001    2564 generic.go:356] "Generic (PLEG): container finished" podID="87195c10-240f-4c70-b2de-61406d6a7bae" containerID="fe6e54d5d1f9852ff6679061c936bc1c90f30cb574a78146d35ab0a272a5e067" exitCode=0
Jul 29 08:48:08.934470 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:08.934060    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" event={"ID":"87195c10-240f-4c70-b2de-61406d6a7bae","Type":"ContainerDied","Data":"fe6e54d5d1f9852ff6679061c936bc1c90f30cb574a78146d35ab0a272a5e067"}
Jul 29 08:48:09.239613 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:09.239525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:09.391649 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:09.391438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:09.619447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:09.619423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:09.720496 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:09.720462    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:09.937615 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:09.937583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5hmg8" event={"ID":"902e3875-27f9-4c3e-8e9c-937846e72c03","Type":"ContainerStarted","Data":"56f76d7404af9702f40ad7b20670496d212f8a379a9cc6fd748839a7899f6094"}
Jul 29 08:48:09.940834 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:09.940813    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" event={"ID":"87195c10-240f-4c70-b2de-61406d6a7bae","Type":"ContainerStarted","Data":"53f83c37dc7f8c2433ca5269b7f3e0ac59878836d44deda6752466da1f53a5df"}
Jul 29 08:48:09.967012 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:09.966968    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5hmg8" podStartSLOduration=1.5813014779999999 podStartE2EDuration="3.966953288s" totalImagesPullingTime="2.38565181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:09.966904854 +0000 UTC m=+38.738174919" watchObservedRunningTime="2026-07-29 08:48:09.966953288 +0000 UTC m=+38.738223353"
Jul 29 08:48:10.033156 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:10.033126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:10.433398 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:10.433363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:10.433578 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:10.433415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:10.433578 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:10.433526    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:10.433578 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:10.433532    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 08:48:10.433578 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:10.433554    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c458b65fd-ddlrg: secret "image-registry-tls" not found
Jul 29 08:48:10.433745 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:10.433589    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls podName:535222c0-a409-4022-99bc-dc2512cdfc07 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:14.433574947 +0000 UTC m=+43.204844992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls") pod "dns-default-pb44v" (UID: "535222c0-a409-4022-99bc-dc2512cdfc07") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:10.433745 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:10.433605    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls podName:c1ed4873-0915-4ad8-8a3d-9c935c19cbbe nodeName:}" failed. No retries permitted until 2026-07-29 08:48:14.433597785 +0000 UTC m=+43.204867826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls") pod "image-registry-6c458b65fd-ddlrg" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe") : secret "image-registry-tls" not found
Jul 29 08:48:10.452830 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:10.452804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:10.551581 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:10.551548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:10.837088 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:10.837016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:11.045733 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:11.045684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:14.466591 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:14.466548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:14.466995 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:14.466599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:14.466995 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:14.466690    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:14.466995 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:14.466701    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 08:48:14.466995 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:14.466738    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c458b65fd-ddlrg: secret "image-registry-tls" not found
Jul 29 08:48:14.466995 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:14.466773    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls podName:535222c0-a409-4022-99bc-dc2512cdfc07 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:22.466754798 +0000 UTC m=+51.238024846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls") pod "dns-default-pb44v" (UID: "535222c0-a409-4022-99bc-dc2512cdfc07") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:14.466995 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:14.466840    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls podName:c1ed4873-0915-4ad8-8a3d-9c935c19cbbe nodeName:}" failed. No retries permitted until 2026-07-29 08:48:22.466822335 +0000 UTC m=+51.238092382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls") pod "image-registry-6c458b65fd-ddlrg" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe") : secret "image-registry-tls" not found
Jul 29 08:48:22.524387 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:22.524358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:22.524857 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:22.524398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:22.524857 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:22.524487    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:22.524857 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:22.524492    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 08:48:22.524857 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:22.524507    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c458b65fd-ddlrg: secret "image-registry-tls" not found
Jul 29 08:48:22.524857 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:22.524539    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls podName:535222c0-a409-4022-99bc-dc2512cdfc07 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:38.524525309 +0000 UTC m=+67.295795352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls") pod "dns-default-pb44v" (UID: "535222c0-a409-4022-99bc-dc2512cdfc07") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:22.524857 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:22.524551    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls podName:c1ed4873-0915-4ad8-8a3d-9c935c19cbbe nodeName:}" failed. No retries permitted until 2026-07-29 08:48:38.524545548 +0000 UTC m=+67.295815589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls") pod "image-registry-6c458b65fd-ddlrg" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe") : secret "image-registry-tls" not found
Jul 29 08:48:22.727414 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:22.727380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:24.198003 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:24.197965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:29.613945 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:29.613913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:29.676066 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:29.676028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:29.777260 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:29.777230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:29.878241 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:29.878208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:30.643986 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:30.643952    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:30.866732 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:30.866693    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:31.922073 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:31.922047    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5n6lx"
Jul 29 08:48:31.948872 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:31.948829    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vjrw8" podStartSLOduration=30.753780216 podStartE2EDuration="59.94881271s" totalImagesPullingTime="29.195032494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:10.028310693 +0000 UTC m=+38.799580741" watchObservedRunningTime="2026-07-29 08:48:31.94881271 +0000 UTC m=+60.720082774"
Jul 29 08:48:32.085367 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:32.085330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:32.185243 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:32.185159    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:32.538901 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:32.538826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:37.423730 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.423667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:37.424178 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.423755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:37.424178 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.423777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:48:37.426219 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.426197    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 08:48:37.426419 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.426402    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 08:48:37.426492 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.426440    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 08:48:37.434109 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:37.434086    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 08:48:37.434193 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:37.434167    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs podName:e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:41.43414484 +0000 UTC m=+130.205414904 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs") pod "network-metrics-daemon-6t59m" (UID: "e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8") : secret "metrics-daemon-secret" not found
Jul 29 08:48:37.436071 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.436055    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 08:48:37.437809 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.437788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43-original-pull-secret\") pod \"global-pull-secret-syncer-cj752\" (UID: \"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43\") " pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:37.446836 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.446811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xck4p\" (UniqueName: \"kubernetes.io/projected/2da5d93a-aaa5-4289-91a3-fe09bae3ec7d-kube-api-access-xck4p\") pod \"network-check-target-966d4\" (UID: \"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d\") " pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:37.467523 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.467501    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cj752"
Jul 29 08:48:37.482286 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.482270    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hkhb\""
Jul 29 08:48:37.490844 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.490826    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:37.614508 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.614476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cj752"]
Jul 29 08:48:37.617402 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:48:37.617369    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a62fa0_75b7_4ca9_b3fe_0d05bf1e8a43.slice/crio-1eaebc2c8751e9584ab74a65061f36fc4916ee8235b4b4335fe1c4083138e074 WatchSource:0}: Error finding container 1eaebc2c8751e9584ab74a65061f36fc4916ee8235b4b4335fe1c4083138e074: Status 404 returned error can't find the container with id 1eaebc2c8751e9584ab74a65061f36fc4916ee8235b4b4335fe1c4083138e074
Jul 29 08:48:37.629310 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:37.629282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-966d4"]
Jul 29 08:48:37.634654 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:48:37.634610    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da5d93a_aaa5_4289_91a3_fe09bae3ec7d.slice/crio-ebc2ab8f3a28587c726e702ff98d6a8c18489e536a165314877a2282658ae60c WatchSource:0}: Error finding container ebc2ab8f3a28587c726e702ff98d6a8c18489e536a165314877a2282658ae60c: Status 404 returned error can't find the container with id ebc2ab8f3a28587c726e702ff98d6a8c18489e536a165314877a2282658ae60c
Jul 29 08:48:38.000176 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:38.000145    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cj752" event={"ID":"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43","Type":"ContainerStarted","Data":"1eaebc2c8751e9584ab74a65061f36fc4916ee8235b4b4335fe1c4083138e074"}
Jul 29 08:48:38.001295 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:38.001269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-966d4" event={"ID":"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d","Type":"ContainerStarted","Data":"ebc2ab8f3a28587c726e702ff98d6a8c18489e536a165314877a2282658ae60c"}
Jul 29 08:48:38.534223 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:38.534182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:48:38.534223 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:38.534227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:48:38.534810 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:38.534353    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 08:48:38.534810 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:38.534359    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 08:48:38.534810 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:38.534385    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c458b65fd-ddlrg: secret "image-registry-tls" not found
Jul 29 08:48:38.534810 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:38.534418    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls podName:535222c0-a409-4022-99bc-dc2512cdfc07 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:10.534400328 +0000 UTC m=+99.305670380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls") pod "dns-default-pb44v" (UID: "535222c0-a409-4022-99bc-dc2512cdfc07") : secret "dns-default-metrics-tls" not found
Jul 29 08:48:38.534810 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:38.534441    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls podName:c1ed4873-0915-4ad8-8a3d-9c935c19cbbe nodeName:}" failed. No retries permitted until 2026-07-29 08:49:10.534424308 +0000 UTC m=+99.305694364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls") pod "image-registry-6c458b65fd-ddlrg" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe") : secret "image-registry-tls" not found
Jul 29 08:48:43.017067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:43.017025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cj752" event={"ID":"e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43","Type":"ContainerStarted","Data":"6daa8ffce56b7b4b107d61d0d73fb380fc219347ce429057622974018143f7c7"}
Jul 29 08:48:43.018379 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:43.018354    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-966d4" event={"ID":"2da5d93a-aaa5-4289-91a3-fe09bae3ec7d","Type":"ContainerStarted","Data":"8b3a6eb5562da0fd0382271329f0a915a9b6efc0535d64412dc853144412d67a"}
Jul 29 08:48:43.018498 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:43.018481    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:48:43.032306 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:43.032265    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cj752" podStartSLOduration=66.365115848 podStartE2EDuration="1m11.032228911s" totalImagesPullingTime="4.667113063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:43.031523803 +0000 UTC m=+71.802793870" watchObservedRunningTime="2026-07-29 08:48:43.032228911 +0000 UTC m=+71.803498974"
Jul 29 08:48:44.064098 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:44.064061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:44.122727 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:44.122678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:45.698301 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:45.698263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:45.764551 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:45.764523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:46.478261 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:46.478229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:46.570237 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:46.570206    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:46.852546 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:46.852471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:46.953565 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:46.953538    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:50.013366 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.013314    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-966d4" podStartSLOduration=74.367265158 podStartE2EDuration="1m19.013297051s" totalImagesPullingTime="4.646031893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:47:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:43.045474122 +0000 UTC m=+71.816744201" watchObservedRunningTime="2026-07-29 08:48:50.013297051 +0000 UTC m=+78.784567116"
Jul 29 08:48:50.013785 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.013430    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"]
Jul 29 08:48:50.015516 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.015500    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.017552 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.017532    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 08:48:50.017661 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.017549    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 08:48:50.017730 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.017689    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 08:48:50.018184 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.018170    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:48:50.018234 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.018176    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-s2hlp\""
Jul 29 08:48:50.027900 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.027880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"]
Jul 29 08:48:50.112326 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.112295    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg"]
Jul 29 08:48:50.113672 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.113650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04cb4ce0-cf14-419e-b296-088f0d42ab0a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.113808 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.113684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04cb4ce0-cf14-419e-b296-088f0d42ab0a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.113808 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.113733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbdmm\" (UniqueName: \"kubernetes.io/projected/04cb4ce0-cf14-419e-b296-088f0d42ab0a-kube-api-access-kbdmm\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.114257 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.114243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg"
Jul 29 08:48:50.116438 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.116415    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"]
Jul 29 08:48:50.116539 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.116498    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-28nw7\""
Jul 29 08:48:50.118069 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.118050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.120682 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.120655    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 08:48:50.120682 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.120673    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 08:48:50.120903 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.120686    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q5hp7\""
Jul 29 08:48:50.120903 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.120703    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 08:48:50.120903 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.120664    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 08:48:50.129250 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.129229    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg"]
Jul 29 08:48:50.132370 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.132339    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"]
Jul 29 08:48:50.214159 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.214127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55xn2\" (UniqueName: \"kubernetes.io/projected/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-kube-api-access-55xn2\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.214326 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.214166    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04cb4ce0-cf14-419e-b296-088f0d42ab0a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.214326 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.214188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04cb4ce0-cf14-419e-b296-088f0d42ab0a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.214326 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.214207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv8zg\" (UniqueName: \"kubernetes.io/projected/49fba6fd-1603-4390-a6a9-ef629ed4f40a-kube-api-access-hv8zg\") pod \"network-check-source-7d88cb55d8-5tlqg\" (UID: \"49fba6fd-1603-4390-a6a9-ef629ed4f40a\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg"
Jul 29 08:48:50.214326 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.214231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdmm\" (UniqueName: \"kubernetes.io/projected/04cb4ce0-cf14-419e-b296-088f0d42ab0a-kube-api-access-kbdmm\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.214326 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.214259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.214546 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.214427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.214811 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.214792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04cb4ce0-cf14-419e-b296-088f0d42ab0a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.216525 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.216503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04cb4ce0-cf14-419e-b296-088f0d42ab0a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.229859 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.229830    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbdmm\" (UniqueName: \"kubernetes.io/projected/04cb4ce0-cf14-419e-b296-088f0d42ab0a-kube-api-access-kbdmm\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v\" (UID: \"04cb4ce0-cf14-419e-b296-088f0d42ab0a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.259898 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.259872    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:50.315707 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.315656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55xn2\" (UniqueName: \"kubernetes.io/projected/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-kube-api-access-55xn2\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.315707 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.315692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv8zg\" (UniqueName: \"kubernetes.io/projected/49fba6fd-1603-4390-a6a9-ef629ed4f40a-kube-api-access-hv8zg\") pod \"network-check-source-7d88cb55d8-5tlqg\" (UID: \"49fba6fd-1603-4390-a6a9-ef629ed4f40a\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg"
Jul 29 08:48:50.315987 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.315730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.315987 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.315768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.315987 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:50.315912    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:50.316102 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:50.315998    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls podName:c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:50.81597851 +0000 UTC m=+79.587248554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-cmpl2" (UID: "c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8") : secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:50.316343 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.316326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.323595 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.323567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv8zg\" (UniqueName: \"kubernetes.io/projected/49fba6fd-1603-4390-a6a9-ef629ed4f40a-kube-api-access-hv8zg\") pod \"network-check-source-7d88cb55d8-5tlqg\" (UID: \"49fba6fd-1603-4390-a6a9-ef629ed4f40a\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg"
Jul 29 08:48:50.323687 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.323656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55xn2\" (UniqueName: \"kubernetes.io/projected/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-kube-api-access-55xn2\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.323687 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.323667    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"
Jul 29 08:48:50.358965 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.358945    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:50.425066 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.425041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg"
Jul 29 08:48:50.440705 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.440681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v"]
Jul 29 08:48:50.443496 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:48:50.443462    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04cb4ce0_cf14_419e_b296_088f0d42ab0a.slice/crio-a4d4e544635f6e2fc366624b94ab7f4d47c92c1195c80fbd38243bc4c0596ac7 WatchSource:0}: Error finding container a4d4e544635f6e2fc366624b94ab7f4d47c92c1195c80fbd38243bc4c0596ac7: Status 404 returned error can't find the container with id a4d4e544635f6e2fc366624b94ab7f4d47c92c1195c80fbd38243bc4c0596ac7
Jul 29 08:48:50.541653 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.541626    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg"]
Jul 29 08:48:50.544286 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:48:50.544259    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49fba6fd_1603_4390_a6a9_ef629ed4f40a.slice/crio-c61b260755926b327b6ed053ff1d75aeb0aa3a31b4db635c8fc0320df7e7784c WatchSource:0}: Error finding container c61b260755926b327b6ed053ff1d75aeb0aa3a31b4db635c8fc0320df7e7784c: Status 404 returned error can't find the container with id c61b260755926b327b6ed053ff1d75aeb0aa3a31b4db635c8fc0320df7e7784c
Jul 29 08:48:50.820024 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:50.819989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:50.820197 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:50.820110    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:50.820197 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:50.820166    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls podName:c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:51.82015112 +0000 UTC m=+80.591421162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-cmpl2" (UID: "c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8") : secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:51.041501 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:51.041458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v" event={"ID":"04cb4ce0-cf14-419e-b296-088f0d42ab0a","Type":"ContainerStarted","Data":"a4d4e544635f6e2fc366624b94ab7f4d47c92c1195c80fbd38243bc4c0596ac7"}
Jul 29 08:48:51.043117 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:51.043081    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg" event={"ID":"49fba6fd-1603-4390-a6a9-ef629ed4f40a","Type":"ContainerStarted","Data":"ea73f9d4f5fe9691e69a91fab0c953ecadcc7c17d4bd05c02ea94c4165477780"}
Jul 29 08:48:51.043243 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:51.043128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg" event={"ID":"49fba6fd-1603-4390-a6a9-ef629ed4f40a","Type":"ContainerStarted","Data":"c61b260755926b327b6ed053ff1d75aeb0aa3a31b4db635c8fc0320df7e7784c"}
Jul 29 08:48:51.058761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:51.058695    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tlqg" podStartSLOduration=1.058681494 podStartE2EDuration="1.058681494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:51.057878555 +0000 UTC m=+79.829148620" watchObservedRunningTime="2026-07-29 08:48:51.058681494 +0000 UTC m=+79.829951536"
Jul 29 08:48:51.827351 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:51.827319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:51.827521 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:51.827444    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:51.827521 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:51.827513    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls podName:c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:53.827493533 +0000 UTC m=+82.598763575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-cmpl2" (UID: "c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8") : secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:53.050968 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:53.050932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v" event={"ID":"04cb4ce0-cf14-419e-b296-088f0d42ab0a","Type":"ContainerStarted","Data":"a2a7ebe994a3704a0f2aa7ffdfb0c6437b415c4e8d97919056d833c7df4a8fef"}
Jul 29 08:48:53.066024 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:53.065965    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v" podStartSLOduration=2.271985247 podStartE2EDuration="4.065946393s" totalImagesPullingTime="1.793961146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:53.06589979 +0000 UTC m=+81.837169857" watchObservedRunningTime="2026-07-29 08:48:53.065946393 +0000 UTC m=+81.837216458"
Jul 29 08:48:53.817462 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:53.817425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:53.846507 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:53.846477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:53.846606 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:53.846589    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:53.846647 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:53.846639    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls podName:c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:57.846625555 +0000 UTC m=+86.617895597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-cmpl2" (UID: "c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8") : secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:53.916807 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:53.916775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:54.417771 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:54.417640    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:54.481191 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:54.481161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:54.799408 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:54.799306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:54.855369 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:54.855337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:55.101354 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:55.101271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:55.198569 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:55.198522    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:56.137879 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.137842    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:56.184691 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.184658    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8mklw"]
Jul 29 08:48:56.187523 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.187507    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.189556 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.189532    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 08:48:56.189687 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.189561    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 08:48:56.189687 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.189566    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 08:48:56.190057 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.190043    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jw2tp\""
Jul 29 08:48:56.190099 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.190054    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 08:48:56.196844 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.196825    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8mklw"]
Jul 29 08:48:56.263455 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.263421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.263640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.263468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67f00192-0f63-4341-9316-083842b4b685-crio-socket\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.263640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.263504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67f00192-0f63-4341-9316-083842b4b685-data-volume\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.263640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.263533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4xw\" (UniqueName: \"kubernetes.io/projected/67f00192-0f63-4341-9316-083842b4b685-kube-api-access-px4xw\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.263640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.263556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.364769 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.364732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.364922 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.364790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67f00192-0f63-4341-9316-083842b4b685-crio-socket\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.364922 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.364818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67f00192-0f63-4341-9316-083842b4b685-data-volume\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.364922 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:56.364853    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:48:56.364922 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:56.364915    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:56.864900876 +0000 UTC m=+85.636170918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : configmap "kube-rbac-proxy" not found
Jul 29 08:48:56.365046 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.364929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67f00192-0f63-4341-9316-083842b4b685-crio-socket\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.365046 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.364858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4xw\" (UniqueName: \"kubernetes.io/projected/67f00192-0f63-4341-9316-083842b4b685-kube-api-access-px4xw\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.365046 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.364977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.365138 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:56.365101    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:56.365172 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:56.365155    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:56.865138194 +0000 UTC m=+85.636408239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:56.365253 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.365236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67f00192-0f63-4341-9316-083842b4b685-data-volume\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.372982 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.372952    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4xw\" (UniqueName: \"kubernetes.io/projected/67f00192-0f63-4341-9316-083842b4b685-kube-api-access-px4xw\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.452555 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.452480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:56.682915 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.682887    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-wtj55"]
Jul 29 08:48:56.684684 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.684669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.686680 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.686659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kptwm\""
Jul 29 08:48:56.686680 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.686671    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 29 08:48:56.686870 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.686744    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 29 08:48:56.686870 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.686745    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 29 08:48:56.687159 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.687142    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 29 08:48:56.693573 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.693555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-wtj55"]
Jul 29 08:48:56.726821 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.726752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:56.767368 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.767335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-signing-cabundle\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.767469 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.767381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-signing-key\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.767518 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.767499    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ks6x\" (UniqueName: \"kubernetes.io/projected/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-kube-api-access-2ks6x\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.786372 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.786342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:56.868394 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.868351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-signing-cabundle\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.868570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.868421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-signing-key\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.868570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.868517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ks6x\" (UniqueName: \"kubernetes.io/projected/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-kube-api-access-2ks6x\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.868570 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.868556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.868744 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.868588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:56.868744 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:56.868672    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:48:56.868854 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:56.868673    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:56.868854 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:56.868774    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:57.868752572 +0000 UTC m=+86.640022621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : configmap "kube-rbac-proxy" not found
Jul 29 08:48:56.868854 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:56.868846    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:57.868828936 +0000 UTC m=+86.640098983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:56.869069 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.869050    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-signing-cabundle\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.871039 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.871009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-signing-key\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.877406 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.877384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ks6x\" (UniqueName: \"kubernetes.io/projected/f3fb2ae3-9b09-47ec-a32c-f50616eebea2-kube-api-access-2ks6x\") pod \"service-ca-658d7b7c78-wtj55\" (UID: \"f3fb2ae3-9b09-47ec-a32c-f50616eebea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:56.993726 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:56.993634    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-wtj55"
Jul 29 08:48:57.116119 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:57.116086    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-wtj55"]
Jul 29 08:48:57.118866 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:48:57.118839    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fb2ae3_9b09_47ec_a32c_f50616eebea2.slice/crio-32d83da99839510bd8e9f8a5edfbefff0ec5075ae331714e23e4bf795ab5d560 WatchSource:0}: Error finding container 32d83da99839510bd8e9f8a5edfbefff0ec5075ae331714e23e4bf795ab5d560: Status 404 returned error can't find the container with id 32d83da99839510bd8e9f8a5edfbefff0ec5075ae331714e23e4bf795ab5d560
Jul 29 08:48:57.140297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:57.140273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:57.248287 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:57.248208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:57.635051 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:57.635015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:48:57.876397 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:57.876344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:57.876585 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:57.876406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:57.876585 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:57.876476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:48:57.876585 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:57.876522    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:57.876585 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:57.876554    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:48:57.876585 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:57.876586    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:57.876837 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:57.876596    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:59.876576385 +0000 UTC m=+88.647846436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:57.876837 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:57.876616    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:48:59.876606839 +0000 UTC m=+88.647876881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : configmap "kube-rbac-proxy" not found
Jul 29 08:48:57.876837 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:57.876631    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls podName:c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:05.876622953 +0000 UTC m=+94.647892994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-cmpl2" (UID: "c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8") : secret "cluster-monitoring-operator-tls" not found
Jul 29 08:48:58.066806 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:58.066705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-wtj55" event={"ID":"f3fb2ae3-9b09-47ec-a32c-f50616eebea2","Type":"ContainerStarted","Data":"32d83da99839510bd8e9f8a5edfbefff0ec5075ae331714e23e4bf795ab5d560"}
Jul 29 08:48:59.071513 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:59.071422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-wtj55" event={"ID":"f3fb2ae3-9b09-47ec-a32c-f50616eebea2","Type":"ContainerStarted","Data":"e923bedec2055164d001e135717c56d1642406e4f9906db1224b5b2d26f3e63f"}
Jul 29 08:48:59.089281 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:59.089231    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-wtj55" podStartSLOduration=1.390744346 podStartE2EDuration="3.08921723s" totalImagesPullingTime="1.698472884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:48:59.08845535 +0000 UTC m=+87.859725415" watchObservedRunningTime="2026-07-29 08:48:59.08921723 +0000 UTC m=+87.860487293"
Jul 29 08:48:59.150038 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:59.150010    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8f5l_1fb8c2ee-ea91-4d57-b2dc-9653bb23c901/dns-node-resolver/0.log"
Jul 29 08:48:59.891834 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:59.891793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:59.892019 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:59.891915    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:48:59.892019 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:48:59.891940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:48:59.892019 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:59.891980    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:03.891962395 +0000 UTC m=+92.663232451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : configmap "kube-rbac-proxy" not found
Jul 29 08:48:59.892123 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:59.892049    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:48:59.892123 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:48:59.892095    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:03.892082828 +0000 UTC m=+92.663352873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:49:00.151880 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:00.151811    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rt4j6_b6185707-adc6-43fa-8a8b-a95116106b5a/node-ca/0.log"
Jul 29 08:49:00.511652 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:00.511565    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:00.751710 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:00.751660    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5hmg8_902e3875-27f9-4c3e-8e9c-937846e72c03/serve-healthcheck-canary/0.log"
Jul 29 08:49:00.798751 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:00.798648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:00.978207 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:00.978175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:01.103798 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:01.103686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:01.309332 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:01.309297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:01.410037 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:01.409864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:01.550562 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:01.550532    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v_04cb4ce0-cf14-419e-b296-088f0d42ab0a/kube-storage-version-migrator-operator/0.log"
Jul 29 08:49:01.578099 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:01.578064    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:01.673826 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:01.673737    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:02.246499 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:02.246462    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:03.007496 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:03.007461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:03.217555 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:03.217523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:03.613007 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:03.612977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:03.822342 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:03.822306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:03.926796 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:03.926761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:49:03.926796 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:03.926798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:49:03.927005 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:49:03.926878    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 08:49:03.927005 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:49:03.926908    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 08:49:03.927005 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:49:03.926928    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:11.926914751 +0000 UTC m=+100.698184793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : configmap "kube-rbac-proxy" not found
Jul 29 08:49:03.927005 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:49:03.926955    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls podName:67f00192-0f63-4341-9316-083842b4b685 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:11.926942208 +0000 UTC m=+100.698212251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mklw" (UID: "67f00192-0f63-4341-9316-083842b4b685") : secret "insights-runtime-extractor-tls" not found
Jul 29 08:49:04.199380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:04.199302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:04.257789 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:04.257763    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:04.518457 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:04.518373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:05.006419 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:05.006386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:05.385765 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:05.385733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:05.444693 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:05.444661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:05.599247 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:05.599219    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:05.943602 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:05.943569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:49:05.943791 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:49:05.943707    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 08:49:05.943791 ip-10-0-131-230 kubenswrapper[2564]: E0729 08:49:05.943783    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls podName:c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8 nodeName:}" failed. No retries permitted until 2026-07-29 08:49:21.943767953 +0000 UTC m=+110.715037999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-cmpl2" (UID: "c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8") : secret "cluster-monitoring-operator-tls" not found
Jul 29 08:49:06.723427 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:06.723395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:06.825224 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:06.825193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:06.925501 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:06.925467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:07.026939 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:07.026859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:07.203669 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:07.203625    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:07.400420 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:07.400383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:07.606066 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:07.606017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:08.050442 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:08.050409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:08.126138 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:08.126103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:08.405750 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:08.405704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:08.938674 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:08.938644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:09.047975 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:09.047939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:09.207643 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:09.207551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:09.598913 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:09.598835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:09.803314 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:09.803288    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:10.015966 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.015923    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:10.582906 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.582873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:49:10.583297 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.583001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:49:10.585361 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.585336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/535222c0-a409-4022-99bc-dc2512cdfc07-metrics-tls\") pod \"dns-default-pb44v\" (UID: \"535222c0-a409-4022-99bc-dc2512cdfc07\") " pod="openshift-dns/dns-default-pb44v"
Jul 29 08:49:10.585525 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.585503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"image-registry-6c458b65fd-ddlrg\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") " pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:49:10.605777 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.605755    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-68zl6\""
Jul 29 08:49:10.614614 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.614596    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pb44v"
Jul 29 08:49:10.735345 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.735316    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pb44v"]
Jul 29 08:49:10.738373 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:49:10.738344    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535222c0_a409_4022_99bc_dc2512cdfc07.slice/crio-1a16744068e0e7428ea6eeba6ec11dab648b6d7b183f6e132bf3b67f04a9988a WatchSource:0}: Error finding container 1a16744068e0e7428ea6eeba6ec11dab648b6d7b183f6e132bf3b67f04a9988a: Status 404 returned error can't find the container with id 1a16744068e0e7428ea6eeba6ec11dab648b6d7b183f6e132bf3b67f04a9988a
Jul 29 08:49:10.796675 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.796649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:10.849307 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.849262    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t2qgg\""
Jul 29 08:49:10.857792 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.857775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:49:10.979184 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:10.979123    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c458b65fd-ddlrg"]
Jul 29 08:49:10.981569 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:49:10.981543    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ed4873_0915_4ad8_8a3d_9c935c19cbbe.slice/crio-dadd99a494670ed7ad2af6eb7414cf3f07bae8d079a0592c133d21d617940864 WatchSource:0}: Error finding container dadd99a494670ed7ad2af6eb7414cf3f07bae8d079a0592c133d21d617940864: Status 404 returned error can't find the container with id dadd99a494670ed7ad2af6eb7414cf3f07bae8d079a0592c133d21d617940864
Jul 29 08:49:11.006730 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.006698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:11.109994 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.109909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg" event={"ID":"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe","Type":"ContainerStarted","Data":"5e78d6fe209ea7e66c748cb387ad3f099de0f60fe9cabc9210f780119699f7ac"}
Jul 29 08:49:11.109994 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.109960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg" event={"ID":"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe","Type":"ContainerStarted","Data":"dadd99a494670ed7ad2af6eb7414cf3f07bae8d079a0592c133d21d617940864"}
Jul 29 08:49:11.110195 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.110008    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:49:11.111173 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.111147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pb44v" event={"ID":"535222c0-a409-4022-99bc-dc2512cdfc07","Type":"ContainerStarted","Data":"1a16744068e0e7428ea6eeba6ec11dab648b6d7b183f6e132bf3b67f04a9988a"}
Jul 29 08:49:11.129870 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.129823    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg" podStartSLOduration=99.129811056 podStartE2EDuration="1m39.129811056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:47:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:11.129374312 +0000 UTC m=+99.900644393" watchObservedRunningTime="2026-07-29 08:49:11.129811056 +0000 UTC m=+99.901081100"
Jul 29 08:49:11.197189 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.197162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:11.993904 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.993867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:49:11.994353 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.993914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:49:11.994505 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.994481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67f00192-0f63-4341-9316-083842b4b685-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:49:11.996430 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:11.996398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67f00192-0f63-4341-9316-083842b4b685-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mklw\" (UID: \"67f00192-0f63-4341-9316-083842b4b685\") " pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:49:12.096537 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:12.096497    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8mklw"
Jul 29 08:49:12.503666 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:12.503635    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8mklw"]
Jul 29 08:49:12.506452 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:49:12.506423    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f00192_0f63_4341_9316_083842b4b685.slice/crio-90480c33c3863bfaf1e8ba46684c9ea05b0ed253237facba55bad0b230584726 WatchSource:0}: Error finding container 90480c33c3863bfaf1e8ba46684c9ea05b0ed253237facba55bad0b230584726: Status 404 returned error can't find the container with id 90480c33c3863bfaf1e8ba46684c9ea05b0ed253237facba55bad0b230584726
Jul 29 08:49:13.126228 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:13.125654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pb44v" event={"ID":"535222c0-a409-4022-99bc-dc2512cdfc07","Type":"ContainerStarted","Data":"2784bec3720a77bc0cd3e9238a9023c611735649bce2f1ae7786a619452f1662"}
Jul 29 08:49:13.126228 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:13.125745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pb44v" event={"ID":"535222c0-a409-4022-99bc-dc2512cdfc07","Type":"ContainerStarted","Data":"5f9bf389e500d7e88a8a18474daeaa18785a91bd3c6eade01da8fc821634e479"}
Jul 29 08:49:13.126228 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:13.125943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pb44v"
Jul 29 08:49:13.127594 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:13.127518    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mklw" event={"ID":"67f00192-0f63-4341-9316-083842b4b685","Type":"ContainerStarted","Data":"90480c33c3863bfaf1e8ba46684c9ea05b0ed253237facba55bad0b230584726"}
Jul 29 08:49:13.144748 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:13.143613    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pb44v" podStartSLOduration=65.141998227 podStartE2EDuration="1m7.143593494s" totalImagesPullingTime="2.001595267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:13.142634313 +0000 UTC m=+101.913904379" watchObservedRunningTime="2026-07-29 08:49:13.143593494 +0000 UTC m=+101.914863558"
Jul 29 08:49:14.023582 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:14.023540    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-966d4"
Jul 29 08:49:17.911996 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.911865    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"]
Jul 29 08:49:17.914687 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.914657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:17.922623 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.922594    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 29 08:49:17.925425 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.925398    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 08:49:17.925527 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.925462    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 29 08:49:17.925601 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.925535    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 29 08:49:17.925692 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.925670    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 08:49:17.925809 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.925742    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 08:49:17.925809 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.925763    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 29 08:49:17.942397 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:17.942370    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"]
Jul 29 08:49:18.043626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.043590    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.043844 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.043650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-ca\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.043844 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.043730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.043844 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.043760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgdt8\" (UniqueName: \"kubernetes.io/projected/b228690f-8777-40e0-a515-cd8743dc90cd-kube-api-access-sgdt8\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.043844 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.043800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b228690f-8777-40e0-a515-cd8743dc90cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.043844 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.043830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-hub\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.138462 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.138425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:18.144241 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.144210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-hub\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.144379 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.144255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.144379 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.144300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-ca\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.144501 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.144393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.144501 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.144428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgdt8\" (UniqueName: \"kubernetes.io/projected/b228690f-8777-40e0-a515-cd8743dc90cd-kube-api-access-sgdt8\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.144501 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.144458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b228690f-8777-40e0-a515-cd8743dc90cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.145405 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.145197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b228690f-8777-40e0-a515-cd8743dc90cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.147663 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.147641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-hub\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.147663 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.147653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.148461 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.148406    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-ca\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.150230 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.150099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b228690f-8777-40e0-a515-cd8743dc90cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.151135 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.151107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mklw" event={"ID":"67f00192-0f63-4341-9316-083842b4b685","Type":"ContainerStarted","Data":"688f581c3ddd31dd492db9ac9bfa20a0728d2d1705dbdcb215bc7078cf87cb60"}
Jul 29 08:49:18.161332 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.161301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgdt8\" (UniqueName: \"kubernetes.io/projected/b228690f-8777-40e0-a515-cd8743dc90cd-kube-api-access-sgdt8\") pod \"cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc\" (UID: \"b228690f-8777-40e0-a515-cd8743dc90cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.237327 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.237229    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"
Jul 29 08:49:18.263814 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.263746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:18.418416 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.418059    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc"]
Jul 29 08:49:18.420824 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:49:18.420790    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb228690f_8777_40e0_a515_cd8743dc90cd.slice/crio-9624a856685823eb84d9185a556732a4959717cae35bb73f3b36e5636ea41a64 WatchSource:0}: Error finding container 9624a856685823eb84d9185a556732a4959717cae35bb73f3b36e5636ea41a64: Status 404 returned error can't find the container with id 9624a856685823eb84d9185a556732a4959717cae35bb73f3b36e5636ea41a64
Jul 29 08:49:18.456310 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.456277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:18.553132 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.553061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:18.653309 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:18.653267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:19.050327 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:19.050286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:19.155770 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:19.155736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc" event={"ID":"b228690f-8777-40e0-a515-cd8743dc90cd","Type":"ContainerStarted","Data":"9624a856685823eb84d9185a556732a4959717cae35bb73f3b36e5636ea41a64"}
Jul 29 08:49:19.474621 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:19.474583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:19.668987 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:19.668949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:19.932385 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:19.932347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:20.056057 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:20.056028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:20.169567 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:20.169530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:20.795958 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:20.795923    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:20.896477 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:20.896444    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:21.166415 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:21.166379    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mklw" event={"ID":"67f00192-0f63-4341-9316-083842b4b685","Type":"ContainerStarted","Data":"332b82ba0c3f016c38eeb035ef0bfd969ca4a5ac3d0a9c1a97b5e6e77b90f498"}
Jul 29 08:49:21.973458 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:21.973394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:49:21.976395 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:21.976367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-cmpl2\" (UID: \"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:49:22.233942 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:22.233856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"
Jul 29 08:49:23.134363 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:23.134335    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pb44v"
Jul 29 08:49:24.869990 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:24.869960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:24.953985 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:24.953949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:25.495111 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:25.495089    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2"]
Jul 29 08:49:25.498209 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:49:25.498161    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17aa2ca_4f62_4eb2_bdc6_52d61af9b6f8.slice/crio-c424b213fc5c2182d50d9719f6cfe40fc6a8dd1fc6d3f68ace07d67096db5734 WatchSource:0}: Error finding container c424b213fc5c2182d50d9719f6cfe40fc6a8dd1fc6d3f68ace07d67096db5734: Status 404 returned error can't find the container with id c424b213fc5c2182d50d9719f6cfe40fc6a8dd1fc6d3f68ace07d67096db5734
Jul 29 08:49:26.187710 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.187672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mklw" event={"ID":"67f00192-0f63-4341-9316-083842b4b685","Type":"ContainerStarted","Data":"2b07db16aafc5f9c13facb2ec931a7eafe9aabc9fd01a7cda5b29220ec428a06"}
Jul 29 08:49:26.189642 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.189616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc" event={"ID":"b228690f-8777-40e0-a515-cd8743dc90cd","Type":"ContainerStarted","Data":"15cac79c5b311422bcfcaff754c2573428aae691c4a80eb39dac77cc4bba0364"}
Jul 29 08:49:26.189775 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.189656    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc" event={"ID":"b228690f-8777-40e0-a515-cd8743dc90cd","Type":"ContainerStarted","Data":"44f131118a929922977805ba3a0228948f87faefa169195c4a873cc9c7a513cf"}
Jul 29 08:49:26.189775 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.189674    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc" event={"ID":"b228690f-8777-40e0-a515-cd8743dc90cd","Type":"ContainerStarted","Data":"95d0b4a143faddc23fd7610452846848634f036c230407abd750d077d2f5cbf3"}
Jul 29 08:49:26.190619 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.190601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2" event={"ID":"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8","Type":"ContainerStarted","Data":"c424b213fc5c2182d50d9719f6cfe40fc6a8dd1fc6d3f68ace07d67096db5734"}
Jul 29 08:49:26.206529 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.206485    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8mklw" podStartSLOduration=17.450016366 podStartE2EDuration="30.206472657s" totalImagesPullingTime="12.756456291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 08:48:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:26.20561712 +0000 UTC m=+114.976887186" watchObservedRunningTime="2026-07-29 08:49:26.206472657 +0000 UTC m=+114.977742699"
Jul 29 08:49:26.226953 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.226869    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bbf8fb5cb-8dcnc" podStartSLOduration=2.278711259 podStartE2EDuration="9.226857857s" totalImagesPullingTime="6.948146598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:26.226578019 +0000 UTC m=+114.997848084" watchObservedRunningTime="2026-07-29 08:49:26.226857857 +0000 UTC m=+114.998127920"
Jul 29 08:49:26.824808 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.824777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:26.888108 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.888074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:26.953108 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:26.953074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:27.664948 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:27.664915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:27.791782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:27.791708    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:27.866883 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:27.866847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:28.025469 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:28.025385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:28.198508 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:28.198476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2" event={"ID":"c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8","Type":"ContainerStarted","Data":"767cee47a0816d2b4674175363e1b810ae3bb5cf65dc8dfcf6ec327fe040027d"}
Jul 29 08:49:28.222087 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:28.222046    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-cmpl2" podStartSLOduration=36.401368957 podStartE2EDuration="38.222032824s" totalImagesPullingTime="1.820663867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:28.221905861 +0000 UTC m=+116.993175925" watchObservedRunningTime="2026-07-29 08:49:28.222032824 +0000 UTC m=+116.993302888"
Jul 29 08:49:30.862850 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:30.862814    2564 patch_prober.go:28] interesting pod/image-registry-6c458b65fd-ddlrg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 08:49:30.863250 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:30.862869    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg" podUID="c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 08:49:30.908453 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:30.908417    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:30.985840 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:30.985803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:31.044815 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:31.044781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:31.982327 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:31.982298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:32.065218 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:32.065184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:32.119459 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:32.119433    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:49:32.282253 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:32.282172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:32.347029 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:32.346997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:32.410561 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:32.410526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:35.893980 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:35.893951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:35.996233 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:35.996204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:38.095846 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:38.095812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:38.203827 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:38.203794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:39.533880 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:39.533849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:39.635508 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:39.635483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:39.734396 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:39.734367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:40.180497 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:40.180459    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c458b65fd-ddlrg"]
Jul 29 08:49:40.341247 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:40.341213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:40.441027 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:40.440948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:41.188048 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.188013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:41.280599 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.280571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:41.527312 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.527224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:49:41.529493 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.529472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8-metrics-certs\") pod \"network-metrics-daemon-6t59m\" (UID: \"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8\") " pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:49:41.677542 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.677514    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dmmnd\""
Jul 29 08:49:41.685418 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.685397    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6t59m"
Jul 29 08:49:41.690496 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.690474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:41.797815 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.797749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:41.846744 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:41.845348    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6t59m"]
Jul 29 08:49:42.242969 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:42.242934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6t59m" event={"ID":"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8","Type":"ContainerStarted","Data":"994224b04e98c2880342221978fa9634bab553c80135ef03b375844ad985f007"}
Jul 29 08:49:43.247679 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:43.247643    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6t59m" event={"ID":"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8","Type":"ContainerStarted","Data":"1402ee958aa658881c7bd189f649675ac51f33b94db302538d668a14eb9f26a2"}
Jul 29 08:49:43.248173 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:43.247703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6t59m" event={"ID":"e3f19847-1fb9-4fc3-9e0a-8b22d54cafa8","Type":"ContainerStarted","Data":"8089b1c67a0cf9ab7f4efb445af37b16acb68397f68baabab9757e3ca228caf1"}
Jul 29 08:49:43.272492 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:43.272429    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6t59m" podStartSLOduration=131.362674151 podStartE2EDuration="2m12.272411768s" totalImagesPullingTime="909.737617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:47:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:43.271872775 +0000 UTC m=+132.043142859" watchObservedRunningTime="2026-07-29 08:49:43.272411768 +0000 UTC m=+132.043681831"
Jul 29 08:49:43.394582 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:43.394552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:43.496752 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:43.496697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:43.598090 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:43.598006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:44.539853 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:44.539822    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:45.913023 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:45.912991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:46.034484 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.034452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:46.142453 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.142421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:46.347302 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.347192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:46.461934 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.461894    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-grh47"]
Jul 29 08:49:46.466194 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.466169    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.469367 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.469319    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 08:49:46.469494 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.469319    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 08:49:46.470780 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.470760    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 08:49:46.471782 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.471763    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 08:49:46.471905 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.471889    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b8lr8\""
Jul 29 08:49:46.549766 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.549732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:46.562790 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.562767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-tls\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.562922 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.562797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-sys\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.562922 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.562844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-wtmp\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.562922 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.562877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-root\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.562922 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.562891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-textfile\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.562922 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.562914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.563102 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.563004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cndcv\" (UniqueName: \"kubernetes.io/projected/26b979b7-97cf-4079-a233-2d13a2205ad4-kube-api-access-cndcv\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.563102 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.563026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.563102 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.563045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26b979b7-97cf-4079-a233-2d13a2205ad4-metrics-client-ca\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.652277 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.652247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:46.663340 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-wtmp\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663437 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-root\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663437 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-textfile\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663437 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663571 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-root\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663571 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-wtmp\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663571 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cndcv\" (UniqueName: \"kubernetes.io/projected/26b979b7-97cf-4079-a233-2d13a2205ad4-kube-api-access-cndcv\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663571 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663571 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26b979b7-97cf-4079-a233-2d13a2205ad4-metrics-client-ca\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663571 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-tls\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663866 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-sys\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663866 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b979b7-97cf-4079-a233-2d13a2205ad4-sys\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.663866 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.663787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-textfile\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.664059 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.664036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-accelerators-collector-config\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.664106 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.664094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26b979b7-97cf-4079-a233-2d13a2205ad4-metrics-client-ca\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.665959 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.665938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-tls\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.666042 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.665990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26b979b7-97cf-4079-a233-2d13a2205ad4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.673131 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.673103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cndcv\" (UniqueName: \"kubernetes.io/projected/26b979b7-97cf-4079-a233-2d13a2205ad4-kube-api-access-cndcv\") pod \"node-exporter-grh47\" (UID: \"26b979b7-97cf-4079-a233-2d13a2205ad4\") " pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.754298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.754271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:46.778624 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.778601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-grh47"
Jul 29 08:49:46.790190 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:49:46.790162    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b979b7_97cf_4079_a233_2d13a2205ad4.slice/crio-d4286271beda5b8b4d4876fedce28d60a9b0cbd590cdb9035fe777a246181dae WatchSource:0}: Error finding container d4286271beda5b8b4d4876fedce28d60a9b0cbd590cdb9035fe777a246181dae: Status 404 returned error can't find the container with id d4286271beda5b8b4d4876fedce28d60a9b0cbd590cdb9035fe777a246181dae
Jul 29 08:49:46.846775 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.846741    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:46.951888 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:46.951787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:47.264074 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:47.264000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grh47" event={"ID":"26b979b7-97cf-4079-a233-2d13a2205ad4","Type":"ContainerStarted","Data":"d4286271beda5b8b4d4876fedce28d60a9b0cbd590cdb9035fe777a246181dae"}
Jul 29 08:49:47.271492 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:47.271465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:47.383746 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:47.383693    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:47.477991 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:47.477963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:47.586131 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:47.586048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:48.000856 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:48.000821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:48.269163 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:48.269096    2564 generic.go:356] "Generic (PLEG): container finished" podID="26b979b7-97cf-4079-a233-2d13a2205ad4" containerID="9fb56d4ec9710987f4112adb2049094ae3eb60badd1ee46ec0e04cb6826754a1" exitCode=0
Jul 29 08:49:48.269163 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:48.269146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grh47" event={"ID":"26b979b7-97cf-4079-a233-2d13a2205ad4","Type":"ContainerDied","Data":"9fb56d4ec9710987f4112adb2049094ae3eb60badd1ee46ec0e04cb6826754a1"}
Jul 29 08:49:49.274626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:49.274593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grh47" event={"ID":"26b979b7-97cf-4079-a233-2d13a2205ad4","Type":"ContainerStarted","Data":"f0c7ec0af0584058f2dae93190a0ad33a748d9e7772cd9d17948ff76653acde0"}
Jul 29 08:49:49.275048 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:49.274644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grh47" event={"ID":"26b979b7-97cf-4079-a233-2d13a2205ad4","Type":"ContainerStarted","Data":"b00b8b3bc19af7fd72821c38970b412f12032fa1b411a956c90b531b2324cfb2"}
Jul 29 08:49:49.467764 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:49.467727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:49.567871 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:49.567792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:49.682285 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:49.682253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:49.856960 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:49.856885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:50.522692 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:50.522663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:50.620535 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:50.620505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:51.102670 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:51.102635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:51.186406 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:51.186377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:51.540003 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:51.539970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:51.647178 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:51.647147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:51.939748 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:51.939680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:52.840943 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.840909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:52.848375 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.848331    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-grh47" podStartSLOduration=5.518604015 podStartE2EDuration="6.8483151s" totalImagesPullingTime="1.270385623s" totalInitContainerRuntime="59.325462ms" isStatefulPod=true podCreationTimestamp="2026-07-29 08:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:49:49.338933051 +0000 UTC m=+138.110203114" watchObservedRunningTime="2026-07-29 08:49:52.8483151 +0000 UTC m=+141.619585164"
Jul 29 08:49:52.848563 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.848548    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 08:49:52.855538 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.855520    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.860181 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.860140    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 08:49:52.860298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.860227    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 08:49:52.860298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.860263    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 08:49:52.860915 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.860891    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 08:49:52.861125 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.861107    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 08:49:52.861202 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.861139    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 08:49:52.861365 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.861351    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 08:49:52.861703 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.861684    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 08:49:52.861803 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.861740    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 08:49:52.861803 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.861783    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 08:49:52.861907 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.861807    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qd4wn\""
Jul 29 08:49:52.861907 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.861743    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bnt6gmgq8dui3\""
Jul 29 08:49:52.862410 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.862108    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 08:49:52.863274 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.863256    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 08:49:52.863365 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.863334    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 08:49:52.865426 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.865407    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 08:49:52.867524 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.867507    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 08:49:52.881772 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.881749    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 08:49:52.910589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fdc7545-53dc-4a42-b222-be862a67cef0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.910589 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.910877 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-config\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.910877 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.910877 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b66q5\" (UniqueName: \"kubernetes.io/projected/6fdc7545-53dc-4a42-b222-be862a67cef0-kube-api-access-b66q5\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.910877 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.910877 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910784    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.910877 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.910877 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.910998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fdc7545-53dc-4a42-b222-be862a67cef0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.911021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.911062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.911110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.911137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.911163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911213 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.911204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:52.911538 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:52.911234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012276 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012276 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012524 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012524 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012639 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012639 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fdc7545-53dc-4a42-b222-be862a67cef0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012639 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012825 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012825 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012825 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012825 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012825 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.012825 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013121 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013121 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fdc7545-53dc-4a42-b222-be862a67cef0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013121 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013121 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-config\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013121 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.012982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013121 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.013006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b66q5\" (UniqueName: \"kubernetes.io/projected/6fdc7545-53dc-4a42-b222-be862a67cef0-kube-api-access-b66q5\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013121 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.013035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013121 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.013074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013497 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.013414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.013659 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.013631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.014285 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.014257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.014436 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.014414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.015472 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.015446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.015749 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.015610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.016792 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.015888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fdc7545-53dc-4a42-b222-be862a67cef0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.016792 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.016184    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.017005 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.016985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.017113 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.016985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fdc7545-53dc-4a42-b222-be862a67cef0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.017413 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.017385    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.017680 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.017647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.018332 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.018297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.018332 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.018321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.018444 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.018334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-config\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.018907 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.018886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.018958 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.018897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fdc7545-53dc-4a42-b222-be862a67cef0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.019204 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.019189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fdc7545-53dc-4a42-b222-be862a67cef0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.022308 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.022289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b66q5\" (UniqueName: \"kubernetes.io/projected/6fdc7545-53dc-4a42-b222-be862a67cef0-kube-api-access-b66q5\") pod \"prometheus-k8s-0\" (UID: \"6fdc7545-53dc-4a42-b222-be862a67cef0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.164686 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.164647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:49:53.358494 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:53.358460    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 08:49:53.364187 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:49:53.364155    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdc7545_53dc_4a42_b222_be862a67cef0.slice/crio-500d7f0ec4acd9441563dba6a6470ac43ea7c509bd0f85b73d3cbc08570dd748 WatchSource:0}: Error finding container 500d7f0ec4acd9441563dba6a6470ac43ea7c509bd0f85b73d3cbc08570dd748: Status 404 returned error can't find the container with id 500d7f0ec4acd9441563dba6a6470ac43ea7c509bd0f85b73d3cbc08570dd748
Jul 29 08:49:54.205485 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:54.205451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:54.294236 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:54.294203    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fdc7545-53dc-4a42-b222-be862a67cef0","Type":"ContainerStarted","Data":"500d7f0ec4acd9441563dba6a6470ac43ea7c509bd0f85b73d3cbc08570dd748"}
Jul 29 08:49:54.305180 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:54.305153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:54.893069 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:54.893034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:54.992328 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:54.992298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:55.425736 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:55.425686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:55.515882 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:55.515845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:56.302334 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:56.302300    2564 generic.go:356] "Generic (PLEG): container finished" podID="6fdc7545-53dc-4a42-b222-be862a67cef0" containerID="30acb9bbb9f780503e9cf7cba33a767aa23fa556953143f1c7dd678d7c92a29c" exitCode=0
Jul 29 08:49:56.302519 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:56.302344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fdc7545-53dc-4a42-b222-be862a67cef0","Type":"ContainerDied","Data":"30acb9bbb9f780503e9cf7cba33a767aa23fa556953143f1c7dd678d7c92a29c"}
Jul 29 08:49:58.316145 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:58.316061    2564 generic.go:356] "Generic (PLEG): container finished" podID="04cb4ce0-cf14-419e-b296-088f0d42ab0a" containerID="a2a7ebe994a3704a0f2aa7ffdfb0c6437b415c4e8d97919056d833c7df4a8fef" exitCode=0
Jul 29 08:49:58.316145 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:58.316112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v" event={"ID":"04cb4ce0-cf14-419e-b296-088f0d42ab0a","Type":"ContainerDied","Data":"a2a7ebe994a3704a0f2aa7ffdfb0c6437b415c4e8d97919056d833c7df4a8fef"}
Jul 29 08:49:58.316654 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:58.316508    2564 scope.go:117] "RemoveContainer" containerID="a2a7ebe994a3704a0f2aa7ffdfb0c6437b415c4e8d97919056d833c7df4a8fef"
Jul 29 08:49:58.396080 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:58.396057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:58.497440 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:58.497407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:58.993988 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:58.993947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:59.065016 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:59.064961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:49:59.322087 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:49:59.322005    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v" event={"ID":"04cb4ce0-cf14-419e-b296-088f0d42ab0a","Type":"ContainerStarted","Data":"9bd409804eb3e8e5793b45c5af481c07a21901e4be6edfa3b3b99df43080ae0f"}
Jul 29 08:50:00.329148 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:00.329116    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fdc7545-53dc-4a42-b222-be862a67cef0","Type":"ContainerStarted","Data":"29e0c57caee52448f979c001f2263665fee1c450d3098c468bbbdae6760fede5"}
Jul 29 08:50:00.329582 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:00.329177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fdc7545-53dc-4a42-b222-be862a67cef0","Type":"ContainerStarted","Data":"05ed8008fa19c7a14f8ddbab4b4c1901d3742bc465e161ef55069b22169ca091"}
Jul 29 08:50:02.340395 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:02.340349    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fdc7545-53dc-4a42-b222-be862a67cef0","Type":"ContainerStarted","Data":"ae88ef4ae6aa1d98fb6d23063442f773271524c177894a4e05988b1e0ebb74f7"}
Jul 29 08:50:02.340804 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:02.340476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fdc7545-53dc-4a42-b222-be862a67cef0","Type":"ContainerStarted","Data":"153437280ff9b7ebd87413869279c226e2c616f9d6923e9c674258fd200d88a1"}
Jul 29 08:50:02.340804 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:02.340522    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fdc7545-53dc-4a42-b222-be862a67cef0","Type":"ContainerStarted","Data":"9dbd1fc98fd840f3a6a06b28b70d116541717e1f8010358ab664aca18172c274"}
Jul 29 08:50:02.340804 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:02.340558    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fdc7545-53dc-4a42-b222-be862a67cef0","Type":"ContainerStarted","Data":"cb4aa6643af495d47c2179a15564462cff19b17cf2a08ae84f703f61adf0a96c"}
Jul 29 08:50:02.377231 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:02.377167    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.291456522 podStartE2EDuration="10.377148057s" totalImagesPullingTime="7.068344092s" totalInitContainerRuntime="17.347443ms" isStatefulPod=false podCreationTimestamp="2026-07-29 08:49:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:50:02.375043828 +0000 UTC m=+151.146313891" watchObservedRunningTime="2026-07-29 08:50:02.377148057 +0000 UTC m=+151.148418123"
Jul 29 08:50:03.164948 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:03.164905    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:50:05.198725 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.198671    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg" podUID="c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" containerName="registry" containerID="cri-o://5e78d6fe209ea7e66c748cb387ad3f099de0f60fe9cabc9210f780119699f7ac" gracePeriod=30
Jul 29 08:50:05.352909 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.352870    2564 generic.go:356] "Generic (PLEG): container finished" podID="c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" containerID="5e78d6fe209ea7e66c748cb387ad3f099de0f60fe9cabc9210f780119699f7ac" exitCode=0
Jul 29 08:50:05.353060 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.352911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg" event={"ID":"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe","Type":"ContainerDied","Data":"5e78d6fe209ea7e66c748cb387ad3f099de0f60fe9cabc9210f780119699f7ac"}
Jul 29 08:50:05.441160 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.441140    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:50:05.521817 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.521734    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-installation-pull-secrets\") pod \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") "
Jul 29 08:50:05.521817 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.521787    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-certificates\") pod \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") "
Jul 29 08:50:05.521817 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.521817    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-bound-sa-token\") pod \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") "
Jul 29 08:50:05.522067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.521835    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") pod \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") "
Jul 29 08:50:05.522067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.521854    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-ca-trust-extracted\") pod \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") "
Jul 29 08:50:05.522067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.521925    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcdhd\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-kube-api-access-jcdhd\") pod \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") "
Jul 29 08:50:05.522067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.521962    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-image-registry-private-configuration\") pod \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") "
Jul 29 08:50:05.522067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.522053    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-trusted-ca\") pod \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\" (UID: \"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe\") "
Jul 29 08:50:05.522308 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.522210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 08:50:05.522367 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.522317    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-certificates\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 08:50:05.522624 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.522584    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 08:50:05.524563 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.524517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:50:05.524563 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.524530    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:50:05.524732 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.524633    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 08:50:05.524732 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.524676    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:50:05.524806 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.524759    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-kube-api-access-jcdhd" (OuterVolumeSpecName: "kube-api-access-jcdhd") pod "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe"). InnerVolumeSpecName "kube-api-access-jcdhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 08:50:05.530431 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.530406    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" (UID: "c1ed4873-0915-4ad8-8a3d-9c935c19cbbe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 08:50:05.622979 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.622942    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-bound-sa-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 08:50:05.622979 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.622973    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-registry-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 08:50:05.622979 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.622982    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-ca-trust-extracted\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 08:50:05.623199 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.622990    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcdhd\" (UniqueName: \"kubernetes.io/projected/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-kube-api-access-jcdhd\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 08:50:05.623199 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.623000    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-image-registry-private-configuration\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 08:50:05.623199 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.623009    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-trusted-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 08:50:05.623199 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:05.623018    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe-installation-pull-secrets\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 08:50:06.358067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:06.358039    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg"
Jul 29 08:50:06.358067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:06.358054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c458b65fd-ddlrg" event={"ID":"c1ed4873-0915-4ad8-8a3d-9c935c19cbbe","Type":"ContainerDied","Data":"dadd99a494670ed7ad2af6eb7414cf3f07bae8d079a0592c133d21d617940864"}
Jul 29 08:50:06.358504 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:06.358108    2564 scope.go:117] "RemoveContainer" containerID="5e78d6fe209ea7e66c748cb387ad3f099de0f60fe9cabc9210f780119699f7ac"
Jul 29 08:50:06.382524 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:06.382496    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c458b65fd-ddlrg"]
Jul 29 08:50:06.384831 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:06.384807    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c458b65fd-ddlrg"]
Jul 29 08:50:07.760102 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:07.760061    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" path="/var/lib/kubelet/pods/c1ed4873-0915-4ad8-8a3d-9c935c19cbbe/volumes"
Jul 29 08:50:08.096573 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:08.096487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:50:08.212067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:08.212034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:50:09.819911 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:09.819873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:50:09.960532 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:09.960504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:50:23.057366 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:23.057322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:50:23.125259 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:23.125226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:50:44.401404 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:44.401344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:50:50.688975 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:50.688941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:50:53.165482 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:53.165444    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:50:53.185392 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:53.185368    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:50:53.541407 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:50:53.541335    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 08:51:02.722039 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:02.722002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:02.821594 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:02.821561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:14.552640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:14.552607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:14.604531 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:14.604494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:16.850338 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:16.850306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:16.941700 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:16.941666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:23.064090 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:23.064056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:23.167591 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:23.167557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:27.509530 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:27.509497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:27.629231 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:27.629196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:27.685458 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:27.685426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:52.141032 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:52.141001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:51:52.196644 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:51:52.196616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:09.425917 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:09.425885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:09.524726 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:09.524690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:31.425385 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:31.425347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:31.636735 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:31.636695    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 08:52:32.766026 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:32.765971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:35.005350 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:35.005314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:35.123133 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:35.123097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:37.337198 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:37.337166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:37.440537 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:37.440499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:39.957404 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:39.957365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:40.120809 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:40.120778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:42.169335 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:42.169306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:42.228932 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:42.228904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:52:47.316685 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:52:47.316650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:01.105301 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:01.105262    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:01.202390 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:01.202352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:01.613650 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:01.613615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:06.698921 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:06.698890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:06.798994 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:06.798963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:08.373858 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:08.373826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:20.469231 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.469195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:20.578225 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.578188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:20.814006 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.813928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:20.875157 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.875128    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-848779956-f8l6b"]
Jul 29 08:53:20.875385 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.875374    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" containerName="registry"
Jul 29 08:53:20.875469 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.875386    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" containerName="registry"
Jul 29 08:53:20.875469 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.875440    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1ed4873-0915-4ad8-8a3d-9c935c19cbbe" containerName="registry"
Jul 29 08:53:20.878157 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.878143    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:20.881072 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.881046    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 08:53:20.881193 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.881134    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 08:53:20.881256 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.881226    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 08:53:20.881314 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.881291    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 08:53:20.881314 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.881306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 08:53:20.881418 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.881292    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8bqr6\""
Jul 29 08:53:20.894306 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.894285    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-848779956-f8l6b"]
Jul 29 08:53:20.916215 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:20.916192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:21.002337 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.002296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-manager-config\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.002337 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.002336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp4vv\" (UniqueName: \"kubernetes.io/projected/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-kube-api-access-bp4vv\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.002553 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.002358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-cert\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.002553 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.002397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-metrics-cert\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.103786 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.103666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-manager-config\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.103786 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.103707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp4vv\" (UniqueName: \"kubernetes.io/projected/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-kube-api-access-bp4vv\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.103786 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.103759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-cert\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.103786 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.103777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-metrics-cert\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.109210 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.104741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-manager-config\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.109210 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.107200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-metrics-cert\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.109210 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.107237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-cert\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.124091 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.124061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp4vv\" (UniqueName: \"kubernetes.io/projected/8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec-kube-api-access-bp4vv\") pod \"lws-controller-manager-848779956-f8l6b\" (UID: \"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec\") " pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.131143 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.131112    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:21.186889 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.186850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:21.318228 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.318196    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-848779956-f8l6b"]
Jul 29 08:53:21.321277 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:53:21.321252    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d58e11c_cfef_48d8_b4f9_e3b3f057e0ec.slice/crio-dd1626bfc88b2f329d081f298f9f924d71d5845272ee6752f7babde386b07d7e WatchSource:0}: Error finding container dd1626bfc88b2f329d081f298f9f924d71d5845272ee6752f7babde386b07d7e: Status 404 returned error can't find the container with id dd1626bfc88b2f329d081f298f9f924d71d5845272ee6752f7babde386b07d7e
Jul 29 08:53:21.323526 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.323508    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 08:53:21.858339 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.858308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:21.997725 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:21.997683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:22.038959 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.038926    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"]
Jul 29 08:53:22.042299 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.042274    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b" event={"ID":"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec","Type":"ContainerStarted","Data":"dd1626bfc88b2f329d081f298f9f924d71d5845272ee6752f7babde386b07d7e"}
Jul 29 08:53:22.042437 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.042365    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.046376 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.046127    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7dtxx\""
Jul 29 08:53:22.046376 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.046154    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 08:53:22.046376 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.046219    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 08:53:22.046376 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.046139    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 08:53:22.046376 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.046136    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 08:53:22.072061 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.072027    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"]
Jul 29 08:53:22.111420 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.111330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c8bfac3-3f75-42e3-8b2e-10abf743c665-tmp\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.111420 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.111397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c8bfac3-3f75-42e3-8b2e-10abf743c665-manifests\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.111626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.111466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj8rf\" (UniqueName: \"kubernetes.io/projected/5c8bfac3-3f75-42e3-8b2e-10abf743c665-kube-api-access-fj8rf\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.111626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.111525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c8bfac3-3f75-42e3-8b2e-10abf743c665-webhook-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.111761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.111620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c8bfac3-3f75-42e3-8b2e-10abf743c665-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.186564 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.186524    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:22.212490 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.212408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c8bfac3-3f75-42e3-8b2e-10abf743c665-tmp\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.212490 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.212461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c8bfac3-3f75-42e3-8b2e-10abf743c665-manifests\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.212834 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.212500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj8rf\" (UniqueName: \"kubernetes.io/projected/5c8bfac3-3f75-42e3-8b2e-10abf743c665-kube-api-access-fj8rf\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.212834 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.212544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c8bfac3-3f75-42e3-8b2e-10abf743c665-webhook-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.212834 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.212577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c8bfac3-3f75-42e3-8b2e-10abf743c665-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.213056 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.213033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c8bfac3-3f75-42e3-8b2e-10abf743c665-manifests\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.216241 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.215831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c8bfac3-3f75-42e3-8b2e-10abf743c665-tmp\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.216241 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.216221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c8bfac3-3f75-42e3-8b2e-10abf743c665-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.217549 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.217527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c8bfac3-3f75-42e3-8b2e-10abf743c665-webhook-cert\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.225863 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.225821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj8rf\" (UniqueName: \"kubernetes.io/projected/5c8bfac3-3f75-42e3-8b2e-10abf743c665-kube-api-access-fj8rf\") pod \"opendatahub-operator-controller-manager-67764bc7cd-cgz4k\" (UID: \"5c8bfac3-3f75-42e3-8b2e-10abf743c665\") " pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.293038 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.293000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:22.354986 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.354946    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:22.400426 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.400395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:22.506565 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.506530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:22.528334 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.528298    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"]
Jul 29 08:53:22.531805 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:53:22.531780    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8bfac3_3f75_42e3_8b2e_10abf743c665.slice/crio-c345cee69d20d861d6b66e41b4fae5d971a05d305fce1f45e2e41dfab5b34b3b WatchSource:0}: Error finding container c345cee69d20d861d6b66e41b4fae5d971a05d305fce1f45e2e41dfab5b34b3b: Status 404 returned error can't find the container with id c345cee69d20d861d6b66e41b4fae5d971a05d305fce1f45e2e41dfab5b34b3b
Jul 29 08:53:22.612998 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.612961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:22.716976 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.716916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:22.858351 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:22.858313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:23.049240 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:23.049157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k" event={"ID":"5c8bfac3-3f75-42e3-8b2e-10abf743c665","Type":"ContainerStarted","Data":"c345cee69d20d861d6b66e41b4fae5d971a05d305fce1f45e2e41dfab5b34b3b"}
Jul 29 08:53:26.063585 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:26.063485    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b" event={"ID":"8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec","Type":"ContainerStarted","Data":"a51baa2bf70adefc6476280e2f6c23b0e973d158748872ab786172b79ba3a26d"}
Jul 29 08:53:26.063585 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:26.063582    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:26.065114 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:26.065091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k" event={"ID":"5c8bfac3-3f75-42e3-8b2e-10abf743c665","Type":"ContainerStarted","Data":"a35b56bb1ccf674f9498ee3d742dc645d063a4237d014f6e15a47b8603906df0"}
Jul 29 08:53:26.080977 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:26.080935    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b" podStartSLOduration=1.6585686229999999 podStartE2EDuration="6.080921914s" totalImagesPullingTime="4.422353291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:26.079320289 +0000 UTC m=+354.850590354" watchObservedRunningTime="2026-07-29 08:53:26.080921914 +0000 UTC m=+354.852192053"
Jul 29 08:53:26.590558 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:26.590525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:27.069772 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:27.069738    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c8bfac3-3f75-42e3-8b2e-10abf743c665" containerID="a35b56bb1ccf674f9498ee3d742dc645d063a4237d014f6e15a47b8603906df0" exitCode=0
Jul 29 08:53:27.070198 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:27.069826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k" event={"ID":"5c8bfac3-3f75-42e3-8b2e-10abf743c665","Type":"ContainerDied","Data":"a35b56bb1ccf674f9498ee3d742dc645d063a4237d014f6e15a47b8603906df0"}
Jul 29 08:53:28.075965 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:28.075876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k" event={"ID":"5c8bfac3-3f75-42e3-8b2e-10abf743c665","Type":"ContainerStarted","Data":"d338e17c21acd792713eaa2b18072a5ff137c76b83393c7bc126dc926d4949b5"}
Jul 29 08:53:28.076352 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:28.076016    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:28.099077 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:28.099050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:28.112933 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:28.112887    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k" podStartSLOduration=1.0671493459999999 podStartE2EDuration="6.112872931s" totalImagesPullingTime="3.903960517s" totalInitContainerRuntime="1.141763068s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:28.111671057 +0000 UTC m=+356.882941136" watchObservedRunningTime="2026-07-29 08:53:28.112872931 +0000 UTC m=+356.884142994"
Jul 29 08:53:37.071968 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:37.071936    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-848779956-f8l6b"
Jul 29 08:53:39.082060 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:39.082030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67764bc7cd-cgz4k"
Jul 29 08:53:41.595496 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:41.595458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:41.769018 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:41.768980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:47.277851 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:47.277813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:47.639561 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:47.639528    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:47.742082 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:47.742046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:47.967590 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:47.967507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:48.129192 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:48.129133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:48.215458 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:48.215430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:48.881381 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:48.881352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:48.946385 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:48.946357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:50.093022 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:50.092992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:55.466443 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.466409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:55.568955 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.568922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:55.742991 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.742918    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"]
Jul 29 08:53:55.746450 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.746432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.750822 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.750799    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 08:53:55.751518 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.751493    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 08:53:55.751640 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.751614    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9sk5x\""
Jul 29 08:53:55.751787 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.751772    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 08:53:55.765039 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.765018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"]
Jul 29 08:53:55.793583 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.793554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:55.892775 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.892741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.892952 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.892789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.892952 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.892873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.892952 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.892914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.892952 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.892936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.893111 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.893008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.893111 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.893036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.893111 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.893053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r78w5\" (UniqueName: \"kubernetes.io/projected/2a0e09b1-6914-42f8-8981-594d0b5d52ac-kube-api-access-r78w5\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.893111 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.893079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993524 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993524 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993524 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993837 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993837 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78w5\" (UniqueName: \"kubernetes.io/projected/2a0e09b1-6914-42f8-8981-594d0b5d52ac-kube-api-access-r78w5\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993837 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993837 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993837 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.993837 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:55.993837 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.994179 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.993972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.994179 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.994091    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.994298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.994233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.994298 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.994269    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.994400 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.994369    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.995808 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.995786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:55.996191 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:55.996174    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:56.007907 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.007884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a0e09b1-6914-42f8-8981-594d0b5d52ac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:56.023855 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.023826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r78w5\" (UniqueName: \"kubernetes.io/projected/2a0e09b1-6914-42f8-8981-594d0b5d52ac-kube-api-access-r78w5\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cldhpm\" (UID: \"2a0e09b1-6914-42f8-8981-594d0b5d52ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:56.056697 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.056673    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:53:56.107835 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.107774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:56.187168 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.187147    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"]
Jul 29 08:53:56.189529 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:53:56.189502    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0e09b1_6914_42f8_8981_594d0b5d52ac.slice/crio-007b9e203f46fd22eb5bdafc24ac7d22e0b5d070ec47b2745315f507f3039af0 WatchSource:0}: Error finding container 007b9e203f46fd22eb5bdafc24ac7d22e0b5d070ec47b2745315f507f3039af0: Status 404 returned error can't find the container with id 007b9e203f46fd22eb5bdafc24ac7d22e0b5d070ec47b2745315f507f3039af0
Jul 29 08:53:56.825116 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.825056    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"]
Jul 29 08:53:56.829299 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.829281    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:56.831332 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.831311    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 08:53:56.831448 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.831337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 08:53:56.831448 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.831439    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v7ktc\""
Jul 29 08:53:56.831628 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.831613    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 08:53:56.839743 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:56.839708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"]
Jul 29 08:53:57.003361 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.003173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.003361 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.003265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.003361 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.003296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.003361 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.003330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff40a0d-a0a8-48d5-a297-6102f94e26af-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.003686 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.003381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.003686 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.003411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.003686 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.003532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwklp\" (UniqueName: \"kubernetes.io/projected/cff40a0d-a0a8-48d5-a297-6102f94e26af-kube-api-access-jwklp\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.104209 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.104118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.104209 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.104167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.104404 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.104218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff40a0d-a0a8-48d5-a297-6102f94e26af-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.104404 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.104339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.104404 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.104374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.104516 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.104435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwklp\" (UniqueName: \"kubernetes.io/projected/cff40a0d-a0a8-48d5-a297-6102f94e26af-kube-api-access-jwklp\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.104516 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.104472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.105793 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.105739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.107949 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.107924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.108067 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.107996    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.108300 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.108277    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.108704 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.108686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff40a0d-a0a8-48d5-a297-6102f94e26af-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.121402 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.121353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwklp\" (UniqueName: \"kubernetes.io/projected/cff40a0d-a0a8-48d5-a297-6102f94e26af-kube-api-access-jwklp\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.122408 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.122383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff40a0d-a0a8-48d5-a297-6102f94e26af-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sxkck\" (UID: \"cff40a0d-a0a8-48d5-a297-6102f94e26af\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.139729 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.139635    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:53:57.185349 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.185301    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm" event={"ID":"2a0e09b1-6914-42f8-8981-594d0b5d52ac","Type":"ContainerStarted","Data":"007b9e203f46fd22eb5bdafc24ac7d22e0b5d070ec47b2745315f507f3039af0"}
Jul 29 08:53:57.341934 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.341858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"]
Jul 29 08:53:57.422028 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:53:57.421993    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff40a0d_a0a8_48d5_a297_6102f94e26af.slice/crio-b89db387cde29581c0614cb7c1bc4e1d0b1bb3f07e76530e42800610ae358def WatchSource:0}: Error finding container b89db387cde29581c0614cb7c1bc4e1d0b1bb3f07e76530e42800610ae358def: Status 404 returned error can't find the container with id b89db387cde29581c0614cb7c1bc4e1d0b1bb3f07e76530e42800610ae358def
Jul 29 08:53:57.985618 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:57.985579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:58.086568 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:58.086529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:53:58.191311 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:58.191276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck" event={"ID":"cff40a0d-a0a8-48d5-a297-6102f94e26af","Type":"ContainerStarted","Data":"b89db387cde29581c0614cb7c1bc4e1d0b1bb3f07e76530e42800610ae358def"}
Jul 29 08:53:59.049262 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:59.049227    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 08:53:59.049519 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:59.049301    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 08:53:59.049519 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:59.049334    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 08:53:59.200789 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:59.200745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm" event={"ID":"2a0e09b1-6914-42f8-8981-594d0b5d52ac","Type":"ContainerStarted","Data":"c31f2dd217d65ebc53d535d3e08c19d00c3f11376fac2931d0bb51d991dff613"}
Jul 29 08:53:59.286019 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:59.285958    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm" podStartSLOduration=1.428291021 podStartE2EDuration="4.285941128s" totalImagesPullingTime="2.857650107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:53:59.282662286 +0000 UTC m=+388.053932352" watchObservedRunningTime="2026-07-29 08:53:59.285941128 +0000 UTC m=+388.057211191"
Jul 29 08:53:59.836651 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:53:59.836612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:00.057306 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.057269    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:54:00.063058 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.063030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:54:00.079665 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.079631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:00.188788 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.188752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:00.206146 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.206084    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:54:00.207171 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.207149    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cldhpm"
Jul 29 08:54:00.297391 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.297344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:00.460732 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.460630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:00.583576 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.583540    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:00.930567 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.930532    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 08:54:00.930639 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:00.930607    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 08:54:01.210991 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:01.210904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck" event={"ID":"cff40a0d-a0a8-48d5-a297-6102f94e26af","Type":"ContainerStarted","Data":"1826858fccf5358014858bdcac48f1e75007dad18de405c9b9a9d9b0c4d57c20"}
Jul 29 08:54:01.211432 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:01.211146    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:54:01.212685 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:01.212657    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-sxkck container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 08:54:01.212799 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:01.212707    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck" podUID="cff40a0d-a0a8-48d5-a297-6102f94e26af" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 08:54:01.241179 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:01.241135    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck" podStartSLOduration=1.7349500629999999 podStartE2EDuration="5.241122024s" totalImagesPullingTime="3.506171961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:54:01.23846716 +0000 UTC m=+390.009737251" watchObservedRunningTime="2026-07-29 08:54:01.241122024 +0000 UTC m=+390.012392088"
Jul 29 08:54:01.331415 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:01.331381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:01.442884 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:01.442845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:02.215844 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:02.215816    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sxkck"
Jul 29 08:54:21.841149 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:21.841115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:21.904565 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:21.904529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:43.047129 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:43.047098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:43.238243 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:43.238214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:43.297657 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:43.297592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:43.977448 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:43.977413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:54:44.184824 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:54:44.184787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:01.413122 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:01.413037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:01.513015 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:01.512981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:11.475481 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:11.475430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:11.903096 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:11.903063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:12.004170 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:12.004141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:12.104222 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:12.104180    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:12.209754 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:12.209646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:13.119503 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:13.119468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:13.269303 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:13.269271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:16.722422 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:16.722386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:19.227917 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:19.227878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:19.732130 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:19.732097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:21.502402 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:21.502350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:21.961516 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:21.961470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:24.980403 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:24.980364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:27.143910 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:27.143873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:27.244638 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:27.244604    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:28.133447 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:28.133407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:28.231503 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:28.231470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:33.098742 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:33.098671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:33.197394 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:33.197367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:33.377376 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:33.377346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:33.627455 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:33.627343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:35.900576 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:35.900545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:36.001673 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:36.001643    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:40.061232 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:40.061188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:40.160758 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:40.160706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:48.084028 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:48.083998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:48.149815 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:48.149785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:48.686003 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:48.685967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:48.787270 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:48.787243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:52.087308 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:52.087273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:52.426276 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:52.426242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:54.312410 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:54.312374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:54.414380 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:54.414344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:58.830451 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:58.830410    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:58.930667 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:58.930632    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:55:59.770773 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.770742    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"]
Jul 29 08:55:59.773992 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.773972    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:55:59.777709 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.777687    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsh69\""
Jul 29 08:55:59.777818 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.777738    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 08:55:59.777871 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.777864    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 08:55:59.803175 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.803150    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"]
Jul 29 08:55:59.869743 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.869682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0976b660-6e2c-4885-9ce9-1e63d729347a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-29995\" (UID: \"0976b660-6e2c-4885-9ce9-1e63d729347a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:55:59.870128 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.869840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtz7l\" (UniqueName: \"kubernetes.io/projected/0976b660-6e2c-4885-9ce9-1e63d729347a-kube-api-access-wtz7l\") pod \"kuadrant-operator-controller-manager-86878c769f-29995\" (UID: \"0976b660-6e2c-4885-9ce9-1e63d729347a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:55:59.971210 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.971172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtz7l\" (UniqueName: \"kubernetes.io/projected/0976b660-6e2c-4885-9ce9-1e63d729347a-kube-api-access-wtz7l\") pod \"kuadrant-operator-controller-manager-86878c769f-29995\" (UID: \"0976b660-6e2c-4885-9ce9-1e63d729347a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:55:59.971378 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.971218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0976b660-6e2c-4885-9ce9-1e63d729347a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-29995\" (UID: \"0976b660-6e2c-4885-9ce9-1e63d729347a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:55:59.971618 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.971600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0976b660-6e2c-4885-9ce9-1e63d729347a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-29995\" (UID: \"0976b660-6e2c-4885-9ce9-1e63d729347a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:55:59.984282 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:55:59.984254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtz7l\" (UniqueName: \"kubernetes.io/projected/0976b660-6e2c-4885-9ce9-1e63d729347a-kube-api-access-wtz7l\") pod \"kuadrant-operator-controller-manager-86878c769f-29995\" (UID: \"0976b660-6e2c-4885-9ce9-1e63d729347a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:56:00.084207 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:00.084123    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:56:00.212044 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:00.211978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"]
Jul 29 08:56:00.215154 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:56:00.215128    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0976b660_6e2c_4885_9ce9_1e63d729347a.slice/crio-43d68a5648fea574b2cbe717affe9584e3b8cd8a24551a7e1a6c11ce61894097 WatchSource:0}: Error finding container 43d68a5648fea574b2cbe717affe9584e3b8cd8a24551a7e1a6c11ce61894097: Status 404 returned error can't find the container with id 43d68a5648fea574b2cbe717affe9584e3b8cd8a24551a7e1a6c11ce61894097
Jul 29 08:56:00.652256 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:00.652225    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995" event={"ID":"0976b660-6e2c-4885-9ce9-1e63d729347a","Type":"ContainerStarted","Data":"43d68a5648fea574b2cbe717affe9584e3b8cd8a24551a7e1a6c11ce61894097"}
Jul 29 08:56:04.192850 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:04.192803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:04.293588 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:04.293553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:04.674629 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:04.674557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995" event={"ID":"0976b660-6e2c-4885-9ce9-1e63d729347a","Type":"ContainerStarted","Data":"9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff"}
Jul 29 08:56:04.674823 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:04.674683    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:56:04.706789 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:04.706667    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995" podStartSLOduration=1.863938987 podStartE2EDuration="5.706646497s" totalImagesPullingTime="3.84270751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:56:04.705241593 +0000 UTC m=+513.476511675" watchObservedRunningTime="2026-07-29 08:56:04.706646497 +0000 UTC m=+513.477916562"
Jul 29 08:56:10.728762 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:10.728710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:10.810663 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:10.810630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:15.681422 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:15.681389    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 08:56:15.989393 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:15.989319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:16.565694 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:16.565657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:17.961933 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:17.961899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:18.016236 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:18.016202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:35.349636 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:35.349549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:35.468270 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:35.468224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:35.524243 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:35.524210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:36.195393 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:36.195361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:36.261227 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:36.261193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:57.741581 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:57.741543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:57.844195 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:57.844160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:56:58.226506 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:56:58.226472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:09.792467 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:09.792425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:09.964424 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:09.964376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:11.963963 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:11.963925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:12.736806 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:12.736771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:12.837336 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:12.837284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:16.189284 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:16.189254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:16.287365 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:16.287324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:16.374893 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:16.374851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:16.435539 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:16.435510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:19.775232 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:19.775191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:19.880103 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:19.880046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:33.576699 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:33.576665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:33.675402 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:33.675367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:53.588826 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:53.588789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:53.687512 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:53.687477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:54.317787 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:54.317683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:54.612997 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:54.612895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:54.955854 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:54.955824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:55.052319 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:55.052286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:57:55.311994 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:57:55.311887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:58:05.846021 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:05.845986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:58:05.938244 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:05.938207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:58:30.437908 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:30.437871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:58:38.110313 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.110279    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"]
Jul 29 08:58:38.113633 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.113613    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.115762 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.115741    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 08:58:38.116323 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.116299    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-27jj4\""
Jul 29 08:58:38.116424 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.116308    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 08:58:38.116424 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.116368    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 08:58:38.124517 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.124494    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"]
Jul 29 08:58:38.148217 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.148188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:58:38.196453 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.196424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.196626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.196471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.196626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.196525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.196626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.196570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eef80f9-809e-42a0-92ed-1d592bc9cb17-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.196626 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.196614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.196819 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.196687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thksq\" (UniqueName: \"kubernetes.io/projected/9eef80f9-809e-42a0-92ed-1d592bc9cb17-kube-api-access-thksq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297412 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297587 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297587 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eef80f9-809e-42a0-92ed-1d592bc9cb17-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297587 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297587 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thksq\" (UniqueName: \"kubernetes.io/projected/9eef80f9-809e-42a0-92ed-1d592bc9cb17-kube-api-access-thksq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297820 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297871 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297923 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.297974 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.297922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.299875 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.299849    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eef80f9-809e-42a0-92ed-1d592bc9cb17-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.300159 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.300138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eef80f9-809e-42a0-92ed-1d592bc9cb17-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.304675 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.304650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thksq\" (UniqueName: \"kubernetes.io/projected/9eef80f9-809e-42a0-92ed-1d592bc9cb17-kube-api-access-thksq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gm4dq\" (UID: \"9eef80f9-809e-42a0-92ed-1d592bc9cb17\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.424101 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.424067    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:38.555518 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.555379    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"]
Jul 29 08:58:38.557624 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:58:38.557599    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eef80f9_809e_42a0_92ed_1d592bc9cb17.slice/crio-803a18d40ef3c33c8cf2b9e05e1f8f494f2e6482bdd080cbc38d845544a5dd56 WatchSource:0}: Error finding container 803a18d40ef3c33c8cf2b9e05e1f8f494f2e6482bdd080cbc38d845544a5dd56: Status 404 returned error can't find the container with id 803a18d40ef3c33c8cf2b9e05e1f8f494f2e6482bdd080cbc38d845544a5dd56
Jul 29 08:58:38.558875 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:38.558856    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 08:58:39.302252 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:39.302207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq" event={"ID":"9eef80f9-809e-42a0-92ed-1d592bc9cb17","Type":"ContainerStarted","Data":"803a18d40ef3c33c8cf2b9e05e1f8f494f2e6482bdd080cbc38d845544a5dd56"}
Jul 29 08:58:40.308764 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:40.308725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq" event={"ID":"9eef80f9-809e-42a0-92ed-1d592bc9cb17","Type":"ContainerStarted","Data":"72ba3f7219fcbcf82e6a0ba808a6aef80f6610d76f9fc9f4ec7b1fcd6e643f85"}
Jul 29 08:58:40.324317 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:40.324269    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq" podStartSLOduration=1.318561106 podStartE2EDuration="2.324253612s" totalImagesPullingTime="1.005692506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:58:40.323397863 +0000 UTC m=+669.094667942" watchObservedRunningTime="2026-07-29 08:58:40.324253612 +0000 UTC m=+669.095523676"
Jul 29 08:58:48.425214 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:48.425172    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:48.425689 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:48.425250    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:48.437952 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:48.437929    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:49.358766 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:49.358735    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gm4dq"
Jul 29 08:58:53.053852 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:58:53.053817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:59:02.139937 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:02.139896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:59:11.003220 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.003188    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"]
Jul 29 08:59:11.006333 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.006316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.008448 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.008427    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 08:59:11.015031 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.015011    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"]
Jul 29 08:59:11.026135 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.026111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:59:11.079772 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.079748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.079878 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.079775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.079878 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.079797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.079878 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.079815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.079878 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.079861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.080035 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.079936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddx4\" (UniqueName: \"kubernetes.io/projected/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-kube-api-access-sddx4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.180610 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.180581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.180761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.180614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.180761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.180663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sddx4\" (UniqueName: \"kubernetes.io/projected/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-kube-api-access-sddx4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.180761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.180701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.180761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.180730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.180761 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.180751    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.181090 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.181069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.181144 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.181106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.181144 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.181105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.183049 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.183024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.183317 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.183301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.188491 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.188471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddx4\" (UniqueName: \"kubernetes.io/projected/76a3b818-5ebc-4a17-994b-3d5e6ccfa35e-kube-api-access-sddx4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lrxfr\" (UID: \"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.316458 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.316367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:11.442061 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:11.442030    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"]
Jul 29 08:59:11.445015 ip-10-0-131-230 kubenswrapper[2564]: W0729 08:59:11.444989    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a3b818_5ebc_4a17_994b_3d5e6ccfa35e.slice/crio-9fed6a0c420121c6ab78b01fbdc3c3af4a860493ceb0eb2aa333318d35dee906 WatchSource:0}: Error finding container 9fed6a0c420121c6ab78b01fbdc3c3af4a860493ceb0eb2aa333318d35dee906: Status 404 returned error can't find the container with id 9fed6a0c420121c6ab78b01fbdc3c3af4a860493ceb0eb2aa333318d35dee906
Jul 29 08:59:12.443056 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:12.443016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr" event={"ID":"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e","Type":"ContainerStarted","Data":"b51359922a836365639efb77b44f5efaa2368909af756fbcf89aa4f9f3099258"}
Jul 29 08:59:12.443451 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:12.443070    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr" event={"ID":"76a3b818-5ebc-4a17-994b-3d5e6ccfa35e","Type":"ContainerStarted","Data":"9fed6a0c420121c6ab78b01fbdc3c3af4a860493ceb0eb2aa333318d35dee906"}
Jul 29 08:59:12.460629 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:12.460575    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr" podStartSLOduration=2.288534662 podStartE2EDuration="2.460559479s" totalImagesPullingTime="172.024817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 08:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 08:59:12.459286546 +0000 UTC m=+701.230556611" watchObservedRunningTime="2026-07-29 08:59:12.460559479 +0000 UTC m=+701.231829543"
Jul 29 08:59:21.317291 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:21.317253    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:21.317770 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:21.317318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:21.329533 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:21.329504    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:21.491390 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:21.491362    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lrxfr"
Jul 29 08:59:25.862510 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:25.862421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:59:36.240799 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:36.240756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 08:59:36.341407 ip-10-0-131-230 kubenswrapper[2564]: I0729 08:59:36.341374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:00:35.087453 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:00:35.087418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:00:35.187615 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:00:35.187582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:00:36.231976 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:00:36.231940    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:00:36.331931 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:00:36.331890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:00:49.126822 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:00:49.126788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:00:49.226882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:00:49.226834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:02:40.917346 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:02:40.917313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:02:42.131177 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:02:42.131140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:22.798786 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:22.798741    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:22.897799 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:22.897755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:23.014812 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:23.014772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:29.023021 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:29.022951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:29.087110 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:29.087074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:29.170094 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:29.170067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:29.268266 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:29.268227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:29.373818 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:29.373709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:34.326698 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:34.326655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:03:36.305992 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:03:36.305953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:04:06.681136 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:04:06.681048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:04:06.781859 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:04:06.781819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:05:23.572357 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:05:23.572317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:05:38.804817 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:05:38.804690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:06:03.171866 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:06:03.171827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:07:54.937523 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:54.937487    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"]
Jul 29 09:07:54.940149 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:54.937707    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995" podUID="0976b660-6e2c-4885-9ce9-1e63d729347a" containerName="manager" containerID="cri-o://9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff" gracePeriod=10
Jul 29 09:07:58.087644 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.087621    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 09:07:58.164679 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.164601    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0976b660-6e2c-4885-9ce9-1e63d729347a-extensions-socket-volume\") pod \"0976b660-6e2c-4885-9ce9-1e63d729347a\" (UID: \"0976b660-6e2c-4885-9ce9-1e63d729347a\") "
Jul 29 09:07:58.164873 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.164693    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtz7l\" (UniqueName: \"kubernetes.io/projected/0976b660-6e2c-4885-9ce9-1e63d729347a-kube-api-access-wtz7l\") pod \"0976b660-6e2c-4885-9ce9-1e63d729347a\" (UID: \"0976b660-6e2c-4885-9ce9-1e63d729347a\") "
Jul 29 09:07:58.164873 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.164842    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0976b660-6e2c-4885-9ce9-1e63d729347a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0976b660-6e2c-4885-9ce9-1e63d729347a" (UID: "0976b660-6e2c-4885-9ce9-1e63d729347a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:07:58.165030 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.165010    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0976b660-6e2c-4885-9ce9-1e63d729347a-extensions-socket-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:07:58.166881 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.166848    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0976b660-6e2c-4885-9ce9-1e63d729347a-kube-api-access-wtz7l" (OuterVolumeSpecName: "kube-api-access-wtz7l") pod "0976b660-6e2c-4885-9ce9-1e63d729347a" (UID: "0976b660-6e2c-4885-9ce9-1e63d729347a"). InnerVolumeSpecName "kube-api-access-wtz7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:07:58.266063 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.266031    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtz7l\" (UniqueName: \"kubernetes.io/projected/0976b660-6e2c-4885-9ce9-1e63d729347a-kube-api-access-wtz7l\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:07:58.684385 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.684350    2564 generic.go:356] "Generic (PLEG): container finished" podID="0976b660-6e2c-4885-9ce9-1e63d729347a" containerID="9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff" exitCode=0
Jul 29 09:07:58.684587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.684398    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"
Jul 29 09:07:58.684587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.684450    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995" event={"ID":"0976b660-6e2c-4885-9ce9-1e63d729347a","Type":"ContainerDied","Data":"9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff"}
Jul 29 09:07:58.684587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.684518    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995" event={"ID":"0976b660-6e2c-4885-9ce9-1e63d729347a","Type":"ContainerDied","Data":"43d68a5648fea574b2cbe717affe9584e3b8cd8a24551a7e1a6c11ce61894097"}
Jul 29 09:07:58.684587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.684549    2564 scope.go:117] "RemoveContainer" containerID="9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff"
Jul 29 09:07:58.694095 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.694073    2564 scope.go:117] "RemoveContainer" containerID="9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff"
Jul 29 09:07:58.694374 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:07:58.694354    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff\": container with ID starting with 9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff not found: ID does not exist" containerID="9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff"
Jul 29 09:07:58.694431 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.694382    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff"} err="failed to get container status \"9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff\": rpc error: code = NotFound desc = could not find container \"9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff\": container with ID starting with 9831903549e09683c1f26ddd28f9335ab5cb0113153e4c9dab660ca47f2c0aff not found: ID does not exist"
Jul 29 09:07:58.704402 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.704380    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"]
Jul 29 09:07:58.708557 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:58.708532    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-29995"]
Jul 29 09:07:59.761005 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:07:59.760968    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0976b660-6e2c-4885-9ce9-1e63d729347a" path="/var/lib/kubelet/pods/0976b660-6e2c-4885-9ce9-1e63d729347a/volumes"
Jul 29 09:08:36.221780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:08:36.221742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:11:46.923389 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:11:46.923316    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:11:53.757838 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:11:53.757801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:12:26.393975 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:12:26.393941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:12:27.981800 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:12:27.981758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:12:55.474325 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:12:55.474286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:13:25.653201 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:13:25.653144    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:13:47.323083 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:13:47.323044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:13:47.421068 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:13:47.421035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:13:51.487923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:13:51.487886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:13:51.589211 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:13:51.589178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:14:37.438169 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:14:37.438070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:15:00.134399 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.134364    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm"]
Jul 29 09:15:00.134779 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.134653    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0976b660-6e2c-4885-9ce9-1e63d729347a" containerName="manager"
Jul 29 09:15:00.134779 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.134663    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0976b660-6e2c-4885-9ce9-1e63d729347a" containerName="manager"
Jul 29 09:15:00.134779 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.134736    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0976b660-6e2c-4885-9ce9-1e63d729347a" containerName="manager"
Jul 29 09:15:00.137509 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.137492    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm"
Jul 29 09:15:00.139463 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.139439    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:15:00.146515 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.146499    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm"
Jul 29 09:15:00.151483 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.151462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm"]
Jul 29 09:15:00.275739 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.275668    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm"]
Jul 29 09:15:00.278488 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:15:00.278461    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3059c1b_df0a_48a7_8c2a_5fe083088ec5.slice/crio-6bbb77945003de40ba092524fd498afcc056e65e969f562a5e89bb521fe0b5da WatchSource:0}: Error finding container 6bbb77945003de40ba092524fd498afcc056e65e969f562a5e89bb521fe0b5da: Status 404 returned error can't find the container with id 6bbb77945003de40ba092524fd498afcc056e65e969f562a5e89bb521fe0b5da
Jul 29 09:15:00.280348 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.280333    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 09:15:00.419071 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:00.418985    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm" event={"ID":"d3059c1b-df0a-48a7-8c2a-5fe083088ec5","Type":"ContainerStarted","Data":"6bbb77945003de40ba092524fd498afcc056e65e969f562a5e89bb521fe0b5da"}
Jul 29 09:15:03.440068 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:03.440032    2564 generic.go:356] "Generic (PLEG): container finished" podID="d3059c1b-df0a-48a7-8c2a-5fe083088ec5" containerID="abab9fa316580d270aeca7bcd98fa42dc9aa3d45ac30fa72611a1161b96e139c" exitCode=0
Jul 29 09:15:03.440514 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:03.440100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm" event={"ID":"d3059c1b-df0a-48a7-8c2a-5fe083088ec5","Type":"ContainerDied","Data":"abab9fa316580d270aeca7bcd98fa42dc9aa3d45ac30fa72611a1161b96e139c"}
Jul 29 09:15:04.577032 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:04.577007    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm"
Jul 29 09:15:05.450370 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:05.450339    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm"
Jul 29 09:15:05.450370 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:05.450351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755275-l4rhm" event={"ID":"d3059c1b-df0a-48a7-8c2a-5fe083088ec5","Type":"ContainerDied","Data":"6bbb77945003de40ba092524fd498afcc056e65e969f562a5e89bb521fe0b5da"}
Jul 29 09:15:05.450579 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:05.450398    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bbb77945003de40ba092524fd498afcc056e65e969f562a5e89bb521fe0b5da"
Jul 29 09:15:45.237217 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:15:45.237150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:04.615488 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:04.615400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:07.843204 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:07.843172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:07.946437 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:07.946403    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:08.043506 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:08.043472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:13.722818 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:13.722783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:13.822072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:13.822046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:13.994455 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:13.994367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:14.207639 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.207604    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"]
Jul 29 09:16:14.207929 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.207917    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3059c1b-df0a-48a7-8c2a-5fe083088ec5" containerName="cleanup"
Jul 29 09:16:14.207973 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.207930    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3059c1b-df0a-48a7-8c2a-5fe083088ec5" containerName="cleanup"
Jul 29 09:16:14.208013 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.207978    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3059c1b-df0a-48a7-8c2a-5fe083088ec5" containerName="cleanup"
Jul 29 09:16:14.210952 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.210927    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.212987 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.212967    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-94ce66b8-openshift-default-dockercfg-6g45t\""
Jul 29 09:16:14.229844 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.229806    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"]
Jul 29 09:16:14.236948 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.236921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:14.318282 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-data\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.318282 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ff615a0-d469-4e07-afe1-530f0209379e-istio-podinfo\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.318282 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-certs\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.318596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-socket\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.318596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-credential-socket\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.318596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnzf\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-kube-api-access-ghnzf\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.318596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ff615a0-d469-4e07-afe1-530f0209379e-istiod-ca-cert\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.318596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-envoy\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.318596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.318525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-istio-token\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.419400 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ff615a0-d469-4e07-afe1-530f0209379e-istiod-ca-cert\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.419400 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-envoy\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.419646 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-istio-token\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.419646 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-data\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.419646 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ff615a0-d469-4e07-afe1-530f0209379e-istio-podinfo\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.419646 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-certs\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.419646 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-socket\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.419948 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-data\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.420020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-credential-socket\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.420020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-certs\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.420020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.419992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnzf\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-kube-api-access-ghnzf\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.420255 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.420193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ff615a0-d469-4e07-afe1-530f0209379e-istiod-ca-cert\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.420333 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.420315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-credential-socket\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.420397 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.420380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-socket\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.422089 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.422060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ff615a0-d469-4e07-afe1-530f0209379e-istio-podinfo\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.422200 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.422090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-envoy\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.427159 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.427140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-istio-token\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.427244 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.427209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnzf\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-kube-api-access-ghnzf\") pod \"e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") " pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.521366 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.521329    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:14.592370 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.592339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:14.656372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.656346    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"]
Jul 29 09:16:14.659234 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:16:14.659210    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff615a0_d469_4e07_afe1_530f0209379e.slice/crio-016887dfb647dad6fad881c570879d736c49f9b850f222c17a63c20142afba19 WatchSource:0}: Error finding container 016887dfb647dad6fad881c570879d736c49f9b850f222c17a63c20142afba19: Status 404 returned error can't find the container with id 016887dfb647dad6fad881c570879d736c49f9b850f222c17a63c20142afba19
Jul 29 09:16:14.661770 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.661741    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:14.661827 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.661811    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:14.661862 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.661840    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:14.741572 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.741538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" event={"ID":"7ff615a0-d469-4e07-afe1-530f0209379e","Type":"ContainerStarted","Data":"be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653"}
Jul 29 09:16:14.742099 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.741599    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" event={"ID":"7ff615a0-d469-4e07-afe1-530f0209379e","Type":"ContainerStarted","Data":"016887dfb647dad6fad881c570879d736c49f9b850f222c17a63c20142afba19"}
Jul 29 09:16:14.768445 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:14.768357    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" podStartSLOduration=0.768330064 podStartE2EDuration="768.330064ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:16:14.761924029 +0000 UTC m=+1723.533194118" watchObservedRunningTime="2026-07-29 09:16:14.768330064 +0000 UTC m=+1723.539600129"
Jul 29 09:16:15.522102 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:15.522061    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:15.526825 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:15.526800    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:15.746463 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:15.746423    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:15.747283 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:15.747264    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:16.114399 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.114368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:16.189959 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.189927    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"]
Jul 29 09:16:16.193624 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.193598    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.195852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.195829    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:16:16.195980 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.195926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:16:16.196071 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.196038    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-94ce66b8-serving-cert\""
Jul 29 09:16:16.196280 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.196261    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:16:16.200495 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.200456    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"]
Jul 29 09:16:16.205759 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.205686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:16.285680 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.285651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:16.335608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.335572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3119cd-e0bb-4643-b3b9-16876b759f70-maas-api-tls\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.335802 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.335619    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3119cd-e0bb-4643-b3b9-16876b759f70-openshift-service-ca\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.335802 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.335789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z729\" (UniqueName: \"kubernetes.io/projected/5d3119cd-e0bb-4643-b3b9-16876b759f70-kube-api-access-6z729\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.436901 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.436863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z729\" (UniqueName: \"kubernetes.io/projected/5d3119cd-e0bb-4643-b3b9-16876b759f70-kube-api-access-6z729\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.437077 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.436923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3119cd-e0bb-4643-b3b9-16876b759f70-maas-api-tls\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.437077 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.436945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3119cd-e0bb-4643-b3b9-16876b759f70-openshift-service-ca\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.437581 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.437554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3119cd-e0bb-4643-b3b9-16876b759f70-openshift-service-ca\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.439369 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.439350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3119cd-e0bb-4643-b3b9-16876b759f70-maas-api-tls\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.446327 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.446306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z729\" (UniqueName: \"kubernetes.io/projected/5d3119cd-e0bb-4643-b3b9-16876b759f70-kube-api-access-6z729\") pod \"maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.481439 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.481408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:16.507376 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.507352    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:16.636051 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.636027    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"]
Jul 29 09:16:16.638391 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:16:16.638361    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3119cd_e0bb_4643_b3b9_16876b759f70.slice/crio-ab1a2778dfd2a87161de08207cba3c16dda5a84dcdece6ae6e38844d962dc0de WatchSource:0}: Error finding container ab1a2778dfd2a87161de08207cba3c16dda5a84dcdece6ae6e38844d962dc0de: Status 404 returned error can't find the container with id ab1a2778dfd2a87161de08207cba3c16dda5a84dcdece6ae6e38844d962dc0de
Jul 29 09:16:16.752850 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.752759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr" event={"ID":"5d3119cd-e0bb-4643-b3b9-16876b759f70","Type":"ContainerStarted","Data":"ab1a2778dfd2a87161de08207cba3c16dda5a84dcdece6ae6e38844d962dc0de"}
Jul 29 09:16:16.817087 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.817056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:16.905995 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.905963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:16.906930 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.906911    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"]
Jul 29 09:16:16.911333 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.911314    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:16.913671 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.913653    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-94ce66b8\""
Jul 29 09:16:16.913776 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.913656    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-94ce66b8-dockercfg-b6s2p\""
Jul 29 09:16:16.919862 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:16.919783    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"]
Jul 29 09:16:17.041120 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.041048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtclw\" (UniqueName: \"kubernetes.io/projected/21cc3e62-101d-41b9-a9d5-c8a62504fe54-kube-api-access-wtclw\") pod \"payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g\" (UID: \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:17.041120 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.041104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e62-101d-41b9-a9d5-c8a62504fe54-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g\" (UID: \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:17.142377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.142344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtclw\" (UniqueName: \"kubernetes.io/projected/21cc3e62-101d-41b9-a9d5-c8a62504fe54-kube-api-access-wtclw\") pod \"payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g\" (UID: \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:17.142552 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.142410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e62-101d-41b9-a9d5-c8a62504fe54-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g\" (UID: \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:17.143122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.143104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e62-101d-41b9-a9d5-c8a62504fe54-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g\" (UID: \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:17.153883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.153863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtclw\" (UniqueName: \"kubernetes.io/projected/21cc3e62-101d-41b9-a9d5-c8a62504fe54-kube-api-access-wtclw\") pod \"payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g\" (UID: \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:17.222243 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.222205    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:17.350240 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.350213    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"]
Jul 29 09:16:17.351482 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:16:17.351458    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cc3e62_101d_41b9_a9d5_c8a62504fe54.slice/crio-7c758b1a63f94087b7b4e257c8458525efcc24b1394ea05549187e0a3cc8cdbe WatchSource:0}: Error finding container 7c758b1a63f94087b7b4e257c8458525efcc24b1394ea05549187e0a3cc8cdbe: Status 404 returned error can't find the container with id 7c758b1a63f94087b7b4e257c8458525efcc24b1394ea05549187e0a3cc8cdbe
Jul 29 09:16:17.762665 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:17.762631    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g" event={"ID":"21cc3e62-101d-41b9-a9d5-c8a62504fe54","Type":"ContainerStarted","Data":"7c758b1a63f94087b7b4e257c8458525efcc24b1394ea05549187e0a3cc8cdbe"}
Jul 29 09:16:20.777866 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:20.777830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr" event={"ID":"5d3119cd-e0bb-4643-b3b9-16876b759f70","Type":"ContainerStarted","Data":"ccad7f7497615bf27f2cf0a1b694549a3865ee179759ef97dd1327bf3eb08455"}
Jul 29 09:16:20.778303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:20.777957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:20.779247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:20.779227    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g" event={"ID":"21cc3e62-101d-41b9-a9d5-c8a62504fe54","Type":"ContainerStarted","Data":"ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422"}
Jul 29 09:16:20.779351 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:20.779340    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:20.794917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:20.794867    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr" podStartSLOduration=1.172631625 podStartE2EDuration="4.794851207s" totalImagesPullingTime="3.622219582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:16:20.793067175 +0000 UTC m=+1729.564337250" watchObservedRunningTime="2026-07-29 09:16:20.794851207 +0000 UTC m=+1729.566121271"
Jul 29 09:16:20.808846 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:20.808792    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g" podStartSLOduration=1.85721582 podStartE2EDuration="4.808776357s" totalImagesPullingTime="2.951560537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:16:20.806898861 +0000 UTC m=+1729.578168925" watchObservedRunningTime="2026-07-29 09:16:20.808776357 +0000 UTC m=+1729.580046424"
Jul 29 09:16:26.789597 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:26.789562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:31.425390 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.425356    2564 patch_prober.go:28] interesting pod/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": read tcp 10.132.0.2:55396->10.132.0.24:15021: read: connection reset by peer" start-of-body=
Jul 29 09:16:31.425781 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.425433    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": read tcp 10.132.0.2:55396->10.132.0.24:15021: read: connection reset by peer"
Jul 29 09:16:31.786821 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.786707    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:31.839882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.839849    2564 generic.go:356] "Generic (PLEG): container finished" podID="7ff615a0-d469-4e07-afe1-530f0209379e" containerID="be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653" exitCode=0
Jul 29 09:16:31.840032 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.839926    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" event={"ID":"7ff615a0-d469-4e07-afe1-530f0209379e","Type":"ContainerDied","Data":"be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653"}
Jul 29 09:16:31.840443 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.840426    2564 scope.go:117] "RemoveContainer" containerID="be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653"
Jul 29 09:16:31.841679 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.841645    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:31.841820 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.841741    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:31.841820 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:31.841776    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:32.845983 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:32.845938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" event={"ID":"7ff615a0-d469-4e07-afe1-530f0209379e","Type":"ContainerStarted","Data":"d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f"}
Jul 29 09:16:33.522408 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:33.522361    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:33.522636 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:33.522427    2564 patch_prober.go:28] interesting pod/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 29 09:16:33.522636 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:33.522475    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 29 09:16:34.522846 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:34.522810    2564 patch_prober.go:28] interesting pod/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 29 09:16:34.523766 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:34.523430    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 29 09:16:35.522164 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:35.522124    2564 patch_prober.go:28] interesting pod/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 29 09:16:35.522903 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:35.522431    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 29 09:16:36.522831 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:36.522788    2564 patch_prober.go:28] interesting pod/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 29 09:16:36.523107 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:36.523074    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 29 09:16:37.525422 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:37.525387    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:37.525867 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:37.525686    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:37.526317 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:37.526296    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:41.811047 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:41.811008    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"]
Jul 29 09:16:41.817516 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:41.817478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"
Jul 29 09:16:41.820100 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:41.820078    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:16:41.820253 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:41.820228    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"]
Jul 29 09:16:41.875608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:41.875579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cffb5d7-dd0b-4381-a42a-1f0f6cddd201-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td\" (UID: \"4cffb5d7-dd0b-4381-a42a-1f0f6cddd201\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"
Jul 29 09:16:41.976822 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:41.976793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cffb5d7-dd0b-4381-a42a-1f0f6cddd201-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td\" (UID: \"4cffb5d7-dd0b-4381-a42a-1f0f6cddd201\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"
Jul 29 09:16:41.977366 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:41.977347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cffb5d7-dd0b-4381-a42a-1f0f6cddd201-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td\" (UID: \"4cffb5d7-dd0b-4381-a42a-1f0f6cddd201\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"
Jul 29 09:16:42.128634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:42.128613    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"
Jul 29 09:16:42.250994 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:42.250966    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"]
Jul 29 09:16:42.253887 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:16:42.253856    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cffb5d7_dd0b_4381_a42a_1f0f6cddd201.slice/crio-8245b883588d7bdb9e5d9e0a98e489dada78f8a51ea9d2a0de7675690514ab6b WatchSource:0}: Error finding container 8245b883588d7bdb9e5d9e0a98e489dada78f8a51ea9d2a0de7675690514ab6b: Status 404 returned error can't find the container with id 8245b883588d7bdb9e5d9e0a98e489dada78f8a51ea9d2a0de7675690514ab6b
Jul 29 09:16:42.891018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:42.890983    2564 generic.go:356] "Generic (PLEG): container finished" podID="4cffb5d7-dd0b-4381-a42a-1f0f6cddd201" containerID="254fcdcae13b50e73f773bb424965a7b9ae46dfc3a94f29c9daeb476b70d29c2" exitCode=0
Jul 29 09:16:42.891419 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:42.891059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td" event={"ID":"4cffb5d7-dd0b-4381-a42a-1f0f6cddd201","Type":"ContainerDied","Data":"254fcdcae13b50e73f773bb424965a7b9ae46dfc3a94f29c9daeb476b70d29c2"}
Jul 29 09:16:42.891419 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:42.891108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td" event={"ID":"4cffb5d7-dd0b-4381-a42a-1f0f6cddd201","Type":"ContainerStarted","Data":"8245b883588d7bdb9e5d9e0a98e489dada78f8a51ea9d2a0de7675690514ab6b"}
Jul 29 09:16:44.029056 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:44.029028    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"
Jul 29 09:16:44.093791 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:44.093756    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cffb5d7-dd0b-4381-a42a-1f0f6cddd201-maas-api-service-ca\") pod \"4cffb5d7-dd0b-4381-a42a-1f0f6cddd201\" (UID: \"4cffb5d7-dd0b-4381-a42a-1f0f6cddd201\") "
Jul 29 09:16:44.094092 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:44.094073    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cffb5d7-dd0b-4381-a42a-1f0f6cddd201-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4cffb5d7-dd0b-4381-a42a-1f0f6cddd201" (UID: "4cffb5d7-dd0b-4381-a42a-1f0f6cddd201"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:16:44.194812 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:44.194701    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cffb5d7-dd0b-4381-a42a-1f0f6cddd201-maas-api-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:44.902240 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:44.902206    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"
Jul 29 09:16:44.902240 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:44.902227    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td" event={"ID":"4cffb5d7-dd0b-4381-a42a-1f0f6cddd201","Type":"ContainerDied","Data":"8245b883588d7bdb9e5d9e0a98e489dada78f8a51ea9d2a0de7675690514ab6b"}
Jul 29 09:16:44.902442 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:44.902271    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8245b883588d7bdb9e5d9e0a98e489dada78f8a51ea9d2a0de7675690514ab6b"
Jul 29 09:16:46.793268 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.793235    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"]
Jul 29 09:16:46.793762 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.793442    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr" podUID="5d3119cd-e0bb-4643-b3b9-16876b759f70" containerName="maas-api" containerID="cri-o://ccad7f7497615bf27f2cf0a1b694549a3865ee179759ef97dd1327bf3eb08455" gracePeriod=30
Jul 29 09:16:46.817412 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.817385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:46.852013 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.851977    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"]
Jul 29 09:16:46.852254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.852211    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g" podUID="21cc3e62-101d-41b9-a9d5-c8a62504fe54" containerName="payload-pre-processing" containerID="cri-o://ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422" gracePeriod=30
Jul 29 09:16:46.912923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.912894    2564 generic.go:356] "Generic (PLEG): container finished" podID="5d3119cd-e0bb-4643-b3b9-16876b759f70" containerID="ccad7f7497615bf27f2cf0a1b694549a3865ee179759ef97dd1327bf3eb08455" exitCode=0
Jul 29 09:16:46.913068 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.912970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr" event={"ID":"5d3119cd-e0bb-4643-b3b9-16876b759f70","Type":"ContainerDied","Data":"ccad7f7497615bf27f2cf0a1b694549a3865ee179759ef97dd1327bf3eb08455"}
Jul 29 09:16:46.950271 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.950243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:46.984915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.984877    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"]
Jul 29 09:16:46.986261 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:46.986232    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-94ce66b8-8m7td"]
Jul 29 09:16:47.004656 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.004602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:47.136695 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.136667    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:47.140399 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.140376    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:47.152790 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.152759    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"]
Jul 29 09:16:47.153047 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.153023    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy" containerID="cri-o://d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f" gracePeriod=30
Jul 29 09:16:47.161678 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.161651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:47.220041 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.220000    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3119cd-e0bb-4643-b3b9-16876b759f70-maas-api-tls\") pod \"5d3119cd-e0bb-4643-b3b9-16876b759f70\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") "
Jul 29 09:16:47.220317 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.220080    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtclw\" (UniqueName: \"kubernetes.io/projected/21cc3e62-101d-41b9-a9d5-c8a62504fe54-kube-api-access-wtclw\") pod \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\" (UID: \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\") "
Jul 29 09:16:47.220317 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.220163    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3119cd-e0bb-4643-b3b9-16876b759f70-openshift-service-ca\") pod \"5d3119cd-e0bb-4643-b3b9-16876b759f70\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") "
Jul 29 09:16:47.220489 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.220348    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z729\" (UniqueName: \"kubernetes.io/projected/5d3119cd-e0bb-4643-b3b9-16876b759f70-kube-api-access-6z729\") pod \"5d3119cd-e0bb-4643-b3b9-16876b759f70\" (UID: \"5d3119cd-e0bb-4643-b3b9-16876b759f70\") "
Jul 29 09:16:47.220489 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.220460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e62-101d-41b9-a9d5-c8a62504fe54-plugins-config-volume\") pod \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\" (UID: \"21cc3e62-101d-41b9-a9d5-c8a62504fe54\") "
Jul 29 09:16:47.220614 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.220502    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d3119cd-e0bb-4643-b3b9-16876b759f70-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d3119cd-e0bb-4643-b3b9-16876b759f70" (UID: "5d3119cd-e0bb-4643-b3b9-16876b759f70"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:16:47.220844 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.220818    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d3119cd-e0bb-4643-b3b9-16876b759f70-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:47.220975 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.220950    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21cc3e62-101d-41b9-a9d5-c8a62504fe54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21cc3e62-101d-41b9-a9d5-c8a62504fe54" (UID: "21cc3e62-101d-41b9-a9d5-c8a62504fe54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:16:47.223036 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.222984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d3119cd-e0bb-4643-b3b9-16876b759f70-kube-api-access-6z729" (OuterVolumeSpecName: "kube-api-access-6z729") pod "5d3119cd-e0bb-4643-b3b9-16876b759f70" (UID: "5d3119cd-e0bb-4643-b3b9-16876b759f70"). InnerVolumeSpecName "kube-api-access-6z729". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:16:47.223185 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.223159    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21cc3e62-101d-41b9-a9d5-c8a62504fe54-kube-api-access-wtclw" (OuterVolumeSpecName: "kube-api-access-wtclw") pod "21cc3e62-101d-41b9-a9d5-c8a62504fe54" (UID: "21cc3e62-101d-41b9-a9d5-c8a62504fe54"). InnerVolumeSpecName "kube-api-access-wtclw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:16:47.223291 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.223181    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d3119cd-e0bb-4643-b3b9-16876b759f70-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d3119cd-e0bb-4643-b3b9-16876b759f70" (UID: "5d3119cd-e0bb-4643-b3b9-16876b759f70"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:16:47.321858 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.321821    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z729\" (UniqueName: \"kubernetes.io/projected/5d3119cd-e0bb-4643-b3b9-16876b759f70-kube-api-access-6z729\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:47.321858 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.321852    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21cc3e62-101d-41b9-a9d5-c8a62504fe54-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:47.321858 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.321864    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d3119cd-e0bb-4643-b3b9-16876b759f70-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:47.322157 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.321874    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtclw\" (UniqueName: \"kubernetes.io/projected/21cc3e62-101d-41b9-a9d5-c8a62504fe54-kube-api-access-wtclw\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:47.398524 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.398491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:47.665217 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.665130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:47.760710 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.760674    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cffb5d7-dd0b-4381-a42a-1f0f6cddd201" path="/var/lib/kubelet/pods/4cffb5d7-dd0b-4381-a42a-1f0f6cddd201/volumes"
Jul 29 09:16:47.763640 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.763616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:47.865032 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.865001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:47.918964 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.918880    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"
Jul 29 09:16:47.918964 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.918886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr" event={"ID":"5d3119cd-e0bb-4643-b3b9-16876b759f70","Type":"ContainerDied","Data":"ab1a2778dfd2a87161de08207cba3c16dda5a84dcdece6ae6e38844d962dc0de"}
Jul 29 09:16:47.919186 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.919009    2564 scope.go:117] "RemoveContainer" containerID="ccad7f7497615bf27f2cf0a1b694549a3865ee179759ef97dd1327bf3eb08455"
Jul 29 09:16:47.920466 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.920275    2564 generic.go:356] "Generic (PLEG): container finished" podID="21cc3e62-101d-41b9-a9d5-c8a62504fe54" containerID="ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422" exitCode=0
Jul 29 09:16:47.920466 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.920342    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"
Jul 29 09:16:47.920466 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.920364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g" event={"ID":"21cc3e62-101d-41b9-a9d5-c8a62504fe54","Type":"ContainerDied","Data":"ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422"}
Jul 29 09:16:47.920466 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.920412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g" event={"ID":"21cc3e62-101d-41b9-a9d5-c8a62504fe54","Type":"ContainerDied","Data":"7c758b1a63f94087b7b4e257c8458525efcc24b1394ea05549187e0a3cc8cdbe"}
Jul 29 09:16:47.928411 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.928396    2564 scope.go:117] "RemoveContainer" containerID="ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422"
Jul 29 09:16:47.934540 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.934521    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"]
Jul 29 09:16:47.937042 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.937018    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94ce66b8-77997c8f8d-l5qvr"]
Jul 29 09:16:47.937633 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.937616    2564 scope.go:117] "RemoveContainer" containerID="ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422"
Jul 29 09:16:47.937928 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:16:47.937907    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422\": container with ID starting with ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422 not found: ID does not exist" containerID="ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422"
Jul 29 09:16:47.937992 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.937938    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422"} err="failed to get container status \"ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422\": rpc error: code = NotFound desc = could not find container \"ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422\": container with ID starting with ff5be674bec5f6fd263be370f350f15ef50a379fdedd1e6825c4a76dbe8c7422 not found: ID does not exist"
Jul 29 09:16:47.944344 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.944322    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"]
Jul 29 09:16:47.947436 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:47.947416    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-94ce66b8-65f66bd57b-hrb6g"]
Jul 29 09:16:48.103296 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103267    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"]
Jul 29 09:16:48.103563 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103551    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cffb5d7-dd0b-4381-a42a-1f0f6cddd201" containerName="revoke-keys"
Jul 29 09:16:48.103608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103564    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cffb5d7-dd0b-4381-a42a-1f0f6cddd201" containerName="revoke-keys"
Jul 29 09:16:48.103608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103584    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21cc3e62-101d-41b9-a9d5-c8a62504fe54" containerName="payload-pre-processing"
Jul 29 09:16:48.103608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103590    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="21cc3e62-101d-41b9-a9d5-c8a62504fe54" containerName="payload-pre-processing"
Jul 29 09:16:48.103608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103598    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d3119cd-e0bb-4643-b3b9-16876b759f70" containerName="maas-api"
Jul 29 09:16:48.103608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103604    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d3119cd-e0bb-4643-b3b9-16876b759f70" containerName="maas-api"
Jul 29 09:16:48.103780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103652    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d3119cd-e0bb-4643-b3b9-16876b759f70" containerName="maas-api"
Jul 29 09:16:48.103780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103660    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="21cc3e62-101d-41b9-a9d5-c8a62504fe54" containerName="payload-pre-processing"
Jul 29 09:16:48.103780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.103666    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cffb5d7-dd0b-4381-a42a-1f0f6cddd201" containerName="revoke-keys"
Jul 29 09:16:48.107888 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.107870    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.111479 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.111454    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-610dc5ab-gw-openshift-default-dockercfg-vn6cj\""
Jul 29 09:16:48.125452 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.125431    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"]
Jul 29 09:16:48.135882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.135854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:48.230563 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-token\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.230563 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-certs\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.230780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsvtf\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-kube-api-access-jsvtf\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.230780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230646    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-data\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.230780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istiod-ca-cert\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.230780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-envoy\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.230780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-podinfo\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.230959 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-socket\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.230959 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.230837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-credential-socket\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332145 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332109    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-certs\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332323 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsvtf\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-kube-api-access-jsvtf\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332323 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-data\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332323 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istiod-ca-cert\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332323 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-envoy\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332323 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-podinfo\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332590 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-socket\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332590 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-credential-socket\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332590 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-token\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332590 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-certs\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332813 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-socket\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.332873 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332853    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-credential-socket\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.333018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.332991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-data\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.333222 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.333203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istiod-ca-cert\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.334527 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.334508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-envoy\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.335016 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.334998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-podinfo\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.339998 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.339978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsvtf\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-kube-api-access-jsvtf\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.340095 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.340016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-token\") pod \"e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") " pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.417534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.417498    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:48.558404 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.558370    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"]
Jul 29 09:16:48.560999 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:16:48.560965    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a83c56_5949_4896_8ea9_00fcf2ddd51e.slice/crio-bce6759a0f2ada9ee03de15d8643ad23aea1296fdbcd1db3b0a296b2134ff728 WatchSource:0}: Error finding container bce6759a0f2ada9ee03de15d8643ad23aea1296fdbcd1db3b0a296b2134ff728: Status 404 returned error can't find the container with id bce6759a0f2ada9ee03de15d8643ad23aea1296fdbcd1db3b0a296b2134ff728
Jul 29 09:16:48.563066 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.563034    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:48.563127 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.563098    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:48.563163 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.563129    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:16:48.576634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.576600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:48.927521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.927481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" event={"ID":"09a83c56-5949-4896-8ea9-00fcf2ddd51e","Type":"ContainerStarted","Data":"e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b"}
Jul 29 09:16:48.927999 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.927541    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" event={"ID":"09a83c56-5949-4896-8ea9-00fcf2ddd51e","Type":"ContainerStarted","Data":"bce6759a0f2ada9ee03de15d8643ad23aea1296fdbcd1db3b0a296b2134ff728"}
Jul 29 09:16:48.952571 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:48.952522    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" podStartSLOduration=0.95250363 podStartE2EDuration="952.50363ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:16:48.950314899 +0000 UTC m=+1757.721584963" watchObservedRunningTime="2026-07-29 09:16:48.95250363 +0000 UTC m=+1757.723773696"
Jul 29 09:16:49.418386 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:49.418352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:49.423375 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:49.423349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:49.762072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:49.761989    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21cc3e62-101d-41b9-a9d5-c8a62504fe54" path="/var/lib/kubelet/pods/21cc3e62-101d-41b9-a9d5-c8a62504fe54/volumes"
Jul 29 09:16:49.762603 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:49.762580    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d3119cd-e0bb-4643-b3b9-16876b759f70" path="/var/lib/kubelet/pods/5d3119cd-e0bb-4643-b3b9-16876b759f70/volumes"
Jul 29 09:16:49.933307 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:49.933276    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:49.934235 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:49.934216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:16:50.521635 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.521603    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"]
Jul 29 09:16:50.525951 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.525928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:50.528316 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.528288    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:16:50.528814 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.528792    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-610dc5ab-serving-cert\""
Jul 29 09:16:50.528915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.528799    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:16:50.528915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.528839    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:16:50.532607 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.532578    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"]
Jul 29 09:16:50.654872 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.654834    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:50.654872 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.654875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrpkt\" (UniqueName: \"kubernetes.io/projected/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-kube-api-access-rrpkt\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:50.655143 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.655002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:50.755736 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.755688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:50.755908 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.755826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:50.755908 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:16:50.755844    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-serving-cert: secret "maas-api-e2e-migrate-610dc5ab-serving-cert" not found
Jul 29 09:16:50.755993 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.755848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrpkt\" (UniqueName: \"kubernetes.io/projected/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-kube-api-access-rrpkt\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:50.755993 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:16:50.755908    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls podName:ee3b232f-3d26-4565-8e75-0f75e1efa5e8 nodeName:}" failed. No retries permitted until 2026-07-29 09:16:51.2558898 +0000 UTC m=+1760.027159842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls") pod "maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx" (UID: "ee3b232f-3d26-4565-8e75-0f75e1efa5e8") : secret "maas-api-e2e-migrate-610dc5ab-serving-cert" not found
Jul 29 09:16:50.756649 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.756629    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:50.769271 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:50.769240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrpkt\" (UniqueName: \"kubernetes.io/projected/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-kube-api-access-rrpkt\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:51.207674 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.207638    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"]
Jul 29 09:16:51.210925 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.210908    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.214161 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.214139    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-610dc5ab-dockercfg-q8l7d\""
Jul 29 09:16:51.214288 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.214140    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-610dc5ab\""
Jul 29 09:16:51.221979 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.221952    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"]
Jul 29 09:16:51.224305 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.224280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:51.249470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.249436    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"]
Jul 29 09:16:51.252471 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.252454    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.260285 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.260253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:51.260395 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.260320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4d239f1-1f47-4d92-86c7-afc80b69835f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz\" (UID: \"e4d239f1-1f47-4d92-86c7-afc80b69835f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.260395 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.260376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"]
Jul 29 09:16:51.260499 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.260446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqkft\" (UniqueName: \"kubernetes.io/projected/e4d239f1-1f47-4d92-86c7-afc80b69835f-kube-api-access-gqkft\") pod \"payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz\" (UID: \"e4d239f1-1f47-4d92-86c7-afc80b69835f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.263103 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.263080    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls\") pod \"maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:51.323244 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.323209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:16:51.361967 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.361923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqkft\" (UniqueName: \"kubernetes.io/projected/e4d239f1-1f47-4d92-86c7-afc80b69835f-kube-api-access-gqkft\") pod \"payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz\" (UID: \"e4d239f1-1f47-4d92-86c7-afc80b69835f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.361967 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.361972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt2jg\" (UniqueName: \"kubernetes.io/projected/c74826dd-9c94-48ae-ab02-901c599b33fd-kube-api-access-xt2jg\") pod \"payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc\" (UID: \"c74826dd-9c94-48ae-ab02-901c599b33fd\") " pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.362182 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.362025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4d239f1-1f47-4d92-86c7-afc80b69835f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz\" (UID: \"e4d239f1-1f47-4d92-86c7-afc80b69835f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.362182 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.362065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74826dd-9c94-48ae-ab02-901c599b33fd-plugins-config-volume\") pod \"payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc\" (UID: \"c74826dd-9c94-48ae-ab02-901c599b33fd\") " pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.362736 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.362692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4d239f1-1f47-4d92-86c7-afc80b69835f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz\" (UID: \"e4d239f1-1f47-4d92-86c7-afc80b69835f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.369979 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.369958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqkft\" (UniqueName: \"kubernetes.io/projected/e4d239f1-1f47-4d92-86c7-afc80b69835f-kube-api-access-gqkft\") pod \"payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz\" (UID: \"e4d239f1-1f47-4d92-86c7-afc80b69835f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.440208 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.440174    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:51.462998 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.462925    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74826dd-9c94-48ae-ab02-901c599b33fd-plugins-config-volume\") pod \"payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc\" (UID: \"c74826dd-9c94-48ae-ab02-901c599b33fd\") " pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.463116 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.463035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2jg\" (UniqueName: \"kubernetes.io/projected/c74826dd-9c94-48ae-ab02-901c599b33fd-kube-api-access-xt2jg\") pod \"payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc\" (UID: \"c74826dd-9c94-48ae-ab02-901c599b33fd\") " pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.463844 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.463825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74826dd-9c94-48ae-ab02-901c599b33fd-plugins-config-volume\") pod \"payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc\" (UID: \"c74826dd-9c94-48ae-ab02-901c599b33fd\") " pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.470972 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.470938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt2jg\" (UniqueName: \"kubernetes.io/projected/c74826dd-9c94-48ae-ab02-901c599b33fd-kube-api-access-xt2jg\") pod \"payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc\" (UID: \"c74826dd-9c94-48ae-ab02-901c599b33fd\") " pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.522456 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.522426    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.563762 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.563727    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.578648 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.578616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"]
Jul 29 09:16:51.580060 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:16:51.580032    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3b232f_3d26_4565_8e75_0f75e1efa5e8.slice/crio-1eeb857737259d63fa1bdb7cacd1b4026a24ec0dfc4ef94e539edd87798e7a0f WatchSource:0}: Error finding container 1eeb857737259d63fa1bdb7cacd1b4026a24ec0dfc4ef94e539edd87798e7a0f: Status 404 returned error can't find the container with id 1eeb857737259d63fa1bdb7cacd1b4026a24ec0dfc4ef94e539edd87798e7a0f
Jul 29 09:16:51.677279 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.677247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"]
Jul 29 09:16:51.681390 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:16:51.681354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d239f1_1f47_4d92_86c7_afc80b69835f.slice/crio-328ef370ac373539724a2977b053dec731d85249b9b483f5b00e704ac4e3d0f4 WatchSource:0}: Error finding container 328ef370ac373539724a2977b053dec731d85249b9b483f5b00e704ac4e3d0f4: Status 404 returned error can't find the container with id 328ef370ac373539724a2977b053dec731d85249b9b483f5b00e704ac4e3d0f4
Jul 29 09:16:51.707897 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.707874    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"]
Jul 29 09:16:51.710246 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:16:51.710221    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74826dd_9c94_48ae_ab02_901c599b33fd.slice/crio-14704f53e6c52e8225d901f353004b4a768c53a975afeb425052a72a35ecd23f WatchSource:0}: Error finding container 14704f53e6c52e8225d901f353004b4a768c53a975afeb425052a72a35ecd23f: Status 404 returned error can't find the container with id 14704f53e6c52e8225d901f353004b4a768c53a975afeb425052a72a35ecd23f
Jul 29 09:16:51.943569 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.943530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc" event={"ID":"c74826dd-9c94-48ae-ab02-901c599b33fd","Type":"ContainerStarted","Data":"a43bbb52944efa9de6feee10fcad1c794e67d410a9f5ed96841bd3c9bf457157"}
Jul 29 09:16:51.943774 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.943592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc" event={"ID":"c74826dd-9c94-48ae-ab02-901c599b33fd","Type":"ContainerStarted","Data":"14704f53e6c52e8225d901f353004b4a768c53a975afeb425052a72a35ecd23f"}
Jul 29 09:16:51.943774 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.943620    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:16:51.945114 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.945090    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz" event={"ID":"e4d239f1-1f47-4d92-86c7-afc80b69835f","Type":"ContainerStarted","Data":"e70a668bd68d8c5d6aad7d83d933ad4613d47fb88e47fb81ce14df6fcb2353bc"}
Jul 29 09:16:51.945190 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.945131    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz" event={"ID":"e4d239f1-1f47-4d92-86c7-afc80b69835f","Type":"ContainerStarted","Data":"328ef370ac373539724a2977b053dec731d85249b9b483f5b00e704ac4e3d0f4"}
Jul 29 09:16:51.945249 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.945195    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:16:51.946323 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.946299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx" event={"ID":"ee3b232f-3d26-4565-8e75-0f75e1efa5e8","Type":"ContainerStarted","Data":"1eeb857737259d63fa1bdb7cacd1b4026a24ec0dfc4ef94e539edd87798e7a0f"}
Jul 29 09:16:51.984961 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:51.984810    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc" podStartSLOduration=0.984789252 podStartE2EDuration="984.789252ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:16:51.984180609 +0000 UTC m=+1760.755450692" watchObservedRunningTime="2026-07-29 09:16:51.984789252 +0000 UTC m=+1760.756059311"
Jul 29 09:16:52.003600 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.003552    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz" podStartSLOduration=1.003535814 podStartE2EDuration="1.003535814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:16:52.00230844 +0000 UTC m=+1760.773578503" watchObservedRunningTime="2026-07-29 09:16:52.003535814 +0000 UTC m=+1760.774805878"
Jul 29 09:16:52.410208 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.410179    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:52.473446 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-credential-socket\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473480    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghnzf\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-kube-api-access-ghnzf\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473540    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ff615a0-d469-4e07-afe1-530f0209379e-istio-podinfo\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473567    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-istio-token\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473596    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-certs\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473807 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473629    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ff615a0-d469-4e07-afe1-530f0209379e-istiod-ca-cert\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473807 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-envoy\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473807 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473731    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-data\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473807 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473755    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-socket\") pod \"7ff615a0-d469-4e07-afe1-530f0209379e\" (UID: \"7ff615a0-d469-4e07-afe1-530f0209379e\") "
Jul 29 09:16:52.473807 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473768    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:16:52.474051 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.473947    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:16:52.474051 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.474027    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff615a0-d469-4e07-afe1-530f0209379e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:16:52.474141 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.474125    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.474189 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.474145    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.474189 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.474147    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:16:52.474770 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.474743    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:16:52.475871 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.475845    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ff615a0-d469-4e07-afe1-530f0209379e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:16:52.475968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.475908    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-kube-api-access-ghnzf" (OuterVolumeSpecName: "kube-api-access-ghnzf") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "kube-api-access-ghnzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:16:52.475968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.475930    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:16:52.475968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.475936    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ff615a0-d469-4e07-afe1-530f0209379e" (UID: "7ff615a0-d469-4e07-afe1-530f0209379e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:16:52.574878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.574795    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghnzf\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-kube-api-access-ghnzf\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.574878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.574825    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ff615a0-d469-4e07-afe1-530f0209379e-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.574878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.574835    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ff615a0-d469-4e07-afe1-530f0209379e-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.574878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.574846    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ff615a0-d469-4e07-afe1-530f0209379e-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.574878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.574854    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.574878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.574864    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.574878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.574871    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ff615a0-d469-4e07-afe1-530f0209379e-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:16:52.952854 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.952819    2564 generic.go:356] "Generic (PLEG): container finished" podID="7ff615a0-d469-4e07-afe1-530f0209379e" containerID="d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f" exitCode=0
Jul 29 09:16:52.953052 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.952864    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"
Jul 29 09:16:52.953052 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.952901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" event={"ID":"7ff615a0-d469-4e07-afe1-530f0209379e","Type":"ContainerDied","Data":"d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f"}
Jul 29 09:16:52.953052 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.952948    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr" event={"ID":"7ff615a0-d469-4e07-afe1-530f0209379e","Type":"ContainerDied","Data":"016887dfb647dad6fad881c570879d736c49f9b850f222c17a63c20142afba19"}
Jul 29 09:16:52.953052 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.952981    2564 scope.go:117] "RemoveContainer" containerID="d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f"
Jul 29 09:16:52.954459 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.954435    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx" event={"ID":"ee3b232f-3d26-4565-8e75-0f75e1efa5e8","Type":"ContainerStarted","Data":"4958eccac68d58ad640de2d49aadfc88ff31cce3dc9ac3f3de5dc33322c2368b"}
Jul 29 09:16:52.954548 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.954486    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:16:52.961761 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.961740    2564 scope.go:117] "RemoveContainer" containerID="be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653"
Jul 29 09:16:52.969299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.969281    2564 scope.go:117] "RemoveContainer" containerID="d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f"
Jul 29 09:16:52.969531 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:16:52.969514    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f\": container with ID starting with d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f not found: ID does not exist" containerID="d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f"
Jul 29 09:16:52.969577 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.969538    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f"} err="failed to get container status \"d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f\": rpc error: code = NotFound desc = could not find container \"d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f\": container with ID starting with d881073245930882288d5950cc8521541f4111deae24c63374e58dc044bf5c9f not found: ID does not exist"
Jul 29 09:16:52.969577 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.969553    2564 scope.go:117] "RemoveContainer" containerID="be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653"
Jul 29 09:16:52.969816 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:16:52.969795    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653\": container with ID starting with be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653 not found: ID does not exist" containerID="be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653"
Jul 29 09:16:52.969877 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.969821    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653"} err="failed to get container status \"be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653\": rpc error: code = NotFound desc = could not find container \"be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653\": container with ID starting with be37fe63d7eeeea36db79203746ced70bd4baeb3c3bd8afddcbccc2d70bc4653 not found: ID does not exist"
Jul 29 09:16:52.972566 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.972525    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx" podStartSLOduration=2.411211551 podStartE2EDuration="2.972512564s" totalImagesPullingTime="561.301013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:16:52.970930214 +0000 UTC m=+1761.742200303" watchObservedRunningTime="2026-07-29 09:16:52.972512564 +0000 UTC m=+1761.743782628"
Jul 29 09:16:52.984449 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.984422    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"]
Jul 29 09:16:52.988494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:52.988470    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-94ce66b8-openshift-default-cd9cbcf46-x5dtr"]
Jul 29 09:16:53.764598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:53.764564    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" path="/var/lib/kubelet/pods/7ff615a0-d469-4e07-afe1-530f0209379e/volumes"
Jul 29 09:16:58.966414 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:16:58.966385    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:17:02.956911 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:02.956878    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:17:02.957391 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:02.956969    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:17:04.935408 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:04.935371    2564 patch_prober.go:28] interesting pod/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 29 09:17:04.935841 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:04.935436    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 29 09:17:05.016318 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:05.016286    2564 generic.go:356] "Generic (PLEG): container finished" podID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerID="e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b" exitCode=0
Jul 29 09:17:05.016492 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:05.016354    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" event={"ID":"09a83c56-5949-4896-8ea9-00fcf2ddd51e","Type":"ContainerDied","Data":"e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b"}
Jul 29 09:17:05.016805 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:05.016791    2564 scope.go:117] "RemoveContainer" containerID="e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b"
Jul 29 09:17:05.017795 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:05.017764    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:05.017863 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:05.017851    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:05.017901 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:05.017888    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:06.024120 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:06.024087    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" event={"ID":"09a83c56-5949-4896-8ea9-00fcf2ddd51e","Type":"ContainerStarted","Data":"0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1"}
Jul 29 09:17:06.418849 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:06.418775    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:17:06.419178 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:06.419146    2564 patch_prober.go:28] interesting pod/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 29 09:17:06.419260 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:06.419230    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 29 09:17:07.418658 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:07.418616    2564 patch_prober.go:28] interesting pod/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 29 09:17:07.419311 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:07.419273    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 29 09:17:08.418253 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:08.418208    2564 patch_prober.go:28] interesting pod/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 29 09:17:08.418538 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:08.418507    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 29 09:17:09.419070 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:09.419029    2564 patch_prober.go:28] interesting pod/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 29 09:17:09.419681 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:09.419646    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 29 09:17:10.422327 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:10.422294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:17:10.422695 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:10.422554    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:17:10.423364 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:10.423344    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:17:21.907191 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:21.907144    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"]
Jul 29 09:17:21.907804 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:21.907427    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx" podUID="ee3b232f-3d26-4565-8e75-0f75e1efa5e8" containerName="maas-api" containerID="cri-o://4958eccac68d58ad640de2d49aadfc88ff31cce3dc9ac3f3de5dc33322c2368b" gracePeriod=30
Jul 29 09:17:21.932313 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:21.932286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:21.970059 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:21.970023    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"]
Jul 29 09:17:21.970333 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:21.970302    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc" podUID="c74826dd-9c94-48ae-ab02-901c599b33fd" containerName="payload-processing" containerID="cri-o://a43bbb52944efa9de6feee10fcad1c794e67d410a9f5ed96841bd3c9bf457157" gracePeriod=30
Jul 29 09:17:21.977769 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:21.977664    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"]
Jul 29 09:17:21.977950 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:21.977922    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz" podUID="e4d239f1-1f47-4d92-86c7-afc80b69835f" containerName="payload-pre-processing" containerID="cri-o://e70a668bd68d8c5d6aad7d83d933ad4613d47fb88e47fb81ce14df6fcb2353bc" gracePeriod=30
Jul 29 09:17:22.009309 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.009282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:22.105601 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.105569    2564 generic.go:356] "Generic (PLEG): container finished" podID="ee3b232f-3d26-4565-8e75-0f75e1efa5e8" containerID="4958eccac68d58ad640de2d49aadfc88ff31cce3dc9ac3f3de5dc33322c2368b" exitCode=0
Jul 29 09:17:22.105850 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.105819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx" event={"ID":"ee3b232f-3d26-4565-8e75-0f75e1efa5e8","Type":"ContainerDied","Data":"4958eccac68d58ad640de2d49aadfc88ff31cce3dc9ac3f3de5dc33322c2368b"}
Jul 29 09:17:22.108404 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.108357    2564 generic.go:356] "Generic (PLEG): container finished" podID="c74826dd-9c94-48ae-ab02-901c599b33fd" containerID="a43bbb52944efa9de6feee10fcad1c794e67d410a9f5ed96841bd3c9bf457157" exitCode=0
Jul 29 09:17:22.108544 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.108502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc" event={"ID":"c74826dd-9c94-48ae-ab02-901c599b33fd","Type":"ContainerDied","Data":"a43bbb52944efa9de6feee10fcad1c794e67d410a9f5ed96841bd3c9bf457157"}
Jul 29 09:17:22.111249 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.111216    2564 generic.go:356] "Generic (PLEG): container finished" podID="e4d239f1-1f47-4d92-86c7-afc80b69835f" containerID="e70a668bd68d8c5d6aad7d83d933ad4613d47fb88e47fb81ce14df6fcb2353bc" exitCode=0
Jul 29 09:17:22.111371 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.111246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz" event={"ID":"e4d239f1-1f47-4d92-86c7-afc80b69835f","Type":"ContainerDied","Data":"e70a668bd68d8c5d6aad7d83d933ad4613d47fb88e47fb81ce14df6fcb2353bc"}
Jul 29 09:17:22.160052 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.158514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:22.224767 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.224733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:22.234196 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.233959    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:17:22.235363 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.235335    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"]
Jul 29 09:17:22.235564 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.235540    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy" containerID="cri-o://0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1" gracePeriod=30
Jul 29 09:17:22.276128 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.276091    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:17:22.307927 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.307898    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:17:22.325139 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.325100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:22.337107 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.337072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-openshift-service-ca\") pod \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") "
Jul 29 09:17:22.337300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.337151    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls\") pod \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") "
Jul 29 09:17:22.337300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.337180    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqkft\" (UniqueName: \"kubernetes.io/projected/e4d239f1-1f47-4d92-86c7-afc80b69835f-kube-api-access-gqkft\") pod \"e4d239f1-1f47-4d92-86c7-afc80b69835f\" (UID: \"e4d239f1-1f47-4d92-86c7-afc80b69835f\") "
Jul 29 09:17:22.337300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.337210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt2jg\" (UniqueName: \"kubernetes.io/projected/c74826dd-9c94-48ae-ab02-901c599b33fd-kube-api-access-xt2jg\") pod \"c74826dd-9c94-48ae-ab02-901c599b33fd\" (UID: \"c74826dd-9c94-48ae-ab02-901c599b33fd\") "
Jul 29 09:17:22.337300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.337278    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74826dd-9c94-48ae-ab02-901c599b33fd-plugins-config-volume\") pod \"c74826dd-9c94-48ae-ab02-901c599b33fd\" (UID: \"c74826dd-9c94-48ae-ab02-901c599b33fd\") "
Jul 29 09:17:22.337530 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.337320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrpkt\" (UniqueName: \"kubernetes.io/projected/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-kube-api-access-rrpkt\") pod \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\" (UID: \"ee3b232f-3d26-4565-8e75-0f75e1efa5e8\") "
Jul 29 09:17:22.337530 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.337439    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4d239f1-1f47-4d92-86c7-afc80b69835f-plugins-config-volume\") pod \"e4d239f1-1f47-4d92-86c7-afc80b69835f\" (UID: \"e4d239f1-1f47-4d92-86c7-afc80b69835f\") "
Jul 29 09:17:22.338299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.337895    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ee3b232f-3d26-4565-8e75-0f75e1efa5e8" (UID: "ee3b232f-3d26-4565-8e75-0f75e1efa5e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:22.338748 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.338427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d239f1-1f47-4d92-86c7-afc80b69835f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e4d239f1-1f47-4d92-86c7-afc80b69835f" (UID: "e4d239f1-1f47-4d92-86c7-afc80b69835f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:22.338748 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.338489    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:22.339087 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.339053    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c74826dd-9c94-48ae-ab02-901c599b33fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c74826dd-9c94-48ae-ab02-901c599b33fd" (UID: "c74826dd-9c94-48ae-ab02-901c599b33fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:22.341127 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.341097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-kube-api-access-rrpkt" (OuterVolumeSpecName: "kube-api-access-rrpkt") pod "ee3b232f-3d26-4565-8e75-0f75e1efa5e8" (UID: "ee3b232f-3d26-4565-8e75-0f75e1efa5e8"). InnerVolumeSpecName "kube-api-access-rrpkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:17:22.341663 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.341636    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d239f1-1f47-4d92-86c7-afc80b69835f-kube-api-access-gqkft" (OuterVolumeSpecName: "kube-api-access-gqkft") pod "e4d239f1-1f47-4d92-86c7-afc80b69835f" (UID: "e4d239f1-1f47-4d92-86c7-afc80b69835f"). InnerVolumeSpecName "kube-api-access-gqkft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:17:22.341797 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.341745    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c74826dd-9c94-48ae-ab02-901c599b33fd-kube-api-access-xt2jg" (OuterVolumeSpecName: "kube-api-access-xt2jg") pod "c74826dd-9c94-48ae-ab02-901c599b33fd" (UID: "c74826dd-9c94-48ae-ab02-901c599b33fd"). InnerVolumeSpecName "kube-api-access-xt2jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:17:22.342651 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.342621    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ee3b232f-3d26-4565-8e75-0f75e1efa5e8" (UID: "ee3b232f-3d26-4565-8e75-0f75e1efa5e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:17:22.439582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.439504    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:22.439582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.439536    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqkft\" (UniqueName: \"kubernetes.io/projected/e4d239f1-1f47-4d92-86c7-afc80b69835f-kube-api-access-gqkft\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:22.439582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.439545    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt2jg\" (UniqueName: \"kubernetes.io/projected/c74826dd-9c94-48ae-ab02-901c599b33fd-kube-api-access-xt2jg\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:22.439582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.439554    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74826dd-9c94-48ae-ab02-901c599b33fd-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:22.439582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.439563    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrpkt\" (UniqueName: \"kubernetes.io/projected/ee3b232f-3d26-4565-8e75-0f75e1efa5e8-kube-api-access-rrpkt\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:22.439582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.439572    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4d239f1-1f47-4d92-86c7-afc80b69835f-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:22.474076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.474042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:22.719802 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.719710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:22.977811 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.977734    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"]
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978040    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74826dd-9c94-48ae-ab02-901c599b33fd" containerName="payload-processing"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978052    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74826dd-9c94-48ae-ab02-901c599b33fd" containerName="payload-processing"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978060    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978065    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978071    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3b232f-3d26-4565-8e75-0f75e1efa5e8" containerName="maas-api"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978077    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3b232f-3d26-4565-8e75-0f75e1efa5e8" containerName="maas-api"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978087    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d239f1-1f47-4d92-86c7-afc80b69835f" containerName="payload-pre-processing"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978093    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d239f1-1f47-4d92-86c7-afc80b69835f" containerName="payload-pre-processing"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978146    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978153    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3b232f-3d26-4565-8e75-0f75e1efa5e8" containerName="maas-api"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978159    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4d239f1-1f47-4d92-86c7-afc80b69835f" containerName="payload-pre-processing"
Jul 29 09:17:22.978172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.978166    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c74826dd-9c94-48ae-ab02-901c599b33fd" containerName="payload-processing"
Jul 29 09:17:22.981276 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.981258    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:22.983199 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.983168    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-696b6b1c-openshift-default-dockercfg-b7wgs\""
Jul 29 09:17:22.994841 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:22.994819    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"]
Jul 29 09:17:23.045625 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-podinfo\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.045625 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-token\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.045954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkp48\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-kube-api-access-kkp48\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.045954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045676    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-credential-socket\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.045954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istiod-ca-cert\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.045954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-data\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.045954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-envoy\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.045954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-socket\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.045954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.045915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-certs\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.118449 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.118418    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"
Jul 29 09:17:23.118449 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.118426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc" event={"ID":"c74826dd-9c94-48ae-ab02-901c599b33fd","Type":"ContainerDied","Data":"14704f53e6c52e8225d901f353004b4a768c53a975afeb425052a72a35ecd23f"}
Jul 29 09:17:23.118688 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.118495    2564 scope.go:117] "RemoveContainer" containerID="a43bbb52944efa9de6feee10fcad1c794e67d410a9f5ed96841bd3c9bf457157"
Jul 29 09:17:23.120091 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.119994    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"
Jul 29 09:17:23.120091 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.120013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz" event={"ID":"e4d239f1-1f47-4d92-86c7-afc80b69835f","Type":"ContainerDied","Data":"328ef370ac373539724a2977b053dec731d85249b9b483f5b00e704ac4e3d0f4"}
Jul 29 09:17:23.125044 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.122340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx" event={"ID":"ee3b232f-3d26-4565-8e75-0f75e1efa5e8","Type":"ContainerDied","Data":"1eeb857737259d63fa1bdb7cacd1b4026a24ec0dfc4ef94e539edd87798e7a0f"}
Jul 29 09:17:23.125044 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.122381    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"
Jul 29 09:17:23.131610 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.131154    2564 scope.go:117] "RemoveContainer" containerID="e70a668bd68d8c5d6aad7d83d933ad4613d47fb88e47fb81ce14df6fcb2353bc"
Jul 29 09:17:23.140548 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.140531    2564 scope.go:117] "RemoveContainer" containerID="4958eccac68d58ad640de2d49aadfc88ff31cce3dc9ac3f3de5dc33322c2368b"
Jul 29 09:17:23.142894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.142871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:23.147047 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-socket\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147147 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-certs\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147147 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-podinfo\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147147 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-token\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147147 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkp48\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-kube-api-access-kkp48\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147356 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-credential-socket\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147356 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istiod-ca-cert\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147356 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-data\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147522 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-envoy\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147522 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-certs\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147637 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-data\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147637 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-credential-socket\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.147790 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.147770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-socket\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.148297 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.148001    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istiod-ca-cert\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.149807 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.149788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-envoy\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.150778 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.150757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-podinfo\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.150926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.150912    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"]
Jul 29 09:17:23.155556 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.155535    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-610dc5ab-776c55f949-5fwcc"]
Jul 29 09:17:23.156350 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.156327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-token\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.156517 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.156500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkp48\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-kube-api-access-kkp48\") pod \"e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") " pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.168272 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.168250    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"]
Jul 29 09:17:23.173962 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.173941    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-610dc5ab-c874bfbf6-jrjvx"]
Jul 29 09:17:23.183249 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.183229    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"]
Jul 29 09:17:23.194048 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.194015    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-610dc5ab-69949c5b76-rbsbz"]
Jul 29 09:17:23.245112 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.244944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:23.291046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.291025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:23.425825 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.425796    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"]
Jul 29 09:17:23.427780 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:17:23.427752    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e5a9f9_4275_4906_80fd_a4419d56d4e6.slice/crio-08c4dc98b0626348a927a70f3027fc3785edd5350961c3bde64a17fecc9b41b7 WatchSource:0}: Error finding container 08c4dc98b0626348a927a70f3027fc3785edd5350961c3bde64a17fecc9b41b7: Status 404 returned error can't find the container with id 08c4dc98b0626348a927a70f3027fc3785edd5350961c3bde64a17fecc9b41b7
Jul 29 09:17:23.429851 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.429818    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:23.429926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.429880    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:23.429926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.429912    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:23.760888 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.760801    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c74826dd-9c94-48ae-ab02-901c599b33fd" path="/var/lib/kubelet/pods/c74826dd-9c94-48ae-ab02-901c599b33fd/volumes"
Jul 29 09:17:23.761174 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.761160    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4d239f1-1f47-4d92-86c7-afc80b69835f" path="/var/lib/kubelet/pods/e4d239f1-1f47-4d92-86c7-afc80b69835f/volumes"
Jul 29 09:17:23.761501 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:23.761488    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee3b232f-3d26-4565-8e75-0f75e1efa5e8" path="/var/lib/kubelet/pods/ee3b232f-3d26-4565-8e75-0f75e1efa5e8/volumes"
Jul 29 09:17:24.128925 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:24.128894    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" event={"ID":"c4e5a9f9-4275-4906-80fd-a4419d56d4e6","Type":"ContainerStarted","Data":"78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0"}
Jul 29 09:17:24.129306 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:24.128943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" event={"ID":"c4e5a9f9-4275-4906-80fd-a4419d56d4e6","Type":"ContainerStarted","Data":"08c4dc98b0626348a927a70f3027fc3785edd5350961c3bde64a17fecc9b41b7"}
Jul 29 09:17:24.148947 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:24.148896    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podStartSLOduration=2.148878154 podStartE2EDuration="2.148878154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:17:24.148066263 +0000 UTC m=+1792.919336338" watchObservedRunningTime="2026-07-29 09:17:24.148878154 +0000 UTC m=+1792.920148218"
Jul 29 09:17:24.291540 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:24.291506    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:24.296155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:24.296131    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:25.135319 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.135287    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:25.136337 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.136314    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:25.425096 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.425007    2564 patch_prober.go:28] interesting pod/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 09:17:25.425096 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.425076    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 09:17:25.583668 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.583635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:25.679318 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.679231    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:25.680388 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.680364    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"]
Jul 29 09:17:25.680824 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.680810    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy"
Jul 29 09:17:25.680877 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.680828    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy"
Jul 29 09:17:25.680932 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.680922    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff615a0-d469-4e07-afe1-530f0209379e" containerName="istio-proxy"
Jul 29 09:17:25.685354 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.685336    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:25.687573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.687550    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-696b6b1c-serving-cert\""
Jul 29 09:17:25.687669 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.687618    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:17:25.688044 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.688028    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:17:25.688160 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.688141    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:17:25.694502 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.694482    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"]
Jul 29 09:17:25.771219 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.771149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:25.771219 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.771212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8n52\" (UniqueName: \"kubernetes.io/projected/0ee9c227-9574-42c2-836a-ba42ab17867d-kube-api-access-g8n52\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:25.771468 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.771274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee9c227-9574-42c2-836a-ba42ab17867d-openshift-service-ca\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:25.871892 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.871849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:25.872087 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.871914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8n52\" (UniqueName: \"kubernetes.io/projected/0ee9c227-9574-42c2-836a-ba42ab17867d-kube-api-access-g8n52\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:25.872087 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:17:25.871963    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-serving-cert: secret "maas-api-e2e-ait-696b6b1c-serving-cert" not found
Jul 29 09:17:25.872087 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.871991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee9c227-9574-42c2-836a-ba42ab17867d-openshift-service-ca\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:25.872087 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:17:25.872024    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls podName:0ee9c227-9574-42c2-836a-ba42ab17867d nodeName:}" failed. No retries permitted until 2026-07-29 09:17:26.372008541 +0000 UTC m=+1795.143278584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls") pod "maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp" (UID: "0ee9c227-9574-42c2-836a-ba42ab17867d") : secret "maas-api-e2e-ait-696b6b1c-serving-cert" not found
Jul 29 09:17:25.872842 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.872818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee9c227-9574-42c2-836a-ba42ab17867d-openshift-service-ca\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:25.880980 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:25.880958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8n52\" (UniqueName: \"kubernetes.io/projected/0ee9c227-9574-42c2-836a-ba42ab17867d-kube-api-access-g8n52\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:26.065704 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.065615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:26.166190 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.166139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:26.305373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.305344    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"]
Jul 29 09:17:26.308530 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.308514    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:26.316216 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.316161    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-696b6b1c\""
Jul 29 09:17:26.323587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.323562    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"]
Jul 29 09:17:26.345104 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.345067    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"]
Jul 29 09:17:26.349613 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.349581    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:26.349860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.349842    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:26.351945 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.351924    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-696b6b1c-dockercfg-j89gs\""
Jul 29 09:17:26.355796 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.355774    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"]
Jul 29 09:17:26.376077 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.376042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4h4j\" (UniqueName: \"kubernetes.io/projected/48244fff-94d6-413f-8c91-a1d1829af2e6-kube-api-access-k4h4j\") pod \"payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq\" (UID: \"48244fff-94d6-413f-8c91-a1d1829af2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:26.376217 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.376082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-plugins-config-volume\") pod \"payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8\" (UID: \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\") " pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:26.376217 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.376104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48244fff-94d6-413f-8c91-a1d1829af2e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq\" (UID: \"48244fff-94d6-413f-8c91-a1d1829af2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:26.376217 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.376199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:26.376327 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.376235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4chxw\" (UniqueName: \"kubernetes.io/projected/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-kube-api-access-4chxw\") pod \"payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8\" (UID: \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\") " pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:26.378534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.378506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls\") pod \"maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:26.417262 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.417233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:26.477668 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.477623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4chxw\" (UniqueName: \"kubernetes.io/projected/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-kube-api-access-4chxw\") pod \"payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8\" (UID: \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\") " pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:26.477870 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.477687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4h4j\" (UniqueName: \"kubernetes.io/projected/48244fff-94d6-413f-8c91-a1d1829af2e6-kube-api-access-k4h4j\") pod \"payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq\" (UID: \"48244fff-94d6-413f-8c91-a1d1829af2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:26.477870 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.477747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-plugins-config-volume\") pod \"payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8\" (UID: \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\") " pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:26.477870 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.477766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48244fff-94d6-413f-8c91-a1d1829af2e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq\" (UID: \"48244fff-94d6-413f-8c91-a1d1829af2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:26.478465 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.478444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-plugins-config-volume\") pod \"payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8\" (UID: \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\") " pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:26.478514 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.478449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48244fff-94d6-413f-8c91-a1d1829af2e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq\" (UID: \"48244fff-94d6-413f-8c91-a1d1829af2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:26.485702 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.485681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4h4j\" (UniqueName: \"kubernetes.io/projected/48244fff-94d6-413f-8c91-a1d1829af2e6-kube-api-access-k4h4j\") pod \"payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq\" (UID: \"48244fff-94d6-413f-8c91-a1d1829af2e6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:26.485883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.485865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4chxw\" (UniqueName: \"kubernetes.io/projected/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-kube-api-access-4chxw\") pod \"payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8\" (UID: \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\") " pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:26.597628 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.597524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:26.618695 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.618669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:26.663081 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.663021    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:26.759295 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.759196    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"]
Jul 29 09:17:26.761487 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:17:26.761457    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee9c227_9574_42c2_836a_ba42ab17867d.slice/crio-089e7ff075c46d1335583488fb3e44637cad464be57afeb8648f8212c41024f4 WatchSource:0}: Error finding container 089e7ff075c46d1335583488fb3e44637cad464be57afeb8648f8212c41024f4: Status 404 returned error can't find the container with id 089e7ff075c46d1335583488fb3e44637cad464be57afeb8648f8212c41024f4
Jul 29 09:17:26.784995 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.784973    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"]
Jul 29 09:17:26.788005 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:17:26.787970    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48244fff_94d6_413f_8c91_a1d1829af2e6.slice/crio-2e180880aa7754428847edfbb77bcfb9334df9d2a5000b919ff2d78adda273ee WatchSource:0}: Error finding container 2e180880aa7754428847edfbb77bcfb9334df9d2a5000b919ff2d78adda273ee: Status 404 returned error can't find the container with id 2e180880aa7754428847edfbb77bcfb9334df9d2a5000b919ff2d78adda273ee
Jul 29 09:17:26.827027 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:26.827000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"]
Jul 29 09:17:26.829697 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:17:26.829672    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6acb0b73_97be_40d2_ae76_e27d47c8ba4a.slice/crio-d2426dc7163da2f695f0aa881a0fc4ec90bc5d73107d6da7c79faf59fa9a1f5c WatchSource:0}: Error finding container d2426dc7163da2f695f0aa881a0fc4ec90bc5d73107d6da7c79faf59fa9a1f5c: Status 404 returned error can't find the container with id d2426dc7163da2f695f0aa881a0fc4ec90bc5d73107d6da7c79faf59fa9a1f5c
Jul 29 09:17:27.145815 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.145773    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq" event={"ID":"48244fff-94d6-413f-8c91-a1d1829af2e6","Type":"ContainerStarted","Data":"7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2"}
Jul 29 09:17:27.145968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.145843    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:27.145968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.145865    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq" event={"ID":"48244fff-94d6-413f-8c91-a1d1829af2e6","Type":"ContainerStarted","Data":"2e180880aa7754428847edfbb77bcfb9334df9d2a5000b919ff2d78adda273ee"}
Jul 29 09:17:27.147088 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.147060    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp" event={"ID":"0ee9c227-9574-42c2-836a-ba42ab17867d","Type":"ContainerStarted","Data":"089e7ff075c46d1335583488fb3e44637cad464be57afeb8648f8212c41024f4"}
Jul 29 09:17:27.148449 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.148428    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8" event={"ID":"6acb0b73-97be-40d2-ae76-e27d47c8ba4a","Type":"ContainerStarted","Data":"a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86"}
Jul 29 09:17:27.148537 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.148468    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8" event={"ID":"6acb0b73-97be-40d2-ae76-e27d47c8ba4a","Type":"ContainerStarted","Data":"d2426dc7163da2f695f0aa881a0fc4ec90bc5d73107d6da7c79faf59fa9a1f5c"}
Jul 29 09:17:27.160666 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.160614    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq" podStartSLOduration=1.160597315 podStartE2EDuration="1.160597315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:17:27.159115172 +0000 UTC m=+1795.930385236" watchObservedRunningTime="2026-07-29 09:17:27.160597315 +0000 UTC m=+1795.931867380"
Jul 29 09:17:27.177785 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.177741    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8" podStartSLOduration=1.177706628 podStartE2EDuration="1.177706628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:17:27.176974462 +0000 UTC m=+1795.948244556" watchObservedRunningTime="2026-07-29 09:17:27.177706628 +0000 UTC m=+1795.948976694"
Jul 29 09:17:27.486318 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.486295    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:17:27.589467 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589437    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-socket\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.589617 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589511    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-certs\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.589617 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589529    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-data\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.589617 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589547    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istiod-ca-cert\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.589617 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589567    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-envoy\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.589617 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589588    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-podinfo\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.589617 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589610    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-credential-socket\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.589986 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589659    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsvtf\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-kube-api-access-jsvtf\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.589986 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589684    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:17:27.589986 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589745    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-token\") pod \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\" (UID: \"09a83c56-5949-4896-8ea9-00fcf2ddd51e\") "
Jul 29 09:17:27.590167 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.589989    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:27.590167 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.590034    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:17:27.590167 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.590064    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:27.590167 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.590083    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:27.590343 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.590257    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:17:27.590622 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.590597    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-data" (OuterVolumeSpecName: "istio-data") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:17:27.591874 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.591853    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:17:27.591957 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.591938    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-token" (OuterVolumeSpecName: "istio-token") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:17:27.592235 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.592216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:17:27.592296 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.592227    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-kube-api-access-jsvtf" (OuterVolumeSpecName: "kube-api-access-jsvtf") pod "09a83c56-5949-4896-8ea9-00fcf2ddd51e" (UID: "09a83c56-5949-4896-8ea9-00fcf2ddd51e"). InnerVolumeSpecName "kube-api-access-jsvtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:17:27.691247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.691187    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:27.691247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.691212    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:27.691247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.691221    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:27.691247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.691230    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsvtf\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-kube-api-access-jsvtf\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:27.691247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.691239    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:27.691247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.691249    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:27.691496 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:27.691257    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09a83c56-5949-4896-8ea9-00fcf2ddd51e-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:28.155536 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.155503    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp" event={"ID":"0ee9c227-9574-42c2-836a-ba42ab17867d","Type":"ContainerStarted","Data":"e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a"}
Jul 29 09:17:28.155734 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.155625    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:28.157032 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.157011    2564 generic.go:356] "Generic (PLEG): container finished" podID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerID="0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1" exitCode=0
Jul 29 09:17:28.157102 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.157050    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"
Jul 29 09:17:28.157102 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.157075    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" event={"ID":"09a83c56-5949-4896-8ea9-00fcf2ddd51e","Type":"ContainerDied","Data":"0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1"}
Jul 29 09:17:28.157176 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.157117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq" event={"ID":"09a83c56-5949-4896-8ea9-00fcf2ddd51e","Type":"ContainerDied","Data":"bce6759a0f2ada9ee03de15d8643ad23aea1296fdbcd1db3b0a296b2134ff728"}
Jul 29 09:17:28.157176 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.157140    2564 scope.go:117] "RemoveContainer" containerID="0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1"
Jul 29 09:17:28.157447 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.157415    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:28.167382 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.167363    2564 scope.go:117] "RemoveContainer" containerID="e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b"
Jul 29 09:17:28.171941 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.171900    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp" podStartSLOduration=2.781656722 podStartE2EDuration="3.17188553s" totalImagesPullingTime="390.228808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:17:28.171341235 +0000 UTC m=+1796.942611299" watchObservedRunningTime="2026-07-29 09:17:28.17188553 +0000 UTC m=+1796.943155597"
Jul 29 09:17:28.176129 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.176108    2564 scope.go:117] "RemoveContainer" containerID="0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1"
Jul 29 09:17:28.176383 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:17:28.176364    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1\": container with ID starting with 0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1 not found: ID does not exist" containerID="0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1"
Jul 29 09:17:28.176445 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.176393    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1"} err="failed to get container status \"0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1\": rpc error: code = NotFound desc = could not find container \"0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1\": container with ID starting with 0cb124644dc22891f0a207a1661be7082f3d2befb2db92b9d1acfd1f31cbc3b1 not found: ID does not exist"
Jul 29 09:17:28.176445 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.176410    2564 scope.go:117] "RemoveContainer" containerID="e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b"
Jul 29 09:17:28.176661 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:17:28.176646    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b\": container with ID starting with e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b not found: ID does not exist" containerID="e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b"
Jul 29 09:17:28.176735 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.176667    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b"} err="failed to get container status \"e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b\": rpc error: code = NotFound desc = could not find container \"e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b\": container with ID starting with e712337331f20ff9ad07c7b9ed85f59110f6e3a528de91ec4f5179ca1dd0b60b not found: ID does not exist"
Jul 29 09:17:28.185846 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.185824    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"]
Jul 29 09:17:28.189178 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:28.189156    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-610dc5ab-gw-openshift-default-6877d98784-xkrfq"]
Jul 29 09:17:29.761333 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:29.761300    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" path="/var/lib/kubelet/pods/09a83c56-5949-4896-8ea9-00fcf2ddd51e/volumes"
Jul 29 09:17:34.167867 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:34.167836    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:38.160464 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:38.160429    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:39.164690 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:39.164655    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:40.191146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:40.191106    2564 patch_prober.go:28] interesting pod/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": read tcp 10.132.0.2:56768->10.132.0.32:15021: read: connection reset by peer" start-of-body=
Jul 29 09:17:40.191577 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:40.191180    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": read tcp 10.132.0.2:56768->10.132.0.32:15021: read: connection reset by peer"
Jul 29 09:17:40.218703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:40.218673    2564 generic.go:356] "Generic (PLEG): container finished" podID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerID="78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0" exitCode=0
Jul 29 09:17:40.218856 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:40.218737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" event={"ID":"c4e5a9f9-4275-4906-80fd-a4419d56d4e6","Type":"ContainerDied","Data":"78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0"}
Jul 29 09:17:40.219132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:40.219113    2564 scope.go:117] "RemoveContainer" containerID="78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0"
Jul 29 09:17:40.220112 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:40.220083    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:40.220167 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:40.220154    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:40.220206 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:40.220185    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:41.227760 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:41.227703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" event={"ID":"c4e5a9f9-4275-4906-80fd-a4419d56d4e6","Type":"ContainerStarted","Data":"bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7"}
Jul 29 09:17:41.291521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:41.291492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:41.291809 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:41.291788    2564 patch_prober.go:28] interesting pod/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 29 09:17:41.291860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:41.291837    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 29 09:17:42.291812 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:42.291778    2564 patch_prober.go:28] interesting pod/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 29 09:17:42.292205 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:42.291835    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 29 09:17:43.292013 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:43.291973    2564 patch_prober.go:28] interesting pod/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 29 09:17:43.292494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:43.292049    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 29 09:17:44.291738 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:44.291684    2564 patch_prober.go:28] interesting pod/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 29 09:17:44.291923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:44.291765    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 29 09:17:45.291993 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:45.291955    2564 patch_prober.go:28] interesting pod/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 29 09:17:45.292377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:45.292013    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 29 09:17:46.294917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:46.294885    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:46.295400 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:46.295293    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:46.295942 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:46.295921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:17:56.189528 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.189494    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"]
Jul 29 09:17:56.190135 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.189757    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp" podUID="0ee9c227-9574-42c2-836a-ba42ab17867d" containerName="maas-api" containerID="cri-o://e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a" gracePeriod=30
Jul 29 09:17:56.300818 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.300785    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"]
Jul 29 09:17:56.301146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.301028    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8" podUID="6acb0b73-97be-40d2-ae76-e27d47c8ba4a" containerName="payload-processing" containerID="cri-o://a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86" gracePeriod=30
Jul 29 09:17:56.304802 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.304769    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"]
Jul 29 09:17:56.305013 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.304985    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq" podUID="48244fff-94d6-413f-8c91-a1d1829af2e6" containerName="payload-pre-processing" containerID="cri-o://7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2" gracePeriod=30
Jul 29 09:17:56.306238 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.305985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:56.397755 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.397677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:56.452306 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.452235    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:56.475594 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.475453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:56.552443 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.552406    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls\") pod \"0ee9c227-9574-42c2-836a-ba42ab17867d\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") "
Jul 29 09:17:56.552587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.552476    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8n52\" (UniqueName: \"kubernetes.io/projected/0ee9c227-9574-42c2-836a-ba42ab17867d-kube-api-access-g8n52\") pod \"0ee9c227-9574-42c2-836a-ba42ab17867d\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") "
Jul 29 09:17:56.552587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.552509    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee9c227-9574-42c2-836a-ba42ab17867d-openshift-service-ca\") pod \"0ee9c227-9574-42c2-836a-ba42ab17867d\" (UID: \"0ee9c227-9574-42c2-836a-ba42ab17867d\") "
Jul 29 09:17:56.552944 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.552918    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ee9c227-9574-42c2-836a-ba42ab17867d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ee9c227-9574-42c2-836a-ba42ab17867d" (UID: "0ee9c227-9574-42c2-836a-ba42ab17867d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:56.555353 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.555327    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ee9c227-9574-42c2-836a-ba42ab17867d-kube-api-access-g8n52" (OuterVolumeSpecName: "kube-api-access-g8n52") pod "0ee9c227-9574-42c2-836a-ba42ab17867d" (UID: "0ee9c227-9574-42c2-836a-ba42ab17867d"). InnerVolumeSpecName "kube-api-access-g8n52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:17:56.555463 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.555431    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ee9c227-9574-42c2-836a-ba42ab17867d" (UID: "0ee9c227-9574-42c2-836a-ba42ab17867d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:17:56.583040 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.583020    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:56.590956 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.590938    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:56.653292 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.653264    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ee9c227-9574-42c2-836a-ba42ab17867d-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:56.653292 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.653292    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8n52\" (UniqueName: \"kubernetes.io/projected/0ee9c227-9574-42c2-836a-ba42ab17867d-kube-api-access-g8n52\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:56.653469 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.653305    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee9c227-9574-42c2-836a-ba42ab17867d-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:56.754417 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.754330    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48244fff-94d6-413f-8c91-a1d1829af2e6-plugins-config-volume\") pod \"48244fff-94d6-413f-8c91-a1d1829af2e6\" (UID: \"48244fff-94d6-413f-8c91-a1d1829af2e6\") "
Jul 29 09:17:56.754417 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.754387    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-plugins-config-volume\") pod \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\" (UID: \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\") "
Jul 29 09:17:56.754417 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.754415    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4h4j\" (UniqueName: \"kubernetes.io/projected/48244fff-94d6-413f-8c91-a1d1829af2e6-kube-api-access-k4h4j\") pod \"48244fff-94d6-413f-8c91-a1d1829af2e6\" (UID: \"48244fff-94d6-413f-8c91-a1d1829af2e6\") "
Jul 29 09:17:56.754697 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.754495    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4chxw\" (UniqueName: \"kubernetes.io/projected/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-kube-api-access-4chxw\") pod \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\" (UID: \"6acb0b73-97be-40d2-ae76-e27d47c8ba4a\") "
Jul 29 09:17:56.754830 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.754806    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48244fff-94d6-413f-8c91-a1d1829af2e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48244fff-94d6-413f-8c91-a1d1829af2e6" (UID: "48244fff-94d6-413f-8c91-a1d1829af2e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:56.754883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.754823    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6acb0b73-97be-40d2-ae76-e27d47c8ba4a" (UID: "6acb0b73-97be-40d2-ae76-e27d47c8ba4a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:17:56.756556 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.756535    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48244fff-94d6-413f-8c91-a1d1829af2e6-kube-api-access-k4h4j" (OuterVolumeSpecName: "kube-api-access-k4h4j") pod "48244fff-94d6-413f-8c91-a1d1829af2e6" (UID: "48244fff-94d6-413f-8c91-a1d1829af2e6"). InnerVolumeSpecName "kube-api-access-k4h4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:17:56.756634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.756574    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-kube-api-access-4chxw" (OuterVolumeSpecName: "kube-api-access-4chxw") pod "6acb0b73-97be-40d2-ae76-e27d47c8ba4a" (UID: "6acb0b73-97be-40d2-ae76-e27d47c8ba4a"). InnerVolumeSpecName "kube-api-access-4chxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:17:56.855168 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.855127    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4chxw\" (UniqueName: \"kubernetes.io/projected/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-kube-api-access-4chxw\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:56.855168 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.855165    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48244fff-94d6-413f-8c91-a1d1829af2e6-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:56.855168 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.855175    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6acb0b73-97be-40d2-ae76-e27d47c8ba4a-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:56.855168 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:56.855183    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4h4j\" (UniqueName: \"kubernetes.io/projected/48244fff-94d6-413f-8c91-a1d1829af2e6-kube-api-access-k4h4j\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:17:57.302020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.301990    2564 generic.go:356] "Generic (PLEG): container finished" podID="0ee9c227-9574-42c2-836a-ba42ab17867d" containerID="e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a" exitCode=0
Jul 29 09:17:57.302508 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.302037    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"
Jul 29 09:17:57.302508 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.302070    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp" event={"ID":"0ee9c227-9574-42c2-836a-ba42ab17867d","Type":"ContainerDied","Data":"e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a"}
Jul 29 09:17:57.302508 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.302131    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp" event={"ID":"0ee9c227-9574-42c2-836a-ba42ab17867d","Type":"ContainerDied","Data":"089e7ff075c46d1335583488fb3e44637cad464be57afeb8648f8212c41024f4"}
Jul 29 09:17:57.302508 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.302170    2564 scope.go:117] "RemoveContainer" containerID="e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a"
Jul 29 09:17:57.303549 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.303519    2564 generic.go:356] "Generic (PLEG): container finished" podID="6acb0b73-97be-40d2-ae76-e27d47c8ba4a" containerID="a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86" exitCode=0
Jul 29 09:17:57.303669 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.303568    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"
Jul 29 09:17:57.303669 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.303615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8" event={"ID":"6acb0b73-97be-40d2-ae76-e27d47c8ba4a","Type":"ContainerDied","Data":"a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86"}
Jul 29 09:17:57.303669 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.303658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8" event={"ID":"6acb0b73-97be-40d2-ae76-e27d47c8ba4a","Type":"ContainerDied","Data":"d2426dc7163da2f695f0aa881a0fc4ec90bc5d73107d6da7c79faf59fa9a1f5c"}
Jul 29 09:17:57.305276 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.305251    2564 generic.go:356] "Generic (PLEG): container finished" podID="48244fff-94d6-413f-8c91-a1d1829af2e6" containerID="7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2" exitCode=0
Jul 29 09:17:57.305389 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.305305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq" event={"ID":"48244fff-94d6-413f-8c91-a1d1829af2e6","Type":"ContainerDied","Data":"7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2"}
Jul 29 09:17:57.305389 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.305318    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"
Jul 29 09:17:57.305389 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.305344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq" event={"ID":"48244fff-94d6-413f-8c91-a1d1829af2e6","Type":"ContainerDied","Data":"2e180880aa7754428847edfbb77bcfb9334df9d2a5000b919ff2d78adda273ee"}
Jul 29 09:17:57.313074 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.313052    2564 scope.go:117] "RemoveContainer" containerID="e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a"
Jul 29 09:17:57.313499 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:17:57.313470    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a\": container with ID starting with e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a not found: ID does not exist" containerID="e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a"
Jul 29 09:17:57.313575 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.313510    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a"} err="failed to get container status \"e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a\": rpc error: code = NotFound desc = could not find container \"e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a\": container with ID starting with e09856e17b8723e779289d7ab74eaa150bb0bc58842faaae0463dfc3939e1e5a not found: ID does not exist"
Jul 29 09:17:57.313575 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.313542    2564 scope.go:117] "RemoveContainer" containerID="a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86"
Jul 29 09:17:57.321091 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.321077    2564 scope.go:117] "RemoveContainer" containerID="a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86"
Jul 29 09:17:57.321321 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:17:57.321302    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86\": container with ID starting with a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86 not found: ID does not exist" containerID="a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86"
Jul 29 09:17:57.321373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.321327    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86"} err="failed to get container status \"a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86\": rpc error: code = NotFound desc = could not find container \"a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86\": container with ID starting with a9e0feba5e01bf55818d69ffb8a38360938a34ac060c1da24c26f04a6448bc86 not found: ID does not exist"
Jul 29 09:17:57.321373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.321348    2564 scope.go:117] "RemoveContainer" containerID="7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2"
Jul 29 09:17:57.326165 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.326147    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"]
Jul 29 09:17:57.328842 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.328740    2564 scope.go:117] "RemoveContainer" containerID="7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2"
Jul 29 09:17:57.329001 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:17:57.328983    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2\": container with ID starting with 7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2 not found: ID does not exist" containerID="7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2"
Jul 29 09:17:57.329043 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.329005    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2"} err="failed to get container status \"7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2\": rpc error: code = NotFound desc = could not find container \"7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2\": container with ID starting with 7477e8ca9418757d3bf32f936550aa0f84c6d89af2be0e54765a86e2d727f2d2 not found: ID does not exist"
Jul 29 09:17:57.333973 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.333952    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-696b6b1c-646cdbf8d6-b2tbp"]
Jul 29 09:17:57.347664 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.347634    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"]
Jul 29 09:17:57.348971 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.348950    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-696b6b1c-7bb8587fd-8gkg8"]
Jul 29 09:17:57.360171 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.360150    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"]
Jul 29 09:17:57.362480 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.362461    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-696b6b1c-59779c5d6d-tfvwq"]
Jul 29 09:17:57.576367 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.576289    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"]
Jul 29 09:17:57.576601 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.576573    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy" containerID="cri-o://bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7" gracePeriod=30
Jul 29 09:17:57.598974 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.598946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:57.760825 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.760785    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ee9c227-9574-42c2-836a-ba42ab17867d" path="/var/lib/kubelet/pods/0ee9c227-9574-42c2-836a-ba42ab17867d/volumes"
Jul 29 09:17:57.761239 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.761219    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48244fff-94d6-413f-8c91-a1d1829af2e6" path="/var/lib/kubelet/pods/48244fff-94d6-413f-8c91-a1d1829af2e6/volumes"
Jul 29 09:17:57.761614 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.761596    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6acb0b73-97be-40d2-ae76-e27d47c8ba4a" path="/var/lib/kubelet/pods/6acb0b73-97be-40d2-ae76-e27d47c8ba4a/volumes"
Jul 29 09:17:57.807676 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:57.807652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:58.013658 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.013624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:58.308564 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.308479    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"]
Jul 29 09:17:58.309022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.308950    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy"
Jul 29 09:17:58.309022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.308968    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy"
Jul 29 09:17:58.309022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.308979    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6acb0b73-97be-40d2-ae76-e27d47c8ba4a" containerName="payload-processing"
Jul 29 09:17:58.309022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.308987    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6acb0b73-97be-40d2-ae76-e27d47c8ba4a" containerName="payload-processing"
Jul 29 09:17:58.309022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309003    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy"
Jul 29 09:17:58.309022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309010    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy"
Jul 29 09:17:58.309022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309024    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48244fff-94d6-413f-8c91-a1d1829af2e6" containerName="payload-pre-processing"
Jul 29 09:17:58.309365 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309033    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="48244fff-94d6-413f-8c91-a1d1829af2e6" containerName="payload-pre-processing"
Jul 29 09:17:58.309365 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309045    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ee9c227-9574-42c2-836a-ba42ab17867d" containerName="maas-api"
Jul 29 09:17:58.309365 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309054    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ee9c227-9574-42c2-836a-ba42ab17867d" containerName="maas-api"
Jul 29 09:17:58.309365 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309120    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6acb0b73-97be-40d2-ae76-e27d47c8ba4a" containerName="payload-processing"
Jul 29 09:17:58.309365 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309134    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy"
Jul 29 09:17:58.309365 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309143    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="48244fff-94d6-413f-8c91-a1d1829af2e6" containerName="payload-pre-processing"
Jul 29 09:17:58.309365 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.309153    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ee9c227-9574-42c2-836a-ba42ab17867d" containerName="maas-api"
Jul 29 09:17:58.312401 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.312379    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.314783 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.314762    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3cfa77ca-openshift-default-dockercfg-fsj4t\""
Jul 29 09:17:58.323283 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.323262    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"]
Jul 29 09:17:58.351835 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.351799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:58.469144 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d82c3142-c793-43d8-b08d-128ac8653a82-istiod-ca-cert\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.469314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-istio-token\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.469314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-certs\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.469314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqdwq\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-kube-api-access-gqdwq\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.469452 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-socket\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.469452 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-credential-socket\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.469452 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-data\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.469452 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-envoy\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.469598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.469459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d82c3142-c793-43d8-b08d-128ac8653a82-istio-podinfo\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570642 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-envoy\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570642 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d82c3142-c793-43d8-b08d-128ac8653a82-istio-podinfo\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570642 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d82c3142-c793-43d8-b08d-128ac8653a82-istiod-ca-cert\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570961 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-istio-token\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570961 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-certs\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570961 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqdwq\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-kube-api-access-gqdwq\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570961 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-socket\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570961 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-credential-socket\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.570961 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.570903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-data\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.571287 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.571199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-data\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.571287 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.571242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-certs\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.571287 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.571271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-socket\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.571492 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.571457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-credential-socket\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.571618 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.571482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d82c3142-c793-43d8-b08d-128ac8653a82-istiod-ca-cert\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.573016 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.572997    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-envoy\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.573540 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.573516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d82c3142-c793-43d8-b08d-128ac8653a82-istio-podinfo\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.578586 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.578561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqdwq\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-kube-api-access-gqdwq\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.578804 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.578781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-istio-token\") pod \"e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") " pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.623651 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.623629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:58.757097 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.757040    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"]
Jul 29 09:17:58.759360 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:17:58.759327    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82c3142_c793_43d8_b08d_128ac8653a82.slice/crio-2e30c6f7f43b4787eb3836dacfeb7580f7acb660a3a943907b4aa8351acc42ba WatchSource:0}: Error finding container 2e30c6f7f43b4787eb3836dacfeb7580f7acb660a3a943907b4aa8351acc42ba: Status 404 returned error can't find the container with id 2e30c6f7f43b4787eb3836dacfeb7580f7acb660a3a943907b4aa8351acc42ba
Jul 29 09:17:58.761569 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.761536    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:58.761629 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.761618    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:58.761665 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.761650    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:17:58.921055 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:58.921004    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:17:59.321959 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:59.321872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" event={"ID":"d82c3142-c793-43d8-b08d-128ac8653a82","Type":"ContainerStarted","Data":"3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c"}
Jul 29 09:17:59.321959 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:59.321933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" event={"ID":"d82c3142-c793-43d8-b08d-128ac8653a82","Type":"ContainerStarted","Data":"2e30c6f7f43b4787eb3836dacfeb7580f7acb660a3a943907b4aa8351acc42ba"}
Jul 29 09:17:59.341538 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:59.341493    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" podStartSLOduration=1.341476658 podStartE2EDuration="1.341476658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:17:59.340881682 +0000 UTC m=+1828.112151747" watchObservedRunningTime="2026-07-29 09:17:59.341476658 +0000 UTC m=+1828.112746792"
Jul 29 09:17:59.624689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:59.624657    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:17:59.629618 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:17:59.629592    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:00.326803 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.326772    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:00.327625 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.327607    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:00.766040 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.766007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:00.775691 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.775660    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"]
Jul 29 09:18:00.776075 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.776060    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="09a83c56-5949-4896-8ea9-00fcf2ddd51e" containerName="istio-proxy"
Jul 29 09:18:00.778204 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.778156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:00.780541 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.780513    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:18:00.780669 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.780522    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:18:00.780948 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.780928    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-3cfa77ca-serving-cert\""
Jul 29 09:18:00.781094 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.780934    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:18:00.791813 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.791786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"]
Jul 29 09:18:00.859191 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.859162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:00.892860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.892825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:00.893061 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.892965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsqqt\" (UniqueName: \"kubernetes.io/projected/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-kube-api-access-wsqqt\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:00.893132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.893094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-openshift-service-ca\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:00.994512 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.994473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsqqt\" (UniqueName: \"kubernetes.io/projected/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-kube-api-access-wsqqt\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:00.994689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.994536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-openshift-service-ca\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:00.994689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.994571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:00.994689 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:00.994662    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-serving-cert: secret "maas-api-e2e-derive-3cfa77ca-serving-cert" not found
Jul 29 09:18:00.994838 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:00.994729    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls podName:2d1a1b35-e6f1-429c-aec2-401cdc0f22b6 nodeName:}" failed. No retries permitted until 2026-07-29 09:18:01.494700703 +0000 UTC m=+1830.265970745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls") pod "maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk" (UID: "2d1a1b35-e6f1-429c-aec2-401cdc0f22b6") : secret "maas-api-e2e-derive-3cfa77ca-serving-cert" not found
Jul 29 09:18:00.995208 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:00.995187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-openshift-service-ca\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:01.002758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.002736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsqqt\" (UniqueName: \"kubernetes.io/projected/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-kube-api-access-wsqqt\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:01.192343 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.192304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:01.297708 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.297662    2564 patch_prober.go:28] interesting pod/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 09:18:01.297877 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.297751    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 09:18:01.366737 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.366683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:01.464899 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.464809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:01.476643 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.476608    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"]
Jul 29 09:18:01.480004 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.479977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:01.483136 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.482640    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-3cfa77ca-dockercfg-wj72k\""
Jul 29 09:18:01.483136 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.482993    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-3cfa77ca\""
Jul 29 09:18:01.490940 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.490910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"]
Jul 29 09:18:01.499439 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.499401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:01.501870 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.501846    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"]
Jul 29 09:18:01.502244 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.502223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls\") pod \"maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:01.504210 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.504191    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:01.515496 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.515462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"]
Jul 29 09:18:01.600280 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.600245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9txlp\" (UniqueName: \"kubernetes.io/projected/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-kube-api-access-9txlp\") pod \"payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh\" (UID: \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:01.600529 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.600314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-plugins-config-volume\") pod \"payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs\" (UID: \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\") " pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:01.600529 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.600433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w76z\" (UniqueName: \"kubernetes.io/projected/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-kube-api-access-9w76z\") pod \"payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs\" (UID: \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\") " pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:01.600529 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.600493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh\" (UID: \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:01.692550 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.692505    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:01.701886 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.701855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh\" (UID: \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:01.702015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.701920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txlp\" (UniqueName: \"kubernetes.io/projected/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-kube-api-access-9txlp\") pod \"payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh\" (UID: \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:01.702015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.701969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-plugins-config-volume\") pod \"payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs\" (UID: \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\") " pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:01.702015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.702011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w76z\" (UniqueName: \"kubernetes.io/projected/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-kube-api-access-9w76z\") pod \"payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs\" (UID: \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\") " pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:01.702670 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.702647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh\" (UID: \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:01.702810 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.702791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-plugins-config-volume\") pod \"payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs\" (UID: \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\") " pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:01.717852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.717783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9txlp\" (UniqueName: \"kubernetes.io/projected/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-kube-api-access-9txlp\") pod \"payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh\" (UID: \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:01.718264 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.718239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w76z\" (UniqueName: \"kubernetes.io/projected/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-kube-api-access-9w76z\") pod \"payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs\" (UID: \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\") " pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:01.793972 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.793897    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:01.821457 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.821423    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:01.839357 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.839319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"]
Jul 29 09:18:01.841080 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:18:01.841046    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1a1b35_e6f1_429c_aec2_401cdc0f22b6.slice/crio-836e60c46d9479eab116a3819d9862626c8f19608463c62c9c48c73da0f4331c WatchSource:0}: Error finding container 836e60c46d9479eab116a3819d9862626c8f19608463c62c9c48c73da0f4331c: Status 404 returned error can't find the container with id 836e60c46d9479eab116a3819d9862626c8f19608463c62c9c48c73da0f4331c
Jul 29 09:18:01.943838 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.943785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"]
Jul 29 09:18:01.946040 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:18:01.946011    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f6d8c9_452e_4352_bb1f_2d35a6dd9d01.slice/crio-fd07bab33f1ddb9092934ab0461ecf3d5a8c727291b126415e5a96ca952172eb WatchSource:0}: Error finding container fd07bab33f1ddb9092934ab0461ecf3d5a8c727291b126415e5a96ca952172eb: Status 404 returned error can't find the container with id fd07bab33f1ddb9092934ab0461ecf3d5a8c727291b126415e5a96ca952172eb
Jul 29 09:18:01.971980 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:01.971954    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"]
Jul 29 09:18:01.974079 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:18:01.974048    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bfeb32_abb7_44e6_a23c_46de7b7a34c2.slice/crio-a0bfdab2780d034b654eef70a1e8f3c4c092ae62b6693e2197cfc8e93112add2 WatchSource:0}: Error finding container a0bfdab2780d034b654eef70a1e8f3c4c092ae62b6693e2197cfc8e93112add2: Status 404 returned error can't find the container with id a0bfdab2780d034b654eef70a1e8f3c4c092ae62b6693e2197cfc8e93112add2
Jul 29 09:18:02.339938 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.339851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs" event={"ID":"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2","Type":"ContainerStarted","Data":"42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8"}
Jul 29 09:18:02.339938 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.339909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs" event={"ID":"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2","Type":"ContainerStarted","Data":"a0bfdab2780d034b654eef70a1e8f3c4c092ae62b6693e2197cfc8e93112add2"}
Jul 29 09:18:02.339938 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.339938    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:02.341112 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.341085    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk" event={"ID":"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6","Type":"ContainerStarted","Data":"836e60c46d9479eab116a3819d9862626c8f19608463c62c9c48c73da0f4331c"}
Jul 29 09:18:02.345790 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.345763    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh" event={"ID":"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01","Type":"ContainerStarted","Data":"e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e"}
Jul 29 09:18:02.345908 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.345815    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh" event={"ID":"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01","Type":"ContainerStarted","Data":"fd07bab33f1ddb9092934ab0461ecf3d5a8c727291b126415e5a96ca952172eb"}
Jul 29 09:18:02.368001 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.367945    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs" podStartSLOduration=1.367929134 podStartE2EDuration="1.367929134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:18:02.365859143 +0000 UTC m=+1831.137129238" watchObservedRunningTime="2026-07-29 09:18:02.367929134 +0000 UTC m=+1831.139199214"
Jul 29 09:18:02.392578 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.392528    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh" podStartSLOduration=1.392507246 podStartE2EDuration="1.392507246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:18:02.389827061 +0000 UTC m=+1831.161097144" watchObservedRunningTime="2026-07-29 09:18:02.392507246 +0000 UTC m=+1831.163777311"
Jul 29 09:18:02.831053 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:02.831028    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:18:03.017283 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017248    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkp48\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-kube-api-access-kkp48\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017474 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017310    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-data\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017474 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-socket\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017474 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-certs\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017631 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017505    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-credential-socket\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017631 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017585    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-token\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017639    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istiod-ca-cert\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017673    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-podinfo\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017698    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-envoy\") pod \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\" (UID: \"c4e5a9f9-4275-4906-80fd-a4419d56d4e6\") "
Jul 29 09:18:03.017758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017739    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:03.017965 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017749    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:03.018020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.017984    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.018020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.018003    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.018261 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.018233    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:03.018314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.018264    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:03.018368 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.018349    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:18:03.019682 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.019649    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-kube-api-access-kkp48" (OuterVolumeSpecName: "kube-api-access-kkp48") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "kube-api-access-kkp48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:18:03.020014 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.019993    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:03.020138 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.020118    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:18:03.020260 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.020244    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4e5a9f9-4275-4906-80fd-a4419d56d4e6" (UID: "c4e5a9f9-4275-4906-80fd-a4419d56d4e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:18:03.119300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.119259    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.119300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.119297    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.119494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.119312    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.119494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.119326    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.119494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.119340    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.119494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.119355    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkp48\" (UniqueName: \"kubernetes.io/projected/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-kube-api-access-kkp48\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.119494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.119369    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4e5a9f9-4275-4906-80fd-a4419d56d4e6-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:03.351667 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.351580    2564 generic.go:356] "Generic (PLEG): container finished" podID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerID="bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7" exitCode=0
Jul 29 09:18:03.351667 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.351623    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"
Jul 29 09:18:03.351919 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.351672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" event={"ID":"c4e5a9f9-4275-4906-80fd-a4419d56d4e6","Type":"ContainerDied","Data":"bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7"}
Jul 29 09:18:03.351919 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.351746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft" event={"ID":"c4e5a9f9-4275-4906-80fd-a4419d56d4e6","Type":"ContainerDied","Data":"08c4dc98b0626348a927a70f3027fc3785edd5350961c3bde64a17fecc9b41b7"}
Jul 29 09:18:03.351919 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.351790    2564 scope.go:117] "RemoveContainer" containerID="bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7"
Jul 29 09:18:03.353351 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.353326    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk" event={"ID":"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6","Type":"ContainerStarted","Data":"9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612"}
Jul 29 09:18:03.353460 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.353392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:03.353658 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.353636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:03.361033 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.361013    2564 scope.go:117] "RemoveContainer" containerID="78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0"
Jul 29 09:18:03.368261 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.368243    2564 scope.go:117] "RemoveContainer" containerID="bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7"
Jul 29 09:18:03.368555 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:03.368481    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7\": container with ID starting with bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7 not found: ID does not exist" containerID="bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7"
Jul 29 09:18:03.368555 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.368506    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7"} err="failed to get container status \"bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7\": rpc error: code = NotFound desc = could not find container \"bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7\": container with ID starting with bdc43fab89ca3c350c1898116530f34b5d50fe3adcb2911d3ce9517b55a69ff7 not found: ID does not exist"
Jul 29 09:18:03.368555 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.368521    2564 scope.go:117] "RemoveContainer" containerID="78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0"
Jul 29 09:18:03.368749 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:03.368733    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0\": container with ID starting with 78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0 not found: ID does not exist" containerID="78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0"
Jul 29 09:18:03.368789 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.368753    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0"} err="failed to get container status \"78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0\": rpc error: code = NotFound desc = could not find container \"78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0\": container with ID starting with 78fd15c0f3e3972da3a1176710172001802db877eea085ed997afd97678364a0 not found: ID does not exist"
Jul 29 09:18:03.371377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.371338    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk" podStartSLOduration=2.840135814 podStartE2EDuration="3.371325292s" totalImagesPullingTime="531.189478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:18:03.370157945 +0000 UTC m=+1832.141428009" watchObservedRunningTime="2026-07-29 09:18:03.371325292 +0000 UTC m=+1832.142595369"
Jul 29 09:18:03.384945 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.384920    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"]
Jul 29 09:18:03.390149 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.390127    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-696b6b1c-openshift-default-7f5477bb-bvkft"]
Jul 29 09:18:03.766436 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:03.766398    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" path="/var/lib/kubelet/pods/c4e5a9f9-4275-4906-80fd-a4419d56d4e6/volumes"
Jul 29 09:18:09.364592 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:09.364562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:13.356274 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:13.356241    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:14.360690 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:14.360646    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh" podUID="90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.38:9004: connect: connection refused"
Jul 29 09:18:16.099885 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:16.099414    2564 patch_prober.go:28] interesting pod/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": read tcp 10.132.0.2:39740->10.132.0.36:15021: read: connection reset by peer" start-of-body=
Jul 29 09:18:16.099885 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:16.099484    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": read tcp 10.132.0.2:39740->10.132.0.36:15021: read: connection reset by peer"
Jul 29 09:18:16.416411 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:16.416377    2564 generic.go:356] "Generic (PLEG): container finished" podID="d82c3142-c793-43d8-b08d-128ac8653a82" containerID="3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c" exitCode=0
Jul 29 09:18:16.416598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:16.416437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" event={"ID":"d82c3142-c793-43d8-b08d-128ac8653a82","Type":"ContainerDied","Data":"3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c"}
Jul 29 09:18:16.416883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:16.416864    2564 scope.go:117] "RemoveContainer" containerID="3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c"
Jul 29 09:18:16.417891 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:16.417858    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:18:16.417991 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:16.417945    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:18:16.418055 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:16.418017    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:18:17.426431 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:17.426387    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" event={"ID":"d82c3142-c793-43d8-b08d-128ac8653a82","Type":"ContainerStarted","Data":"21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373"}
Jul 29 09:18:17.624032 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:17.623941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:17.624634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:17.624606    2564 patch_prober.go:28] interesting pod/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 29 09:18:17.624856 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:17.624830    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 29 09:18:18.624141 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:18.624098    2564 patch_prober.go:28] interesting pod/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 29 09:18:18.624582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:18.624165    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 29 09:18:19.624479 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:19.624424    2564 patch_prober.go:28] interesting pod/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 29 09:18:19.624905 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:19.624495    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 29 09:18:20.624440 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:20.624392    2564 patch_prober.go:28] interesting pod/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 29 09:18:20.624600 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:20.624459    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 29 09:18:21.627887 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:21.627853    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:21.628301 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:21.628117    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:21.628710 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:21.628689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:24.359777 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:24.359749    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:31.462886 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.462850    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"]
Jul 29 09:18:31.463483 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.463113    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk" podUID="2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" containerName="maas-api" containerID="cri-o://9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612" gracePeriod=30
Jul 29 09:18:31.563741 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.562432    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"]
Jul 29 09:18:31.563741 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.562661    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs" podUID="b3bfeb32-abb7-44e6-a23c-46de7b7a34c2" containerName="payload-processing" containerID="cri-o://42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8" gracePeriod=30
Jul 29 09:18:31.580068 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.576534    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"]
Jul 29 09:18:31.589583 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.586338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:31.589848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.589796    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh" podUID="90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" containerName="payload-pre-processing" containerID="cri-o://e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e" gracePeriod=30
Jul 29 09:18:31.675140 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.675111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:31.738899 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.738579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:31.747649 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.747208    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:31.833805 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.833775    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"]
Jul 29 09:18:31.834175 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.834139    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy" containerID="cri-o://21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373" gracePeriod=30
Jul 29 09:18:31.852840 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.852808    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:31.869911 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.869878    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-openshift-service-ca\") pod \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") "
Jul 29 09:18:31.870026 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.869936    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls\") pod \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") "
Jul 29 09:18:31.870081 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.870047    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsqqt\" (UniqueName: \"kubernetes.io/projected/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-kube-api-access-wsqqt\") pod \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\" (UID: \"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6\") "
Jul 29 09:18:31.870227 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.870199    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" (UID: "2d1a1b35-e6f1-429c-aec2-401cdc0f22b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:18:31.870422 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.870385    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:31.872169 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.872143    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-kube-api-access-wsqqt" (OuterVolumeSpecName: "kube-api-access-wsqqt") pod "2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" (UID: "2d1a1b35-e6f1-429c-aec2-401cdc0f22b6"). InnerVolumeSpecName "kube-api-access-wsqqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:18:31.872280 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.872251    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" (UID: "2d1a1b35-e6f1-429c-aec2-401cdc0f22b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:18:31.877607 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.877588    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:31.879693 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.879677    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:31.971782 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.971690    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-plugins-config-volume\") pod \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\" (UID: \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\") "
Jul 29 09:18:31.971944 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.971826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w76z\" (UniqueName: \"kubernetes.io/projected/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-kube-api-access-9w76z\") pod \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\" (UID: \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\") "
Jul 29 09:18:31.971944 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.971861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-plugins-config-volume\") pod \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\" (UID: \"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2\") "
Jul 29 09:18:31.971944 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.971880    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9txlp\" (UniqueName: \"kubernetes.io/projected/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-kube-api-access-9txlp\") pod \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\" (UID: \"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01\") "
Jul 29 09:18:31.972111 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.972054    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:31.972111 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.972067    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsqqt\" (UniqueName: \"kubernetes.io/projected/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6-kube-api-access-wsqqt\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:31.972212 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.972185    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" (UID: "90f6d8c9-452e-4352-bb1f-2d35a6dd9d01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:18:31.972263 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.972221    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3bfeb32-abb7-44e6-a23c-46de7b7a34c2" (UID: "b3bfeb32-abb7-44e6-a23c-46de7b7a34c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:18:31.973990 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.973964    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-kube-api-access-9txlp" (OuterVolumeSpecName: "kube-api-access-9txlp") pod "90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" (UID: "90f6d8c9-452e-4352-bb1f-2d35a6dd9d01"). InnerVolumeSpecName "kube-api-access-9txlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:18:31.974082 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:31.974053    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-kube-api-access-9w76z" (OuterVolumeSpecName: "kube-api-access-9w76z") pod "b3bfeb32-abb7-44e6-a23c-46de7b7a34c2" (UID: "b3bfeb32-abb7-44e6-a23c-46de7b7a34c2"). InnerVolumeSpecName "kube-api-access-9w76z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:18:32.076398 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.073589    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:32.076398 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.073621    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w76z\" (UniqueName: \"kubernetes.io/projected/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-kube-api-access-9w76z\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:32.076398 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.073636    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:32.076398 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.073649    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9txlp\" (UniqueName: \"kubernetes.io/projected/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01-kube-api-access-9txlp\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:32.080251 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.080218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:32.498587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.498554    2564 generic.go:356] "Generic (PLEG): container finished" podID="2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" containerID="9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612" exitCode=0
Jul 29 09:18:32.499069 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.498602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk" event={"ID":"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6","Type":"ContainerDied","Data":"9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612"}
Jul 29 09:18:32.499069 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.498624    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"
Jul 29 09:18:32.499069 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.498685    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk" event={"ID":"2d1a1b35-e6f1-429c-aec2-401cdc0f22b6","Type":"ContainerDied","Data":"836e60c46d9479eab116a3819d9862626c8f19608463c62c9c48c73da0f4331c"}
Jul 29 09:18:32.499069 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.498727    2564 scope.go:117] "RemoveContainer" containerID="9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612"
Jul 29 09:18:32.499917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.499803    2564 generic.go:356] "Generic (PLEG): container finished" podID="90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" containerID="e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e" exitCode=0
Jul 29 09:18:32.499917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.499831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh" event={"ID":"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01","Type":"ContainerDied","Data":"e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e"}
Jul 29 09:18:32.499917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.499866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh" event={"ID":"90f6d8c9-452e-4352-bb1f-2d35a6dd9d01","Type":"ContainerDied","Data":"fd07bab33f1ddb9092934ab0461ecf3d5a8c727291b126415e5a96ca952172eb"}
Jul 29 09:18:32.499917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.499872    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"
Jul 29 09:18:32.501124 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.501089    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3bfeb32-abb7-44e6-a23c-46de7b7a34c2" containerID="42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8" exitCode=0
Jul 29 09:18:32.501247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.501147    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"
Jul 29 09:18:32.501247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.501148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs" event={"ID":"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2","Type":"ContainerDied","Data":"42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8"}
Jul 29 09:18:32.501247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.501194    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs" event={"ID":"b3bfeb32-abb7-44e6-a23c-46de7b7a34c2","Type":"ContainerDied","Data":"a0bfdab2780d034b654eef70a1e8f3c4c092ae62b6693e2197cfc8e93112add2"}
Jul 29 09:18:32.509053 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.509036    2564 scope.go:117] "RemoveContainer" containerID="9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612"
Jul 29 09:18:32.509468 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:32.509288    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612\": container with ID starting with 9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612 not found: ID does not exist" containerID="9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612"
Jul 29 09:18:32.509468 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.509326    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612"} err="failed to get container status \"9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612\": rpc error: code = NotFound desc = could not find container \"9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612\": container with ID starting with 9a49ae047c9a72359c2838c753f811fdb6f73a27707ba9a2c9164363c8953612 not found: ID does not exist"
Jul 29 09:18:32.509468 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.509344    2564 scope.go:117] "RemoveContainer" containerID="e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e"
Jul 29 09:18:32.517571 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.517554    2564 scope.go:117] "RemoveContainer" containerID="e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e"
Jul 29 09:18:32.517815 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:32.517798    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e\": container with ID starting with e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e not found: ID does not exist" containerID="e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e"
Jul 29 09:18:32.517882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.517821    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e"} err="failed to get container status \"e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e\": rpc error: code = NotFound desc = could not find container \"e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e\": container with ID starting with e17a9763ad687b7bcfbdc6db53e260080ea3058089288d2475a043aa6229d26e not found: ID does not exist"
Jul 29 09:18:32.517882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.517836    2564 scope.go:117] "RemoveContainer" containerID="42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8"
Jul 29 09:18:32.524868 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.524853    2564 scope.go:117] "RemoveContainer" containerID="42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8"
Jul 29 09:18:32.525111 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:32.525092    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8\": container with ID starting with 42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8 not found: ID does not exist" containerID="42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8"
Jul 29 09:18:32.525158 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.525117    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8"} err="failed to get container status \"42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8\": rpc error: code = NotFound desc = could not find container \"42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8\": container with ID starting with 42702414b34e0d617b3326624e1bca0c1b83b67c2bd34459ee0fb6e87e5661c8 not found: ID does not exist"
Jul 29 09:18:32.561766 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.561741    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"]
Jul 29 09:18:32.571108 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.571088    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3cfa77ca-59dc8477fb-49rxh"]
Jul 29 09:18:32.602166 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.602139    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"]
Jul 29 09:18:32.627911 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.627882    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-3cfa77ca-566c7bf586-cvgcs"]
Jul 29 09:18:32.633442 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.633418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:32.648782 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.648759    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"]
Jul 29 09:18:32.654667 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.654649    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3cfa77ca-cb7bb9cb9-h79jk"]
Jul 29 09:18:32.765592 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:32.765531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:33.760461 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:33.760421    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" path="/var/lib/kubelet/pods/2d1a1b35-e6f1-429c-aec2-401cdc0f22b6/volumes"
Jul 29 09:18:33.760852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:33.760808    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" path="/var/lib/kubelet/pods/90f6d8c9-452e-4352-bb1f-2d35a6dd9d01/volumes"
Jul 29 09:18:33.761130 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:33.761118    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3bfeb32-abb7-44e6-a23c-46de7b7a34c2" path="/var/lib/kubelet/pods/b3bfeb32-abb7-44e6-a23c-46de7b7a34c2/volumes"
Jul 29 09:18:34.090075 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:34.089985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:36.630558 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:36.630517    2564 patch_prober.go:28] interesting pod/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 09:18:36.630974 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:36.630591    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 09:18:37.090990 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.090965    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:37.219468 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219362    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-socket\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.219468 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-istio-token\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.219745 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219492    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d82c3142-c793-43d8-b08d-128ac8653a82-istio-podinfo\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.219745 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219520    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-certs\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.219745 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqdwq\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-kube-api-access-gqdwq\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.219745 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-data\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.219966 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219741    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:37.219966 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219748    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-envoy\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.219966 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219807    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d82c3142-c793-43d8-b08d-128ac8653a82-istiod-ca-cert\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.219966 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.219835    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-credential-socket\") pod \"d82c3142-c793-43d8-b08d-128ac8653a82\" (UID: \"d82c3142-c793-43d8-b08d-128ac8653a82\") "
Jul 29 09:18:37.220172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.220140    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.220229 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.220202    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:37.220229 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.220211    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d82c3142-c793-43d8-b08d-128ac8653a82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:18:37.220341 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.220279    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:37.220652 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.220625    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-data" (OuterVolumeSpecName: "istio-data") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:37.221827 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.221798    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-kube-api-access-gqdwq" (OuterVolumeSpecName: "kube-api-access-gqdwq") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "kube-api-access-gqdwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:18:37.221827 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.221811    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:18:37.221963 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.221858    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-istio-token" (OuterVolumeSpecName: "istio-token") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:18:37.222151 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.222136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d82c3142-c793-43d8-b08d-128ac8653a82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d82c3142-c793-43d8-b08d-128ac8653a82" (UID: "d82c3142-c793-43d8-b08d-128ac8653a82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:18:37.320801 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.320762    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d82c3142-c793-43d8-b08d-128ac8653a82-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.320801 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.320795    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.320801 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.320806    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqdwq\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-kube-api-access-gqdwq\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.321038 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.320817    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.321038 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.320826    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.321038 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.320833    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d82c3142-c793-43d8-b08d-128ac8653a82-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.321038 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.320841    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d82c3142-c793-43d8-b08d-128ac8653a82-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.321038 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.320849    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d82c3142-c793-43d8-b08d-128ac8653a82-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:18:37.525674 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.525577    2564 generic.go:356] "Generic (PLEG): container finished" podID="d82c3142-c793-43d8-b08d-128ac8653a82" containerID="21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373" exitCode=0
Jul 29 09:18:37.525674 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.525638    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"
Jul 29 09:18:37.525674 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.525648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" event={"ID":"d82c3142-c793-43d8-b08d-128ac8653a82","Type":"ContainerDied","Data":"21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373"}
Jul 29 09:18:37.525972 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.525756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6" event={"ID":"d82c3142-c793-43d8-b08d-128ac8653a82","Type":"ContainerDied","Data":"2e30c6f7f43b4787eb3836dacfeb7580f7acb660a3a943907b4aa8351acc42ba"}
Jul 29 09:18:37.525972 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.525789    2564 scope.go:117] "RemoveContainer" containerID="21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373"
Jul 29 09:18:37.534614 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.534599    2564 scope.go:117] "RemoveContainer" containerID="3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c"
Jul 29 09:18:37.541861 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.541842    2564 scope.go:117] "RemoveContainer" containerID="21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373"
Jul 29 09:18:37.542086 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:37.542068    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373\": container with ID starting with 21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373 not found: ID does not exist" containerID="21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373"
Jul 29 09:18:37.542140 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.542093    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373"} err="failed to get container status \"21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373\": rpc error: code = NotFound desc = could not find container \"21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373\": container with ID starting with 21b048ef8058800b4bf475ca85f57245d457b0f4474ffc4b0f28a86d6dc8f373 not found: ID does not exist"
Jul 29 09:18:37.542140 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.542108    2564 scope.go:117] "RemoveContainer" containerID="3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c"
Jul 29 09:18:37.542347 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:18:37.542331    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c\": container with ID starting with 3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c not found: ID does not exist" containerID="3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c"
Jul 29 09:18:37.542391 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.542351    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c"} err="failed to get container status \"3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c\": rpc error: code = NotFound desc = could not find container \"3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c\": container with ID starting with 3edeb0ab0896c731b2830f4d33f89ab9fa3d043fc0abb22e1032a051940daf5c not found: ID does not exist"
Jul 29 09:18:37.547189 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.547169    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"]
Jul 29 09:18:37.552518 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.552496    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3cfa77ca-openshift-default-5d9958476-s8wx6"]
Jul 29 09:18:37.760289 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:37.760261    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" path="/var/lib/kubelet/pods/d82c3142-c793-43d8-b08d-128ac8653a82/volumes"
Jul 29 09:18:39.980787 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:39.980760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:40.090501 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:40.090469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:40.181022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:40.180989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:40.280709 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:40.280630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:18:40.665977 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:18:40.665948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:06.632222 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:06.632103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:12.692766 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:12.692707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:12.797402 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:12.797370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:12.897473 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:12.897444    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:28.730624 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:28.730586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:34.492004 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:34.491967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:34.617041 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:34.616989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:34.727987 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:34.727947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:45.190664 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:45.190629    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:46.077570 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:46.077538    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:52.371015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:52.370980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:52.482856 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:52.482823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:52.572295 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:52.572258    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:52.675816 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:52.675786    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:57.744999 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:57.744961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:57.845912 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:57.845873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:57.946972 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:57.946931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:19:59.689989 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:19:59.689952    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:06.463044 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:06.463003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:06.559740 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:06.559684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:07.099202 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:07.099168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:12.928213 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:12.928175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:13.019777 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.019739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:13.181412 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.181324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:13.429185 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429152    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"]
Jul 29 09:20:13.429635 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429617    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy"
Jul 29 09:20:13.429703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429637    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy"
Jul 29 09:20:13.429703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429652    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bfeb32-abb7-44e6-a23c-46de7b7a34c2" containerName="payload-processing"
Jul 29 09:20:13.429703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429661    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bfeb32-abb7-44e6-a23c-46de7b7a34c2" containerName="payload-processing"
Jul 29 09:20:13.429703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429688    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy"
Jul 29 09:20:13.429703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429697    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429707    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429731    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429742    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" containerName="payload-pre-processing"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429750    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" containerName="payload-pre-processing"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429765    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429773    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429784    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" containerName="maas-api"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429792    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" containerName="maas-api"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429855    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="90f6d8c9-452e-4352-bb1f-2d35a6dd9d01" containerName="payload-pre-processing"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429866    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d1a1b35-e6f1-429c-aec2-401cdc0f22b6" containerName="maas-api"
Jul 29 09:20:13.429882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429878    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy"
Jul 29 09:20:13.430210 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429887    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3bfeb32-abb7-44e6-a23c-46de7b7a34c2" containerName="payload-processing"
Jul 29 09:20:13.430210 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429897    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy"
Jul 29 09:20:13.430210 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429906    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e5a9f9-4275-4906-80fd-a4419d56d4e6" containerName="istio-proxy"
Jul 29 09:20:13.430210 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.429915    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d82c3142-c793-43d8-b08d-128ac8653a82" containerName="istio-proxy"
Jul 29 09:20:13.433436 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.433373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.435538 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.435517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6f2e14d7-openshift-default-dockercfg-g8hv7\""
Jul 29 09:20:13.456394 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.456364    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"]
Jul 29 09:20:13.460708 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.460682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:13.538195 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4wg6\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-kube-api-access-n4wg6\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.538380 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-certs\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.538380 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d53f84-5fd6-4992-9caa-b5215007a246-istiod-ca-cert\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.538380 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-istio-token\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.538380 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-credential-socket\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.538380 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d53f84-5fd6-4992-9caa-b5215007a246-istio-podinfo\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.538704 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-envoy\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.538704 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-data\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.538704 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.538447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-socket\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639101 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-istio-token\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639101 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639105    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-credential-socket\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d53f84-5fd6-4992-9caa-b5215007a246-istio-podinfo\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-envoy\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-data\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639539 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-socket\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639539 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4wg6\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-kube-api-access-n4wg6\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639539 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639496    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-credential-socket\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639698 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-certs\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639698 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d53f84-5fd6-4992-9caa-b5215007a246-istiod-ca-cert\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.639838 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-data\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.640026 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.639983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-certs\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.640026 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.640012    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-socket\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.640317 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.640299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d53f84-5fd6-4992-9caa-b5215007a246-istiod-ca-cert\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.641653 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.641624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-envoy\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.641928 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.641908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d53f84-5fd6-4992-9caa-b5215007a246-istio-podinfo\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.647846 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.647803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-istio-token\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.647846 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.647810    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4wg6\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-kube-api-access-n4wg6\") pod \"e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") " pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.744049 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.743948    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:13.882057 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.882019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"]
Jul 29 09:20:13.885253 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:20:13.885223    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d53f84_5fd6_4992_9caa_b5215007a246.slice/crio-2fe31a7d875f2ca2ae2718602cc06032765f20c69c95c5179996698770c1a7c5 WatchSource:0}: Error finding container 2fe31a7d875f2ca2ae2718602cc06032765f20c69c95c5179996698770c1a7c5: Status 404 returned error can't find the container with id 2fe31a7d875f2ca2ae2718602cc06032765f20c69c95c5179996698770c1a7c5
Jul 29 09:20:13.887955 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.887913    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:20:13.888051 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.888004    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:20:13.888101 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.888049    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:20:13.953694 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.953665    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" event={"ID":"62d53f84-5fd6-4992-9caa-b5215007a246","Type":"ContainerStarted","Data":"d1fad60729cace80824da9bc3321df5766906efae61a3f7a3e675b3b763238d0"}
Jul 29 09:20:13.954024 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:13.953741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" event={"ID":"62d53f84-5fd6-4992-9caa-b5215007a246","Type":"ContainerStarted","Data":"2fe31a7d875f2ca2ae2718602cc06032765f20c69c95c5179996698770c1a7c5"}
Jul 29 09:20:14.107667 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:14.107566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:14.978736 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:14.978672    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" podStartSLOduration=1.9786566300000001 podStartE2EDuration="1.97865663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:20:14.976516381 +0000 UTC m=+1963.747786446" watchObservedRunningTime="2026-07-29 09:20:14.97865663 +0000 UTC m=+1963.749926693"
Jul 29 09:20:15.745107 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:15.745070    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:15.749822 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:15.749797    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:15.962645 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:15.962614    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:15.963660 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:15.963641    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:17.123787 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.123757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:17.223321 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.223286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:17.329551 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.329519    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"]
Jul 29 09:20:17.332934 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.332917    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.335412 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.335387    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:20:17.335528 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.335448    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:20:17.335528 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.335502    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6f2e14d7-serving-cert\""
Jul 29 09:20:17.335838 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.335820    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:20:17.344162 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.344133    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"]
Jul 29 09:20:17.361684 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.361646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:17.480085 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.480041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvch\" (UniqueName: \"kubernetes.io/projected/c3391065-0caf-44da-898e-4f4d57e6f131-kube-api-access-lsvch\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.480294 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.480126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3391065-0caf-44da-898e-4f4d57e6f131-maas-api-tls\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.480294 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.480165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3391065-0caf-44da-898e-4f4d57e6f131-openshift-service-ca\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.579868 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.579805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:17.580917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.580895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvch\" (UniqueName: \"kubernetes.io/projected/c3391065-0caf-44da-898e-4f4d57e6f131-kube-api-access-lsvch\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.581009 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.580958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3391065-0caf-44da-898e-4f4d57e6f131-maas-api-tls\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.581009 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.580996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3391065-0caf-44da-898e-4f4d57e6f131-openshift-service-ca\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.581651 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.581631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3391065-0caf-44da-898e-4f4d57e6f131-openshift-service-ca\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.583377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.583358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3391065-0caf-44da-898e-4f4d57e6f131-maas-api-tls\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.588943 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.588916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvch\" (UniqueName: \"kubernetes.io/projected/c3391065-0caf-44da-898e-4f4d57e6f131-kube-api-access-lsvch\") pod \"maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.644883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.644852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:17.781974 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.781947    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"]
Jul 29 09:20:17.784244 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:20:17.784217    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3391065_0caf_44da_898e_4f4d57e6f131.slice/crio-b8ba28e354b2f2b5922683ce7e897bd8c190c230fd87d406934454d6129e8dbb WatchSource:0}: Error finding container b8ba28e354b2f2b5922683ce7e897bd8c190c230fd87d406934454d6129e8dbb: Status 404 returned error can't find the container with id b8ba28e354b2f2b5922683ce7e897bd8c190c230fd87d406934454d6129e8dbb
Jul 29 09:20:17.785914 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.785893    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 09:20:17.953030 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.953001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:17.972946 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:17.972904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8" event={"ID":"c3391065-0caf-44da-898e-4f4d57e6f131","Type":"ContainerStarted","Data":"b8ba28e354b2f2b5922683ce7e897bd8c190c230fd87d406934454d6129e8dbb"}
Jul 29 09:20:18.051957 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.051871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:18.066419 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.066386    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"]
Jul 29 09:20:18.070788 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.070772    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.073569 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.073551    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6f2e14d7-dockercfg-clkzg\""
Jul 29 09:20:18.074115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.074100    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6f2e14d7\""
Jul 29 09:20:18.079707 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.079685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"]
Jul 29 09:20:18.083504 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.083478    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"]
Jul 29 09:20:18.086523 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.086506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.103108 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.103083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"]
Jul 29 09:20:18.188097 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.188065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdg86\" (UniqueName: \"kubernetes.io/projected/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-kube-api-access-qdg86\") pod \"payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb\" (UID: \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\") " pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.188616 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.188114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a5dcd6-8173-4a72-a759-30bf65e2061f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67\" (UID: \"64a5dcd6-8173-4a72-a759-30bf65e2061f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.188616 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.188223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flxjs\" (UniqueName: \"kubernetes.io/projected/64a5dcd6-8173-4a72-a759-30bf65e2061f-kube-api-access-flxjs\") pod \"payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67\" (UID: \"64a5dcd6-8173-4a72-a759-30bf65e2061f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.188616 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.188308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-plugins-config-volume\") pod \"payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb\" (UID: \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\") " pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.289332 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.289292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flxjs\" (UniqueName: \"kubernetes.io/projected/64a5dcd6-8173-4a72-a759-30bf65e2061f-kube-api-access-flxjs\") pod \"payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67\" (UID: \"64a5dcd6-8173-4a72-a759-30bf65e2061f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.289598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.289357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-plugins-config-volume\") pod \"payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb\" (UID: \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\") " pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.289598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.289398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdg86\" (UniqueName: \"kubernetes.io/projected/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-kube-api-access-qdg86\") pod \"payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb\" (UID: \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\") " pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.289598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.289427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a5dcd6-8173-4a72-a759-30bf65e2061f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67\" (UID: \"64a5dcd6-8173-4a72-a759-30bf65e2061f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.290194 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.290172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-plugins-config-volume\") pod \"payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb\" (UID: \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\") " pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.290242 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.290195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a5dcd6-8173-4a72-a759-30bf65e2061f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67\" (UID: \"64a5dcd6-8173-4a72-a759-30bf65e2061f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.297673 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.297644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdg86\" (UniqueName: \"kubernetes.io/projected/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-kube-api-access-qdg86\") pod \"payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb\" (UID: \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\") " pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.297673 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.297657    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flxjs\" (UniqueName: \"kubernetes.io/projected/64a5dcd6-8173-4a72-a759-30bf65e2061f-kube-api-access-flxjs\") pod \"payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67\" (UID: \"64a5dcd6-8173-4a72-a759-30bf65e2061f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.382647 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.382617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.398848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.398820    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.527280 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.527236    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"]
Jul 29 09:20:18.529750 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:20:18.529707    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a5dcd6_8173_4a72_a759_30bf65e2061f.slice/crio-637cc8e52861a9d36c22481cbfdc377fc4f26f8079f346aeca3f954c8e443fa7 WatchSource:0}: Error finding container 637cc8e52861a9d36c22481cbfdc377fc4f26f8079f346aeca3f954c8e443fa7: Status 404 returned error can't find the container with id 637cc8e52861a9d36c22481cbfdc377fc4f26f8079f346aeca3f954c8e443fa7
Jul 29 09:20:18.553205 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.553111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"]
Jul 29 09:20:18.567895 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:20:18.567870    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7e133c_d2f4_4c97_baf4_3e5665fdfe32.slice/crio-37b8393a607c6d7c2b3a663f78c8b5f171738a2d7094dff82f2cb49c8c3d3668 WatchSource:0}: Error finding container 37b8393a607c6d7c2b3a663f78c8b5f171738a2d7094dff82f2cb49c8c3d3668: Status 404 returned error can't find the container with id 37b8393a607c6d7c2b3a663f78c8b5f171738a2d7094dff82f2cb49c8c3d3668
Jul 29 09:20:18.978938 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.978816    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67" event={"ID":"64a5dcd6-8173-4a72-a759-30bf65e2061f","Type":"ContainerStarted","Data":"e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5"}
Jul 29 09:20:18.978938 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.978895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67" event={"ID":"64a5dcd6-8173-4a72-a759-30bf65e2061f","Type":"ContainerStarted","Data":"637cc8e52861a9d36c22481cbfdc377fc4f26f8079f346aeca3f954c8e443fa7"}
Jul 29 09:20:18.978938 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.978923    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:18.980315 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.980286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8" event={"ID":"c3391065-0caf-44da-898e-4f4d57e6f131","Type":"ContainerStarted","Data":"d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9"}
Jul 29 09:20:18.980454 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.980346    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:18.981736 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.981698    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb" event={"ID":"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32","Type":"ContainerStarted","Data":"bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d"}
Jul 29 09:20:18.981837 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.981756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb" event={"ID":"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32","Type":"ContainerStarted","Data":"37b8393a607c6d7c2b3a663f78c8b5f171738a2d7094dff82f2cb49c8c3d3668"}
Jul 29 09:20:18.981837 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.981828    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:18.997386 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:18.997337    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67" podStartSLOduration=0.997319185 podStartE2EDuration="997.319185ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:20:18.996256684 +0000 UTC m=+1967.767526747" watchObservedRunningTime="2026-07-29 09:20:18.997319185 +0000 UTC m=+1967.768589249"
Jul 29 09:20:19.011793 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:19.011742    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb" podStartSLOduration=1.01170442 podStartE2EDuration="1.01170442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:20:19.010944785 +0000 UTC m=+1967.782214869" watchObservedRunningTime="2026-07-29 09:20:19.01170442 +0000 UTC m=+1967.782974462"
Jul 29 09:20:19.028240 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:19.028189    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8" podStartSLOduration=1.342492845 podStartE2EDuration="2.028175221s" totalImagesPullingTime="685.682376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:20:19.026965942 +0000 UTC m=+1967.798236014" watchObservedRunningTime="2026-07-29 09:20:19.028175221 +0000 UTC m=+1967.799445286"
Jul 29 09:20:24.991874 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:24.991842    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:20:29.037076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:29.037042    2564 generic.go:356] "Generic (PLEG): container finished" podID="62d53f84-5fd6-4992-9caa-b5215007a246" containerID="d1fad60729cace80824da9bc3321df5766906efae61a3f7a3e675b3b763238d0" exitCode=0
Jul 29 09:20:29.037473 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:29.037104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" event={"ID":"62d53f84-5fd6-4992-9caa-b5215007a246","Type":"ContainerDied","Data":"d1fad60729cace80824da9bc3321df5766906efae61a3f7a3e675b3b763238d0"}
Jul 29 09:20:29.037473 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:29.037431    2564 scope.go:117] "RemoveContainer" containerID="d1fad60729cace80824da9bc3321df5766906efae61a3f7a3e675b3b763238d0"
Jul 29 09:20:29.038380 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:29.038349    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:20:29.038431 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:29.038417    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:20:29.038466 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:29.038452    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:20:29.988515 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:29.988480    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:20:29.988741 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:29.988572    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:20:30.044894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:30.044858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" event={"ID":"62d53f84-5fd6-4992-9caa-b5215007a246","Type":"ContainerStarted","Data":"1586f7880e0379090c0e3bef379eb55ff87e1886691b01f4f52dc24ee3d52a28"}
Jul 29 09:20:30.744641 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:30.744596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:30.745825 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:30.745799    2564 patch_prober.go:28] interesting pod/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 29 09:20:30.745880 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:30.745851    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 29 09:20:30.962906 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:30.962867    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:31.745051 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:31.745013    2564 patch_prober.go:28] interesting pod/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 29 09:20:31.745531 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:31.745068    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 29 09:20:32.744665 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:32.744622    2564 patch_prober.go:28] interesting pod/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 29 09:20:32.744876 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:32.744696    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 29 09:20:33.745300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:33.745262    2564 patch_prober.go:28] interesting pod/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 29 09:20:33.745759 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:33.745331    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 29 09:20:34.748772 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:34.748734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:34.749923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:34.749903    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:20:42.110791 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:42.110748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:42.752521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:42.752480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:42.852528 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:42.852496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:43.170733 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:43.170692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:48.937948 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:48.937913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:49.009190 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:49.009154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:59.715206 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.715172    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"]
Jul 29 09:20:59.715834 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.715426    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8" podUID="c3391065-0caf-44da-898e-4f4d57e6f131" containerName="maas-api" containerID="cri-o://d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9" gracePeriod=30
Jul 29 09:20:59.747528 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.747502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:59.772467 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.772437    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"]
Jul 29 09:20:59.772726 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.772689    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb" podUID="5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" containerName="payload-processing" containerID="cri-o://bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d" gracePeriod=30
Jul 29 09:20:59.781696 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.781670    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"]
Jul 29 09:20:59.781958 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.781934    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67" podUID="64a5dcd6-8173-4a72-a759-30bf65e2061f" containerName="payload-pre-processing" containerID="cri-o://e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5" gracePeriod=30
Jul 29 09:20:59.849477 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.849453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:59.941126 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.940684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:20:59.987101 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:20:59.986786    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67" podUID="64a5dcd6-8173-4a72-a759-30bf65e2061f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.42:9004: connect: connection refused"
Jul 29 09:21:00.000447 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.000408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:00.036834 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.036810    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:21:00.053098 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.053075    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:21:00.084251 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.084226    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:21:00.175867 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.175833    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3391065-0caf-44da-898e-4f4d57e6f131" containerID="d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9" exitCode=0
Jul 29 09:21:00.176055 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.175890    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"
Jul 29 09:21:00.176055 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.175906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8" event={"ID":"c3391065-0caf-44da-898e-4f4d57e6f131","Type":"ContainerDied","Data":"d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9"}
Jul 29 09:21:00.176055 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.175983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8" event={"ID":"c3391065-0caf-44da-898e-4f4d57e6f131","Type":"ContainerDied","Data":"b8ba28e354b2f2b5922683ce7e897bd8c190c230fd87d406934454d6129e8dbb"}
Jul 29 09:21:00.176055 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.176007    2564 scope.go:117] "RemoveContainer" containerID="d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9"
Jul 29 09:21:00.177265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.177245    2564 generic.go:356] "Generic (PLEG): container finished" podID="5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" containerID="bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d" exitCode=0
Jul 29 09:21:00.177330 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.177295    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"
Jul 29 09:21:00.177373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.177335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb" event={"ID":"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32","Type":"ContainerDied","Data":"bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d"}
Jul 29 09:21:00.177419 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.177377    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb" event={"ID":"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32","Type":"ContainerDied","Data":"37b8393a607c6d7c2b3a663f78c8b5f171738a2d7094dff82f2cb49c8c3d3668"}
Jul 29 09:21:00.178541 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.178520    2564 generic.go:356] "Generic (PLEG): container finished" podID="64a5dcd6-8173-4a72-a759-30bf65e2061f" containerID="e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5" exitCode=0
Jul 29 09:21:00.178665 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.178545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67" event={"ID":"64a5dcd6-8173-4a72-a759-30bf65e2061f","Type":"ContainerDied","Data":"e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5"}
Jul 29 09:21:00.178665 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.178566    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"
Jul 29 09:21:00.178665 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.178601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67" event={"ID":"64a5dcd6-8173-4a72-a759-30bf65e2061f","Type":"ContainerDied","Data":"637cc8e52861a9d36c22481cbfdc377fc4f26f8079f346aeca3f954c8e443fa7"}
Jul 29 09:21:00.184766 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.184750    2564 scope.go:117] "RemoveContainer" containerID="d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9"
Jul 29 09:21:00.185008 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:21:00.184989    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9\": container with ID starting with d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9 not found: ID does not exist" containerID="d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9"
Jul 29 09:21:00.185058 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.185016    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9"} err="failed to get container status \"d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9\": rpc error: code = NotFound desc = could not find container \"d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9\": container with ID starting with d188bb87d7ca9512e5b98f71ec9543811c0da9a13babc37622c57ffdf54335d9 not found: ID does not exist"
Jul 29 09:21:00.185058 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.185031    2564 scope.go:117] "RemoveContainer" containerID="bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d"
Jul 29 09:21:00.192502 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.192483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3391065-0caf-44da-898e-4f4d57e6f131-maas-api-tls\") pod \"c3391065-0caf-44da-898e-4f4d57e6f131\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") "
Jul 29 09:21:00.192587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.192491    2564 scope.go:117] "RemoveContainer" containerID="bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d"
Jul 29 09:21:00.192587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.192523    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdg86\" (UniqueName: \"kubernetes.io/projected/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-kube-api-access-qdg86\") pod \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\" (UID: \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\") "
Jul 29 09:21:00.192587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.192547    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a5dcd6-8173-4a72-a759-30bf65e2061f-plugins-config-volume\") pod \"64a5dcd6-8173-4a72-a759-30bf65e2061f\" (UID: \"64a5dcd6-8173-4a72-a759-30bf65e2061f\") "
Jul 29 09:21:00.192587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.192573    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flxjs\" (UniqueName: \"kubernetes.io/projected/64a5dcd6-8173-4a72-a759-30bf65e2061f-kube-api-access-flxjs\") pod \"64a5dcd6-8173-4a72-a759-30bf65e2061f\" (UID: \"64a5dcd6-8173-4a72-a759-30bf65e2061f\") "
Jul 29 09:21:00.192810 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.192599    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-plugins-config-volume\") pod \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\" (UID: \"5b7e133c-d2f4-4c97-baf4-3e5665fdfe32\") "
Jul 29 09:21:00.192810 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.192631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsvch\" (UniqueName: \"kubernetes.io/projected/c3391065-0caf-44da-898e-4f4d57e6f131-kube-api-access-lsvch\") pod \"c3391065-0caf-44da-898e-4f4d57e6f131\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") "
Jul 29 09:21:00.192810 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.192703    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3391065-0caf-44da-898e-4f4d57e6f131-openshift-service-ca\") pod \"c3391065-0caf-44da-898e-4f4d57e6f131\" (UID: \"c3391065-0caf-44da-898e-4f4d57e6f131\") "
Jul 29 09:21:00.193077 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.193038    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a5dcd6-8173-4a72-a759-30bf65e2061f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64a5dcd6-8173-4a72-a759-30bf65e2061f" (UID: "64a5dcd6-8173-4a72-a759-30bf65e2061f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:21:00.193216 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.193102    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" (UID: "5b7e133c-d2f4-4c97-baf4-3e5665fdfe32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:21:00.193288 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.193270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3391065-0caf-44da-898e-4f4d57e6f131-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3391065-0caf-44da-898e-4f4d57e6f131" (UID: "c3391065-0caf-44da-898e-4f4d57e6f131"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:21:00.193379 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:21:00.193351    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d\": container with ID starting with bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d not found: ID does not exist" containerID="bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d"
Jul 29 09:21:00.193494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.193385    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d"} err="failed to get container status \"bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d\": rpc error: code = NotFound desc = could not find container \"bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d\": container with ID starting with bd95a4c980a29ac5985e71a5f7b17e5d4f8b436d789d1c676f29fbc8acb7d64d not found: ID does not exist"
Jul 29 09:21:00.193494 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.193405    2564 scope.go:117] "RemoveContainer" containerID="e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5"
Jul 29 09:21:00.194934 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.194912    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3391065-0caf-44da-898e-4f4d57e6f131-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3391065-0caf-44da-898e-4f4d57e6f131" (UID: "c3391065-0caf-44da-898e-4f4d57e6f131"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:21:00.195018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.194972    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a5dcd6-8173-4a72-a759-30bf65e2061f-kube-api-access-flxjs" (OuterVolumeSpecName: "kube-api-access-flxjs") pod "64a5dcd6-8173-4a72-a759-30bf65e2061f" (UID: "64a5dcd6-8173-4a72-a759-30bf65e2061f"). InnerVolumeSpecName "kube-api-access-flxjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:21:00.195068 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.195044    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-kube-api-access-qdg86" (OuterVolumeSpecName: "kube-api-access-qdg86") pod "5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" (UID: "5b7e133c-d2f4-4c97-baf4-3e5665fdfe32"). InnerVolumeSpecName "kube-api-access-qdg86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:21:00.195234 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.195215    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3391065-0caf-44da-898e-4f4d57e6f131-kube-api-access-lsvch" (OuterVolumeSpecName: "kube-api-access-lsvch") pod "c3391065-0caf-44da-898e-4f4d57e6f131" (UID: "c3391065-0caf-44da-898e-4f4d57e6f131"). InnerVolumeSpecName "kube-api-access-lsvch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:21:00.200944 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.200924    2564 scope.go:117] "RemoveContainer" containerID="e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5"
Jul 29 09:21:00.201216 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:21:00.201195    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5\": container with ID starting with e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5 not found: ID does not exist" containerID="e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5"
Jul 29 09:21:00.201279 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.201227    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5"} err="failed to get container status \"e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5\": rpc error: code = NotFound desc = could not find container \"e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5\": container with ID starting with e90d7244c0ec8e32fa5e5efeee3ed940195ceea2c93d3b24676309a6bee9a6b5 not found: ID does not exist"
Jul 29 09:21:00.294248 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.294162    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3391065-0caf-44da-898e-4f4d57e6f131-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:00.294248 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.294192    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdg86\" (UniqueName: \"kubernetes.io/projected/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-kube-api-access-qdg86\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:00.294248 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.294203    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64a5dcd6-8173-4a72-a759-30bf65e2061f-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:00.294248 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.294214    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flxjs\" (UniqueName: \"kubernetes.io/projected/64a5dcd6-8173-4a72-a759-30bf65e2061f-kube-api-access-flxjs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:00.294248 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.294224    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:00.294248 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.294232    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsvch\" (UniqueName: \"kubernetes.io/projected/c3391065-0caf-44da-898e-4f4d57e6f131-kube-api-access-lsvch\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:00.294248 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.294241    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3391065-0caf-44da-898e-4f4d57e6f131-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:00.392747 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.392697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:00.500321 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.500282    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"]
Jul 29 09:21:00.502397 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.502374    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8"]
Jul 29 09:21:00.512524 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.512491    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"]
Jul 29 09:21:00.514541 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.514516    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6f2e14d7-74b9b8bb8d-k6t67"]
Jul 29 09:21:00.525224 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.525200    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"]
Jul 29 09:21:00.529972 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.529952    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb"]
Jul 29 09:21:00.986996 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:00.986899    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-6f2e14d7-7b7ccf786b-mdjjb" podUID="5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.43:9004: i/o timeout"
Jul 29 09:21:01.761554 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:01.761520    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" path="/var/lib/kubelet/pods/5b7e133c-d2f4-4c97-baf4-3e5665fdfe32/volumes"
Jul 29 09:21:01.761914 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:01.761900    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a5dcd6-8173-4a72-a759-30bf65e2061f" path="/var/lib/kubelet/pods/64a5dcd6-8173-4a72-a759-30bf65e2061f/volumes"
Jul 29 09:21:01.762246 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:01.762234    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3391065-0caf-44da-898e-4f4d57e6f131" path="/var/lib/kubelet/pods/c3391065-0caf-44da-898e-4f4d57e6f131/volumes"
Jul 29 09:21:02.987119 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:02.987076    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6f2e14d7-5cc9c5b675-c8mv8" podUID="c3391065-0caf-44da-898e-4f4d57e6f131" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.41:8443/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 09:21:06.654403 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:06.654369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:06.803245 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:06.803210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:07.033628 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:07.033538    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"]
Jul 29 09:21:07.033797 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:07.033765    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy" containerID="cri-o://1586f7880e0379090c0e3bef379eb55ff87e1886691b01f4f52dc24ee3d52a28" gracePeriod=30
Jul 29 09:21:07.068878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:07.068838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:07.270397 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:07.270364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:07.410376 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:07.410341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:07.491600 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:07.491552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:07.594338 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:07.594299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:12.238181 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.238144    2564 generic.go:356] "Generic (PLEG): container finished" podID="62d53f84-5fd6-4992-9caa-b5215007a246" containerID="1586f7880e0379090c0e3bef379eb55ff87e1886691b01f4f52dc24ee3d52a28" exitCode=0
Jul 29 09:21:12.238606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.238222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" event={"ID":"62d53f84-5fd6-4992-9caa-b5215007a246","Type":"ContainerDied","Data":"1586f7880e0379090c0e3bef379eb55ff87e1886691b01f4f52dc24ee3d52a28"}
Jul 29 09:21:12.238606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.238296    2564 scope.go:117] "RemoveContainer" containerID="d1fad60729cace80824da9bc3321df5766906efae61a3f7a3e675b3b763238d0"
Jul 29 09:21:12.287658 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.287635    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:21:12.293012 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.292993    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-istio-token\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293095 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-credential-socket\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293095 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293065    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-data\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293197 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d53f84-5fd6-4992-9caa-b5215007a246-istio-podinfo\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293214    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-envoy\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-certs\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293362 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293305    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4wg6\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-kube-api-access-n4wg6\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293362 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293349    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-socket\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293465 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293370    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:21:12.293465 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293388    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d53f84-5fd6-4992-9caa-b5215007a246-istiod-ca-cert\") pod \"62d53f84-5fd6-4992-9caa-b5215007a246\" (UID: \"62d53f84-5fd6-4992-9caa-b5215007a246\") "
Jul 29 09:21:12.293574 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293551    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:21:12.293893 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293689    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:12.293893 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293745    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:12.293893 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293857    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:21:12.293893 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293867    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-data" (OuterVolumeSpecName: "istio-data") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:21:12.294156 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.293893    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62d53f84-5fd6-4992-9caa-b5215007a246-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:21:12.295328 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.295299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62d53f84-5fd6-4992-9caa-b5215007a246-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:21:12.295421 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.295390    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-kube-api-access-n4wg6" (OuterVolumeSpecName: "kube-api-access-n4wg6") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "kube-api-access-n4wg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:21:12.295618 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.295595    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:21:12.295618 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.295604    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-istio-token" (OuterVolumeSpecName: "istio-token") pod "62d53f84-5fd6-4992-9caa-b5215007a246" (UID: "62d53f84-5fd6-4992-9caa-b5215007a246"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:21:12.394441 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.394404    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:12.394441 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.394436    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d53f84-5fd6-4992-9caa-b5215007a246-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:12.394441 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.394446    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:12.394689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.394455    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4wg6\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-kube-api-access-n4wg6\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:12.394689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.394464    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d53f84-5fd6-4992-9caa-b5215007a246-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:12.394689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.394472    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d53f84-5fd6-4992-9caa-b5215007a246-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:12.394689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:12.394481    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d53f84-5fd6-4992-9caa-b5215007a246-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:21:13.243662 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:13.243630    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml" event={"ID":"62d53f84-5fd6-4992-9caa-b5215007a246","Type":"ContainerDied","Data":"2fe31a7d875f2ca2ae2718602cc06032765f20c69c95c5179996698770c1a7c5"}
Jul 29 09:21:13.243662 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:13.243648    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"
Jul 29 09:21:13.244132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:13.243689    2564 scope.go:117] "RemoveContainer" containerID="1586f7880e0379090c0e3bef379eb55ff87e1886691b01f4f52dc24ee3d52a28"
Jul 29 09:21:13.264214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:13.264187    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"]
Jul 29 09:21:13.268915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:13.268891    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6f2e14d7-openshift-default-5766696dc6-ccrml"]
Jul 29 09:21:13.760946 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:13.760911    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" path="/var/lib/kubelet/pods/62d53f84-5fd6-4992-9caa-b5215007a246/volumes"
Jul 29 09:21:13.802161 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:13.802130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:13.930899 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:13.930867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:14.068461 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:14.068370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:14.200624 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:14.200592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:20.146737 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:20.146685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:20.218786 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:20.218755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:26.984969 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:26.984931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:27.242340 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242257    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"]
Jul 29 09:21:27.242632 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242615    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a5dcd6-8173-4a72-a759-30bf65e2061f" containerName="payload-pre-processing"
Jul 29 09:21:27.242632 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242632    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a5dcd6-8173-4a72-a759-30bf65e2061f" containerName="payload-pre-processing"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242647    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242653    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242661    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3391065-0caf-44da-898e-4f4d57e6f131" containerName="maas-api"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242667    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3391065-0caf-44da-898e-4f4d57e6f131" containerName="maas-api"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242674    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" containerName="payload-processing"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242679    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" containerName="payload-processing"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242686    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242691    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242766    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242775    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3391065-0caf-44da-898e-4f4d57e6f131" containerName="maas-api"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242780    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b7e133c-d2f4-4c97-baf4-3e5665fdfe32" containerName="payload-processing"
Jul 29 09:21:27.242836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.242787    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a5dcd6-8173-4a72-a759-30bf65e2061f" containerName="payload-pre-processing"
Jul 29 09:21:27.246770 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.246749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.249065 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.249041    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2dc45aaa-openshift-default-dockercfg-vcgw5\""
Jul 29 09:21:27.258194 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.258172    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"]
Jul 29 09:21:27.270269 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.270237    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:27.325979 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.325941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50e27783-68de-475f-b639-45cf94e2f36d-istiod-ca-cert\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.326173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.325990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50e27783-68de-475f-b639-45cf94e2f36d-istio-podinfo\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.326173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.326009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnc4r\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-kube-api-access-wnc4r\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.326173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.326030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-certs\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.326173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.326044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-envoy\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.326173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.326072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-istio-token\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.326173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.326106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-data\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.326173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.326142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-socket\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.326173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.326165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-credential-socket\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50e27783-68de-475f-b639-45cf94e2f36d-istiod-ca-cert\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427366 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50e27783-68de-475f-b639-45cf94e2f36d-istio-podinfo\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427366 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnc4r\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-kube-api-access-wnc4r\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427366 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-certs\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-envoy\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-istio-token\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-data\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-socket\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427803 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-credential-socket\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427950 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427921    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-certs\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.427950 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.427933    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-data\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.428143 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.428022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-credential-socket\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.428143 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.428102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-socket\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.428433 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.428403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50e27783-68de-475f-b639-45cf94e2f36d-istiod-ca-cert\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.429840 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.429821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-envoy\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.429925 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.429889    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50e27783-68de-475f-b639-45cf94e2f36d-istio-podinfo\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.435796 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.435770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-istio-token\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.436032 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.436009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnc4r\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-kube-api-access-wnc4r\") pod \"e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") " pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.556921 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.556824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:27.655097 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.655061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:27.696335 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.696309    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"]
Jul 29 09:21:27.698599 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:21:27.698560    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e27783_68de_475f_b639_45cf94e2f36d.slice/crio-fef1816f4565d6b510a0f2959c2decdaa8d4e26f8fac09a2131f5bf5462c2ddd WatchSource:0}: Error finding container fef1816f4565d6b510a0f2959c2decdaa8d4e26f8fac09a2131f5bf5462c2ddd: Status 404 returned error can't find the container with id fef1816f4565d6b510a0f2959c2decdaa8d4e26f8fac09a2131f5bf5462c2ddd
Jul 29 09:21:27.701037 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.701001    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:21:27.701125 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.701067    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:21:27.701125 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:27.701099    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:21:28.312178 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:28.312142    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" event={"ID":"50e27783-68de-475f-b639-45cf94e2f36d","Type":"ContainerStarted","Data":"6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378"}
Jul 29 09:21:28.312571 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:28.312196    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" event={"ID":"50e27783-68de-475f-b639-45cf94e2f36d","Type":"ContainerStarted","Data":"fef1816f4565d6b510a0f2959c2decdaa8d4e26f8fac09a2131f5bf5462c2ddd"}
Jul 29 09:21:28.333353 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:28.333298    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" podStartSLOduration=1.333278656 podStartE2EDuration="1.333278656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:21:28.333033274 +0000 UTC m=+2037.104303371" watchObservedRunningTime="2026-07-29 09:21:28.333278656 +0000 UTC m=+2037.104548722"
Jul 29 09:21:28.557155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:28.557128    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:28.561833 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:28.561811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:29.317343 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:29.317311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:29.318486 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:29.318472    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:30.224566 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.224534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:30.323144 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.323110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:30.431810 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.431779    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"]
Jul 29 09:21:30.432155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.432142    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d53f84-5fd6-4992-9caa-b5215007a246" containerName="istio-proxy"
Jul 29 09:21:30.435201 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.435183    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.437400 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.437379    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:21:30.437497 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.437387    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:21:30.437926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.437909    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:21:30.438163 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.438147    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2dc45aaa-serving-cert\""
Jul 29 09:21:30.445033 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.445008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"]
Jul 29 09:21:30.469918 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.469886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:30.548808 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.548734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:30.557924 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.557900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh9s8\" (UniqueName: \"kubernetes.io/projected/fd96b1e0-0cef-4736-87f1-cb94437ea068-kube-api-access-bh9s8\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.558006 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.557955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd96b1e0-0cef-4736-87f1-cb94437ea068-openshift-service-ca\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.558050 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.558010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd96b1e0-0cef-4736-87f1-cb94437ea068-maas-api-tls\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.658975 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.658937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd96b1e0-0cef-4736-87f1-cb94437ea068-openshift-service-ca\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.659175 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.658987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd96b1e0-0cef-4736-87f1-cb94437ea068-maas-api-tls\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.659175 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.659042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh9s8\" (UniqueName: \"kubernetes.io/projected/fd96b1e0-0cef-4736-87f1-cb94437ea068-kube-api-access-bh9s8\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.659645 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.659617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd96b1e0-0cef-4736-87f1-cb94437ea068-openshift-service-ca\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.661501 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.661478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd96b1e0-0cef-4736-87f1-cb94437ea068-maas-api-tls\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.667584 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.667564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh9s8\" (UniqueName: \"kubernetes.io/projected/fd96b1e0-0cef-4736-87f1-cb94437ea068-kube-api-access-bh9s8\") pod \"maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.747122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.747081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:30.880631 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.880605    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"]
Jul 29 09:21:30.883124 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:21:30.883096    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd96b1e0_0cef_4736_87f1_cb94437ea068.slice/crio-9fb371d48662db4bdc9bc3e4c118f99275cab819ba9a15bec12148b9d3706210 WatchSource:0}: Error finding container 9fb371d48662db4bdc9bc3e4c118f99275cab819ba9a15bec12148b9d3706210: Status 404 returned error can't find the container with id 9fb371d48662db4bdc9bc3e4c118f99275cab819ba9a15bec12148b9d3706210
Jul 29 09:21:30.990181 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:30.990146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:31.091874 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.091788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:31.101284 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.101258    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"]
Jul 29 09:21:31.105698 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.105683    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:31.107876 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.107860    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2dc45aaa\""
Jul 29 09:21:31.118214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.118188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"]
Jul 29 09:21:31.130572 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.130545    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"]
Jul 29 09:21:31.133725 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.133697    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:31.136070 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.136050    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2dc45aaa-dockercfg-wrj6k\""
Jul 29 09:21:31.147050 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.147028    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"]
Jul 29 09:21:31.162919 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.162889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swzkv\" (UniqueName: \"kubernetes.io/projected/0525002d-69dc-4ffa-8f65-37eed3c538d2-kube-api-access-swzkv\") pod \"payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb\" (UID: \"0525002d-69dc-4ffa-8f65-37eed3c538d2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:31.163051 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.162942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0525002d-69dc-4ffa-8f65-37eed3c538d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb\" (UID: \"0525002d-69dc-4ffa-8f65-37eed3c538d2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:31.263565 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.263530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swzkv\" (UniqueName: \"kubernetes.io/projected/0525002d-69dc-4ffa-8f65-37eed3c538d2-kube-api-access-swzkv\") pod \"payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb\" (UID: \"0525002d-69dc-4ffa-8f65-37eed3c538d2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:31.263796 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.263572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0525002d-69dc-4ffa-8f65-37eed3c538d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb\" (UID: \"0525002d-69dc-4ffa-8f65-37eed3c538d2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:31.263796 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.263603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-plugins-config-volume\") pod \"payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z\" (UID: \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\") " pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:31.263796 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.263658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqkg\" (UniqueName: \"kubernetes.io/projected/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-kube-api-access-7sqkg\") pod \"payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z\" (UID: \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\") " pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:31.264516 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.264497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0525002d-69dc-4ffa-8f65-37eed3c538d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb\" (UID: \"0525002d-69dc-4ffa-8f65-37eed3c538d2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:31.272225 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.272195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swzkv\" (UniqueName: \"kubernetes.io/projected/0525002d-69dc-4ffa-8f65-37eed3c538d2-kube-api-access-swzkv\") pod \"payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb\" (UID: \"0525002d-69dc-4ffa-8f65-37eed3c538d2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:31.326561 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.326525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9" event={"ID":"fd96b1e0-0cef-4736-87f1-cb94437ea068","Type":"ContainerStarted","Data":"9fb371d48662db4bdc9bc3e4c118f99275cab819ba9a15bec12148b9d3706210"}
Jul 29 09:21:31.364894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.364804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-plugins-config-volume\") pod \"payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z\" (UID: \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\") " pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:31.364894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.364865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqkg\" (UniqueName: \"kubernetes.io/projected/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-kube-api-access-7sqkg\") pod \"payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z\" (UID: \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\") " pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:31.365560 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.365534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-plugins-config-volume\") pod \"payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z\" (UID: \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\") " pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:31.374896 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.374876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqkg\" (UniqueName: \"kubernetes.io/projected/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-kube-api-access-7sqkg\") pod \"payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z\" (UID: \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\") " pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:31.416235 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.416200    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:31.446431 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.446399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:31.559453 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.559402    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"]
Jul 29 09:21:31.562089 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:21:31.562049    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0525002d_69dc_4ffa_8f65_37eed3c538d2.slice/crio-a374531739104c16d71c7ca3d30d42666fdb533cfcdea63cec931120debe2f4d WatchSource:0}: Error finding container a374531739104c16d71c7ca3d30d42666fdb533cfcdea63cec931120debe2f4d: Status 404 returned error can't find the container with id a374531739104c16d71c7ca3d30d42666fdb533cfcdea63cec931120debe2f4d
Jul 29 09:21:31.589423 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:31.589401    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"]
Jul 29 09:21:31.596868 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:21:31.596832    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683b0fdd_0506_4bd3_9670_d4f4c243bfe2.slice/crio-30be1a92008356193ffcf9e9494f2439e14e7ae87490f999f2d312e628fb3c88 WatchSource:0}: Error finding container 30be1a92008356193ffcf9e9494f2439e14e7ae87490f999f2d312e628fb3c88: Status 404 returned error can't find the container with id 30be1a92008356193ffcf9e9494f2439e14e7ae87490f999f2d312e628fb3c88
Jul 29 09:21:32.332703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.332588    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9" event={"ID":"fd96b1e0-0cef-4736-87f1-cb94437ea068","Type":"ContainerStarted","Data":"046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563"}
Jul 29 09:21:32.332703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.332694    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:32.334157 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.334126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z" event={"ID":"683b0fdd-0506-4bd3-9670-d4f4c243bfe2","Type":"ContainerStarted","Data":"d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1"}
Jul 29 09:21:32.334299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.334173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z" event={"ID":"683b0fdd-0506-4bd3-9670-d4f4c243bfe2","Type":"ContainerStarted","Data":"30be1a92008356193ffcf9e9494f2439e14e7ae87490f999f2d312e628fb3c88"}
Jul 29 09:21:32.334299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.334235    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:32.335615 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.335593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb" event={"ID":"0525002d-69dc-4ffa-8f65-37eed3c538d2","Type":"ContainerStarted","Data":"1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c"}
Jul 29 09:21:32.335859 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.335633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:32.335859 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.335648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb" event={"ID":"0525002d-69dc-4ffa-8f65-37eed3c538d2","Type":"ContainerStarted","Data":"a374531739104c16d71c7ca3d30d42666fdb533cfcdea63cec931120debe2f4d"}
Jul 29 09:21:32.350659 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.350617    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9" podStartSLOduration=1.608123463 podStartE2EDuration="2.350605002s" totalImagesPullingTime="742.481539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:21:32.349870469 +0000 UTC m=+2041.121140533" watchObservedRunningTime="2026-07-29 09:21:32.350605002 +0000 UTC m=+2041.121875106"
Jul 29 09:21:32.367298 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.367249    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb" podStartSLOduration=1.36723338 podStartE2EDuration="1.36723338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:21:32.366001382 +0000 UTC m=+2041.137271486" watchObservedRunningTime="2026-07-29 09:21:32.36723338 +0000 UTC m=+2041.138503447"
Jul 29 09:21:32.382816 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:32.382769    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z" podStartSLOduration=1.382754649 podStartE2EDuration="1.382754649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:21:32.381447312 +0000 UTC m=+2041.152717388" watchObservedRunningTime="2026-07-29 09:21:32.382754649 +0000 UTC m=+2041.154024713"
Jul 29 09:21:38.346418 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:38.346387    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:21:43.343776 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:43.343740    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:21:43.344206 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:43.343823    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:21:45.111470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:45.111439    2564 patch_prober.go:28] interesting pod/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:44534->10.132.0.44:15021: read: connection reset by peer" start-of-body=
Jul 29 09:21:45.111848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:45.111521    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:44534->10.132.0.44:15021: read: connection reset by peer"
Jul 29 09:21:45.403307 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:45.403275    2564 generic.go:356] "Generic (PLEG): container finished" podID="50e27783-68de-475f-b639-45cf94e2f36d" containerID="6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378" exitCode=0
Jul 29 09:21:45.403479 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:45.403336    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" event={"ID":"50e27783-68de-475f-b639-45cf94e2f36d","Type":"ContainerDied","Data":"6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378"}
Jul 29 09:21:45.403707 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:45.403694    2564 scope.go:117] "RemoveContainer" containerID="6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378"
Jul 29 09:21:45.404688 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:45.404656    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:21:45.404771 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:45.404744    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:21:45.404809 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:45.404794    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:21:46.412638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:46.412592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" event={"ID":"50e27783-68de-475f-b639-45cf94e2f36d","Type":"ContainerStarted","Data":"6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4"}
Jul 29 09:21:46.557743 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:46.557675    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:46.557964 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:46.557939    2564 patch_prober.go:28] interesting pod/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 09:21:46.558022 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:46.558006    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 09:21:47.557626 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:47.557584    2564 patch_prober.go:28] interesting pod/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 09:21:47.558057 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:47.557650    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 09:21:48.558126 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:48.558093    2564 patch_prober.go:28] interesting pod/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 09:21:48.558513 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:48.558146    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 09:21:49.558132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:49.558091    2564 patch_prober.go:28] interesting pod/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 09:21:49.558516 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:49.558152    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 09:21:50.561006 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:50.560975    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:50.561412 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:50.561343    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:50.562181 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:50.562157    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:21:55.171268 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:55.171175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:21:59.249107 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:21:59.249051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:24.232424 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.232365    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"]
Jul 29 09:22:24.235229 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.235206    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"
Jul 29 09:22:24.237157 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.237133    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:22:24.242289 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.242266    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"]
Jul 29 09:22:24.356187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.356155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f7e60f-3a7f-4598-8c4a-ebbf85fde998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2\" (UID: \"f8f7e60f-3a7f-4598-8c4a-ebbf85fde998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"
Jul 29 09:22:24.456923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.456840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f7e60f-3a7f-4598-8c4a-ebbf85fde998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2\" (UID: \"f8f7e60f-3a7f-4598-8c4a-ebbf85fde998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"
Jul 29 09:22:24.457464 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.457442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f7e60f-3a7f-4598-8c4a-ebbf85fde998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2\" (UID: \"f8f7e60f-3a7f-4598-8c4a-ebbf85fde998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"
Jul 29 09:22:24.484000 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.483974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:24.540876 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.540851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:24.547786 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.547763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"
Jul 29 09:22:24.687218 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:24.687185    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"]
Jul 29 09:22:24.691171 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:22:24.691144    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f7e60f_3a7f_4598_8c4a_ebbf85fde998.slice/crio-2773a469ff79c25278c5d6e6cb88d08dc18506355ca07c52e1ea8a09d1ef9139 WatchSource:0}: Error finding container 2773a469ff79c25278c5d6e6cb88d08dc18506355ca07c52e1ea8a09d1ef9139: Status 404 returned error can't find the container with id 2773a469ff79c25278c5d6e6cb88d08dc18506355ca07c52e1ea8a09d1ef9139
Jul 29 09:22:25.594678 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:25.594590    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8f7e60f-3a7f-4598-8c4a-ebbf85fde998" containerID="a1d64cf8b67804a305851e101be447a7ef2a4eb975bf6d1513b0f218235c1cfb" exitCode=0
Jul 29 09:22:25.594678 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:25.594663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2" event={"ID":"f8f7e60f-3a7f-4598-8c4a-ebbf85fde998","Type":"ContainerDied","Data":"a1d64cf8b67804a305851e101be447a7ef2a4eb975bf6d1513b0f218235c1cfb"}
Jul 29 09:22:25.595095 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:25.594702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2" event={"ID":"f8f7e60f-3a7f-4598-8c4a-ebbf85fde998","Type":"ContainerStarted","Data":"2773a469ff79c25278c5d6e6cb88d08dc18506355ca07c52e1ea8a09d1ef9139"}
Jul 29 09:22:26.726143 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:26.726120    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"
Jul 29 09:22:26.880208 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:26.880169    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f7e60f-3a7f-4598-8c4a-ebbf85fde998-maas-api-service-ca\") pod \"f8f7e60f-3a7f-4598-8c4a-ebbf85fde998\" (UID: \"f8f7e60f-3a7f-4598-8c4a-ebbf85fde998\") "
Jul 29 09:22:26.880592 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:26.880564    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f7e60f-3a7f-4598-8c4a-ebbf85fde998-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f8f7e60f-3a7f-4598-8c4a-ebbf85fde998" (UID: "f8f7e60f-3a7f-4598-8c4a-ebbf85fde998"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:22:26.981780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:26.981733    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f7e60f-3a7f-4598-8c4a-ebbf85fde998-maas-api-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:22:27.603920 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:27.603889    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"
Jul 29 09:22:27.603920 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:27.603908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2" event={"ID":"f8f7e60f-3a7f-4598-8c4a-ebbf85fde998","Type":"ContainerDied","Data":"2773a469ff79c25278c5d6e6cb88d08dc18506355ca07c52e1ea8a09d1ef9139"}
Jul 29 09:22:27.604182 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:27.603948    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2773a469ff79c25278c5d6e6cb88d08dc18506355ca07c52e1ea8a09d1ef9139"
Jul 29 09:22:39.734042 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.734007    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"]
Jul 29 09:22:39.734514 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.734299    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9" podUID="fd96b1e0-0cef-4736-87f1-cb94437ea068" containerName="maas-api" containerID="cri-o://046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563" gracePeriod=30
Jul 29 09:22:39.759262 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.759235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:39.791422 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.791382    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"]
Jul 29 09:22:39.791638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.791611    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z" podUID="683b0fdd-0506-4bd3-9670-d4f4c243bfe2" containerName="payload-processing" containerID="cri-o://d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1" gracePeriod=30
Jul 29 09:22:39.800544 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.800518    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"]
Jul 29 09:22:39.800857 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.800825    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb" podUID="0525002d-69dc-4ffa-8f65-37eed3c538d2" containerName="payload-pre-processing" containerID="cri-o://1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c" gracePeriod=30
Jul 29 09:22:39.837981 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.837955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:39.912543 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.912515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:39.961544 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.961509    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"]
Jul 29 09:22:39.964731 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.964683    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2dc45aaa-wvts2"]
Jul 29 09:22:39.981267 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:39.980949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:40.077287 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.077261    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:22:40.105040 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.105020    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:22:40.112581 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.112558    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:22:40.200105 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200070    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd96b1e0-0cef-4736-87f1-cb94437ea068-openshift-service-ca\") pod \"fd96b1e0-0cef-4736-87f1-cb94437ea068\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") "
Jul 29 09:22:40.200288 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200159    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh9s8\" (UniqueName: \"kubernetes.io/projected/fd96b1e0-0cef-4736-87f1-cb94437ea068-kube-api-access-bh9s8\") pod \"fd96b1e0-0cef-4736-87f1-cb94437ea068\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") "
Jul 29 09:22:40.200288 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200187    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd96b1e0-0cef-4736-87f1-cb94437ea068-maas-api-tls\") pod \"fd96b1e0-0cef-4736-87f1-cb94437ea068\" (UID: \"fd96b1e0-0cef-4736-87f1-cb94437ea068\") "
Jul 29 09:22:40.200288 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sqkg\" (UniqueName: \"kubernetes.io/projected/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-kube-api-access-7sqkg\") pod \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\" (UID: \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\") "
Jul 29 09:22:40.200288 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200241    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swzkv\" (UniqueName: \"kubernetes.io/projected/0525002d-69dc-4ffa-8f65-37eed3c538d2-kube-api-access-swzkv\") pod \"0525002d-69dc-4ffa-8f65-37eed3c538d2\" (UID: \"0525002d-69dc-4ffa-8f65-37eed3c538d2\") "
Jul 29 09:22:40.200519 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200342    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-plugins-config-volume\") pod \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\" (UID: \"683b0fdd-0506-4bd3-9670-d4f4c243bfe2\") "
Jul 29 09:22:40.200519 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200388    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0525002d-69dc-4ffa-8f65-37eed3c538d2-plugins-config-volume\") pod \"0525002d-69dc-4ffa-8f65-37eed3c538d2\" (UID: \"0525002d-69dc-4ffa-8f65-37eed3c538d2\") "
Jul 29 09:22:40.200624 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200587    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd96b1e0-0cef-4736-87f1-cb94437ea068-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fd96b1e0-0cef-4736-87f1-cb94437ea068" (UID: "fd96b1e0-0cef-4736-87f1-cb94437ea068"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:22:40.200779 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200725    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "683b0fdd-0506-4bd3-9670-d4f4c243bfe2" (UID: "683b0fdd-0506-4bd3-9670-d4f4c243bfe2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:22:40.200849 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200790    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd96b1e0-0cef-4736-87f1-cb94437ea068-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:22:40.201029 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.200998    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0525002d-69dc-4ffa-8f65-37eed3c538d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0525002d-69dc-4ffa-8f65-37eed3c538d2" (UID: "0525002d-69dc-4ffa-8f65-37eed3c538d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:22:40.202443 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.202422    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0525002d-69dc-4ffa-8f65-37eed3c538d2-kube-api-access-swzkv" (OuterVolumeSpecName: "kube-api-access-swzkv") pod "0525002d-69dc-4ffa-8f65-37eed3c538d2" (UID: "0525002d-69dc-4ffa-8f65-37eed3c538d2"). InnerVolumeSpecName "kube-api-access-swzkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:22:40.202443 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.202431    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-kube-api-access-7sqkg" (OuterVolumeSpecName: "kube-api-access-7sqkg") pod "683b0fdd-0506-4bd3-9670-d4f4c243bfe2" (UID: "683b0fdd-0506-4bd3-9670-d4f4c243bfe2"). InnerVolumeSpecName "kube-api-access-7sqkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:22:40.202803 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.202783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd96b1e0-0cef-4736-87f1-cb94437ea068-kube-api-access-bh9s8" (OuterVolumeSpecName: "kube-api-access-bh9s8") pod "fd96b1e0-0cef-4736-87f1-cb94437ea068" (UID: "fd96b1e0-0cef-4736-87f1-cb94437ea068"). InnerVolumeSpecName "kube-api-access-bh9s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:22:40.202863 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.202800    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd96b1e0-0cef-4736-87f1-cb94437ea068-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fd96b1e0-0cef-4736-87f1-cb94437ea068" (UID: "fd96b1e0-0cef-4736-87f1-cb94437ea068"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:22:40.302265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.302176    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh9s8\" (UniqueName: \"kubernetes.io/projected/fd96b1e0-0cef-4736-87f1-cb94437ea068-kube-api-access-bh9s8\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:22:40.302265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.302208    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd96b1e0-0cef-4736-87f1-cb94437ea068-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:22:40.302265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.302219    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sqkg\" (UniqueName: \"kubernetes.io/projected/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-kube-api-access-7sqkg\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:22:40.302265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.302228    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swzkv\" (UniqueName: \"kubernetes.io/projected/0525002d-69dc-4ffa-8f65-37eed3c538d2-kube-api-access-swzkv\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:22:40.302265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.302237    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/683b0fdd-0506-4bd3-9670-d4f4c243bfe2-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:22:40.302265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.302247    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0525002d-69dc-4ffa-8f65-37eed3c538d2-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:22:40.664053 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.664015    2564 generic.go:356] "Generic (PLEG): container finished" podID="fd96b1e0-0cef-4736-87f1-cb94437ea068" containerID="046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563" exitCode=0
Jul 29 09:22:40.664214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.664062    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"
Jul 29 09:22:40.664214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.664092    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9" event={"ID":"fd96b1e0-0cef-4736-87f1-cb94437ea068","Type":"ContainerDied","Data":"046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563"}
Jul 29 09:22:40.664214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.664141    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9" event={"ID":"fd96b1e0-0cef-4736-87f1-cb94437ea068","Type":"ContainerDied","Data":"9fb371d48662db4bdc9bc3e4c118f99275cab819ba9a15bec12148b9d3706210"}
Jul 29 09:22:40.664214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.664166    2564 scope.go:117] "RemoveContainer" containerID="046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563"
Jul 29 09:22:40.665480 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.665459    2564 generic.go:356] "Generic (PLEG): container finished" podID="683b0fdd-0506-4bd3-9670-d4f4c243bfe2" containerID="d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1" exitCode=0
Jul 29 09:22:40.665605 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.665486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z" event={"ID":"683b0fdd-0506-4bd3-9670-d4f4c243bfe2","Type":"ContainerDied","Data":"d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1"}
Jul 29 09:22:40.665605 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.665505    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"
Jul 29 09:22:40.665605 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.665539    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z" event={"ID":"683b0fdd-0506-4bd3-9670-d4f4c243bfe2","Type":"ContainerDied","Data":"30be1a92008356193ffcf9e9494f2439e14e7ae87490f999f2d312e628fb3c88"}
Jul 29 09:22:40.667046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.667023    2564 generic.go:356] "Generic (PLEG): container finished" podID="0525002d-69dc-4ffa-8f65-37eed3c538d2" containerID="1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c" exitCode=0
Jul 29 09:22:40.667156 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.667071    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"
Jul 29 09:22:40.667156 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.667102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb" event={"ID":"0525002d-69dc-4ffa-8f65-37eed3c538d2","Type":"ContainerDied","Data":"1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c"}
Jul 29 09:22:40.667268 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.667157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb" event={"ID":"0525002d-69dc-4ffa-8f65-37eed3c538d2","Type":"ContainerDied","Data":"a374531739104c16d71c7ca3d30d42666fdb533cfcdea63cec931120debe2f4d"}
Jul 29 09:22:40.674524 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.674504    2564 scope.go:117] "RemoveContainer" containerID="046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563"
Jul 29 09:22:40.674804 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:22:40.674786    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563\": container with ID starting with 046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563 not found: ID does not exist" containerID="046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563"
Jul 29 09:22:40.674864 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.674812    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563"} err="failed to get container status \"046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563\": rpc error: code = NotFound desc = could not find container \"046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563\": container with ID starting with 046607c51801b1143d64688d0b36bd007ffb2f75119143d9826a2e72dad96563 not found: ID does not exist"
Jul 29 09:22:40.674864 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.674828    2564 scope.go:117] "RemoveContainer" containerID="d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1"
Jul 29 09:22:40.683777 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.683759    2564 scope.go:117] "RemoveContainer" containerID="d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1"
Jul 29 09:22:40.684027 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:22:40.684010    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1\": container with ID starting with d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1 not found: ID does not exist" containerID="d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1"
Jul 29 09:22:40.684064 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.684033    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1"} err="failed to get container status \"d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1\": rpc error: code = NotFound desc = could not find container \"d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1\": container with ID starting with d9859ef102bd84f2fb8c4159314dd73b61c1f73a045c892944e5122baf8263d1 not found: ID does not exist"
Jul 29 09:22:40.684064 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.684051    2564 scope.go:117] "RemoveContainer" containerID="1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c"
Jul 29 09:22:40.691300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.691283    2564 scope.go:117] "RemoveContainer" containerID="1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c"
Jul 29 09:22:40.691531 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:22:40.691513    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c\": container with ID starting with 1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c not found: ID does not exist" containerID="1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c"
Jul 29 09:22:40.691573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.691537    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c"} err="failed to get container status \"1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c\": rpc error: code = NotFound desc = could not find container \"1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c\": container with ID starting with 1e406df58bab535058374ccdc8fd7b34367badfae88b892e395c797bc77bfc3c not found: ID does not exist"
Jul 29 09:22:40.694572 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.694551    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"]
Jul 29 09:22:40.703411 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.703389    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2dc45aaa-76c9fc4b8c-cn7x9"]
Jul 29 09:22:40.712436 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.712417    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"]
Jul 29 09:22:40.718634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.718609    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2dc45aaa-858b85985d-fgr2z"]
Jul 29 09:22:40.727465 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.727446    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"]
Jul 29 09:22:40.733041 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:40.733022    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2dc45aaa-574f77888d-4czhb"]
Jul 29 09:22:41.761469 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:41.761435    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0525002d-69dc-4ffa-8f65-37eed3c538d2" path="/var/lib/kubelet/pods/0525002d-69dc-4ffa-8f65-37eed3c538d2/volumes"
Jul 29 09:22:41.761878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:41.761815    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="683b0fdd-0506-4bd3-9670-d4f4c243bfe2" path="/var/lib/kubelet/pods/683b0fdd-0506-4bd3-9670-d4f4c243bfe2/volumes"
Jul 29 09:22:41.762115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:41.762102    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8f7e60f-3a7f-4598-8c4a-ebbf85fde998" path="/var/lib/kubelet/pods/f8f7e60f-3a7f-4598-8c4a-ebbf85fde998/volumes"
Jul 29 09:22:41.762447 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:41.762435    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd96b1e0-0cef-4736-87f1-cb94437ea068" path="/var/lib/kubelet/pods/fd96b1e0-0cef-4736-87f1-cb94437ea068/volumes"
Jul 29 09:22:43.066768 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:43.066709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:43.554024 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:43.553998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:22:48.145995 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:22:48.145961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:06.613813 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:06.613782    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:24.588065 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:24.587976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:25.229933 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:25.229897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:30.720020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:30.719980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:31.923526 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:31.923495    2564 scope.go:117] "RemoveContainer" containerID="254fcdcae13b50e73f773bb424965a7b9ae46dfc3a94f29c9daeb476b70d29c2"
Jul 29 09:23:45.076124 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:45.076087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:45.176377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:45.176335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:45.345664 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:45.345571    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"]
Jul 29 09:23:45.345885 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:45.345859    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy" containerID="cri-o://6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4" gracePeriod=30
Jul 29 09:23:45.364301 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:45.364268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:45.642439 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:45.642407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:46.703290 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:46.703259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:46.803121 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:46.803089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:46.904556 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:46.904521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:47.650433 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:47.650398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:47.805580 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:47.805545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:49.132896 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:49.132868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:49.725443 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:49.725412    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:50.589788 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.589763    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:23:50.692010 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.691977    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50e27783-68de-475f-b639-45cf94e2f36d-istiod-ca-cert\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692010 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692018    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50e27783-68de-475f-b639-45cf94e2f36d-istio-podinfo\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692042    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-certs\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692089    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-data\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692109    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-credential-socket\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692130    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-istio-token\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692190    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnc4r\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-kube-api-access-wnc4r\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692218    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-socket\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692559 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-envoy\") pod \"50e27783-68de-475f-b639-45cf94e2f36d\" (UID: \"50e27783-68de-475f-b639-45cf94e2f36d\") "
Jul 29 09:23:50.692559 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692503    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:50.692559 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692518    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:50.692559 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50e27783-68de-475f-b639-45cf94e2f36d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:23:50.692778 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.692678    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:50.693626 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.693597    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-data" (OuterVolumeSpecName: "istio-data") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:50.694400 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.694378    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:23:50.694518 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.694496    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-istio-token" (OuterVolumeSpecName: "istio-token") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:23:50.694566 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.694501    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50e27783-68de-475f-b639-45cf94e2f36d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:23:50.694566 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.694549    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-kube-api-access-wnc4r" (OuterVolumeSpecName: "kube-api-access-wnc4r") pod "50e27783-68de-475f-b639-45cf94e2f36d" (UID: "50e27783-68de-475f-b639-45cf94e2f36d"). InnerVolumeSpecName "kube-api-access-wnc4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:23:50.793556 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793507    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50e27783-68de-475f-b639-45cf94e2f36d-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.793556 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793550    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50e27783-68de-475f-b639-45cf94e2f36d-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.793556 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793560    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.793556 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793569    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.793850 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793578    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.793850 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793587    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.793850 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793595    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnc4r\" (UniqueName: \"kubernetes.io/projected/50e27783-68de-475f-b639-45cf94e2f36d-kube-api-access-wnc4r\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.793850 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793604    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.793850 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.793613    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50e27783-68de-475f-b639-45cf94e2f36d-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:23:50.975459 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.975366    2564 generic.go:356] "Generic (PLEG): container finished" podID="50e27783-68de-475f-b639-45cf94e2f36d" containerID="6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4" exitCode=0
Jul 29 09:23:50.975459 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.975422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" event={"ID":"50e27783-68de-475f-b639-45cf94e2f36d","Type":"ContainerDied","Data":"6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4"}
Jul 29 09:23:50.975459 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.975432    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"
Jul 29 09:23:50.975754 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.975487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" event={"ID":"50e27783-68de-475f-b639-45cf94e2f36d","Type":"ContainerDied","Data":"fef1816f4565d6b510a0f2959c2decdaa8d4e26f8fac09a2131f5bf5462c2ddd"}
Jul 29 09:23:50.975754 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.975507    2564 scope.go:117] "RemoveContainer" containerID="6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4"
Jul 29 09:23:50.984060 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.984041    2564 scope.go:117] "RemoveContainer" containerID="6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378"
Jul 29 09:23:50.991278 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.991262    2564 scope.go:117] "RemoveContainer" containerID="6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4"
Jul 29 09:23:50.991527 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:23:50.991504    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4\": container with ID starting with 6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4 not found: ID does not exist" containerID="6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4"
Jul 29 09:23:50.991575 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.991535    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4"} err="failed to get container status \"6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4\": rpc error: code = NotFound desc = could not find container \"6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4\": container with ID starting with 6887c61cf3b6bfc00869b60f6097dcfaea5f21e4dea82e49f05b0005547216a4 not found: ID does not exist"
Jul 29 09:23:50.991575 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.991556    2564 scope.go:117] "RemoveContainer" containerID="6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378"
Jul 29 09:23:50.991792 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:23:50.991773    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378\": container with ID starting with 6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378 not found: ID does not exist" containerID="6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378"
Jul 29 09:23:50.991883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:50.991796    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378"} err="failed to get container status \"6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378\": rpc error: code = NotFound desc = could not find container \"6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378\": container with ID starting with 6c69cf05c7f87fbc66f3d7294fa2cdc8802285ebb7579d6f08d0987ca4b90378 not found: ID does not exist"
Jul 29 09:23:51.001339 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:51.001316    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"]
Jul 29 09:23:51.005671 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:51.005649    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855"]
Jul 29 09:23:51.563007 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:51.562965    2564 patch_prober.go:28] interesting pod/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 09:23:51.563209 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:51.563038    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2dc45aaa-openshift-default-7779bb56dd-tf855" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 09:23:51.760388 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:51.760355    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50e27783-68de-475f-b639-45cf94e2f36d" path="/var/lib/kubelet/pods/50e27783-68de-475f-b639-45cf94e2f36d/volumes"
Jul 29 09:23:55.528487 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:55.528445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:55.625387 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:55.625355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:23:56.168996 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:23:56.168961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:03.186244 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:03.186211    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:03.292688 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:03.292651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:03.386989 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:03.386950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:13.888932 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:13.888896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:14.209257 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:14.209167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:35.180537 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:35.180503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:41.534053 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:41.534016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:41.639284 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:41.639254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:41.862223 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:41.862136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:42.134277 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134243    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"]
Jul 29 09:24:42.134547 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134535    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f7e60f-3a7f-4598-8c4a-ebbf85fde998" containerName="revoke-keys"
Jul 29 09:24:42.134593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134549    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f7e60f-3a7f-4598-8c4a-ebbf85fde998" containerName="revoke-keys"
Jul 29 09:24:42.134593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134557    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy"
Jul 29 09:24:42.134593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134563    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy"
Jul 29 09:24:42.134593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134569    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd96b1e0-0cef-4736-87f1-cb94437ea068" containerName="maas-api"
Jul 29 09:24:42.134593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134575    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd96b1e0-0cef-4736-87f1-cb94437ea068" containerName="maas-api"
Jul 29 09:24:42.134593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134585    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0525002d-69dc-4ffa-8f65-37eed3c538d2" containerName="payload-pre-processing"
Jul 29 09:24:42.134593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134591    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0525002d-69dc-4ffa-8f65-37eed3c538d2" containerName="payload-pre-processing"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134597    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134603    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134609    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="683b0fdd-0506-4bd3-9670-d4f4c243bfe2" containerName="payload-processing"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134615    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="683b0fdd-0506-4bd3-9670-d4f4c243bfe2" containerName="payload-processing"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134687    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134727    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0525002d-69dc-4ffa-8f65-37eed3c538d2" containerName="payload-pre-processing"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134739    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e27783-68de-475f-b639-45cf94e2f36d" containerName="istio-proxy"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134748    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="683b0fdd-0506-4bd3-9670-d4f4c243bfe2" containerName="payload-processing"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134758    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd96b1e0-0cef-4736-87f1-cb94437ea068" containerName="maas-api"
Jul 29 09:24:42.134848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.134773    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8f7e60f-3a7f-4598-8c4a-ebbf85fde998" containerName="revoke-keys"
Jul 29 09:24:42.137908 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.137891    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.140049 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.140028    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-306d65-openshift-default-dockercfg-vzzn4\""
Jul 29 09:24:42.149817 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.149792    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"]
Jul 29 09:24:42.158675 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.158635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:42.234691 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.234651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/013b745c-cb33-433d-bd99-17713011c74f-istiod-ca-cert\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.234905 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.234701    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-credential-socket\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.234905 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.234750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-certs\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.234905 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.234779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-socket\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.234905 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.234872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/013b745c-cb33-433d-bd99-17713011c74f-istio-podinfo\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.235146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.234964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptpq\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-kube-api-access-tptpq\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.235146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.234995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-envoy\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.235146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.235090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-istio-token\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.235280 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.235172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-data\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.306995 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.306964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:42.336139 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-credential-socket\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336139 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-certs\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336390 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-socket\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336390 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/013b745c-cb33-433d-bd99-17713011c74f-istio-podinfo\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336390 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptpq\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-kube-api-access-tptpq\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-envoy\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-istio-token\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-data\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336749 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/013b745c-cb33-433d-bd99-17713011c74f-istiod-ca-cert\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336749 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-certs\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336749 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-socket\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.336897 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-credential-socket\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.337019 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.336999    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-data\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.337264 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.337246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/013b745c-cb33-433d-bd99-17713011c74f-istiod-ca-cert\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.338783 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.338762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-envoy\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.338893 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.338818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/013b745c-cb33-433d-bd99-17713011c74f-istio-podinfo\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.348901 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.348878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-istio-token\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.349245 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.349226    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptpq\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-kube-api-access-tptpq\") pod \"e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") " pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.448771 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.448640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:42.582000 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.581973    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"]
Jul 29 09:24:42.583743 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:24:42.583693    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013b745c_cb33_433d_bd99_17713011c74f.slice/crio-a3d26c76b077818b4ae87cd9c87eca642d56bc4aba00a2dba32ab088a188ba8b WatchSource:0}: Error finding container a3d26c76b077818b4ae87cd9c87eca642d56bc4aba00a2dba32ab088a188ba8b: Status 404 returned error can't find the container with id a3d26c76b077818b4ae87cd9c87eca642d56bc4aba00a2dba32ab088a188ba8b
Jul 29 09:24:42.585926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.585894    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:24:42.585997 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.585964    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:24:42.586046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:42.585997    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:24:43.203346 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:43.203308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" event={"ID":"013b745c-cb33-433d-bd99-17713011c74f","Type":"ContainerStarted","Data":"ad238461dc7a022c2af8ccfdef7580c6758bd0365496f60d27829a7b2f9ca742"}
Jul 29 09:24:43.203505 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:43.203394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" event={"ID":"013b745c-cb33-433d-bd99-17713011c74f","Type":"ContainerStarted","Data":"a3d26c76b077818b4ae87cd9c87eca642d56bc4aba00a2dba32ab088a188ba8b"}
Jul 29 09:24:43.222350 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:43.222275    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" podStartSLOduration=1.222254037 podStartE2EDuration="1.222254037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:24:43.2214825 +0000 UTC m=+2231.992752577" watchObservedRunningTime="2026-07-29 09:24:43.222254037 +0000 UTC m=+2231.993524102"
Jul 29 09:24:43.448807 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:43.448766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:43.454299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:43.454234    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:44.207833 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:44.207795    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:44.208852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:44.208829    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:24:45.131232 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.131197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:45.217872 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.217836    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"]
Jul 29 09:24:45.221040 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.221012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:45.221292 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.221275    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.223241 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.223216    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-306d65-serving-cert\""
Jul 29 09:24:45.223241 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.223237    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:24:45.223421 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.223352    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:24:45.223784 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.223764    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:24:45.231273 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.231253    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"]
Jul 29 09:24:45.286977 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.286947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:45.364596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.364552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/f69a7517-e820-441f-90c8-7640734a6fc8-kube-api-access-snd6z\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.364774 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.364608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.364871 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.364848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69a7517-e820-441f-90c8-7640734a6fc8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.465545 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.465457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/f69a7517-e820-441f-90c8-7640734a6fc8-kube-api-access-snd6z\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.465545 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.465501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.465772 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.465553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69a7517-e820-441f-90c8-7640734a6fc8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.465772 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:24:45.465683    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-serving-cert: secret "maas-api-e2e-inf-a-306d65-serving-cert" not found
Jul 29 09:24:45.465861 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:24:45.465797    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls podName:f69a7517-e820-441f-90c8-7640734a6fc8 nodeName:}" failed. No retries permitted until 2026-07-29 09:24:45.965775981 +0000 UTC m=+2234.737046029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls") pod "maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq" (UID: "f69a7517-e820-441f-90c8-7640734a6fc8") : secret "maas-api-e2e-inf-a-306d65-serving-cert" not found
Jul 29 09:24:45.466232 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.466214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69a7517-e820-441f-90c8-7640734a6fc8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.473507 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.473481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/f69a7517-e820-441f-90c8-7640734a6fc8-kube-api-access-snd6z\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.545726 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.545687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:45.941599 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.941560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:45.970347 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.970321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:45.972636 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:45.972607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls\") pod \"maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:46.040427 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.040394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:24:46.068404 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.068372    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"]
Jul 29 09:24:46.071804 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.071784    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:46.073862 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.073842    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-306d65\""
Jul 29 09:24:46.073972 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.073888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-306d65-dockercfg-l9xrz\""
Jul 29 09:24:46.081030 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.081004    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"]
Jul 29 09:24:46.097544 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.097517    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"]
Jul 29 09:24:46.100756 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.100739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:46.111079 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.111052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"]
Jul 29 09:24:46.134082 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.133981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:46.171628 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.171589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00601c6-9407-4bdc-8297-e2d6647cad3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5\" (UID: \"c00601c6-9407-4bdc-8297-e2d6647cad3a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:46.171848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.171633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g\" (UID: \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\") " pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:46.171848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.171827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d7fj\" (UniqueName: \"kubernetes.io/projected/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-kube-api-access-6d7fj\") pod \"payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g\" (UID: \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\") " pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:46.171981 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.171877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46wdp\" (UniqueName: \"kubernetes.io/projected/c00601c6-9407-4bdc-8297-e2d6647cad3a-kube-api-access-46wdp\") pod \"payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5\" (UID: \"c00601c6-9407-4bdc-8297-e2d6647cad3a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:46.272777 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.272676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d7fj\" (UniqueName: \"kubernetes.io/projected/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-kube-api-access-6d7fj\") pod \"payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g\" (UID: \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\") " pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:46.272777 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.272777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46wdp\" (UniqueName: \"kubernetes.io/projected/c00601c6-9407-4bdc-8297-e2d6647cad3a-kube-api-access-46wdp\") pod \"payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5\" (UID: \"c00601c6-9407-4bdc-8297-e2d6647cad3a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:46.273309 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.272817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00601c6-9407-4bdc-8297-e2d6647cad3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5\" (UID: \"c00601c6-9407-4bdc-8297-e2d6647cad3a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:46.273309 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.272841    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g\" (UID: \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\") " pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:46.273784 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.273762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g\" (UID: \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\") " pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:46.273881 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.273867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00601c6-9407-4bdc-8297-e2d6647cad3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5\" (UID: \"c00601c6-9407-4bdc-8297-e2d6647cad3a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:46.274603 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.274582    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"]
Jul 29 09:24:46.278149 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:24:46.278097    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69a7517_e820_441f_90c8_7640734a6fc8.slice/crio-d021acfcb14e0d68792f33e006e7f7e5089b84f2390980d8a4506b28d9d28d50 WatchSource:0}: Error finding container d021acfcb14e0d68792f33e006e7f7e5089b84f2390980d8a4506b28d9d28d50: Status 404 returned error can't find the container with id d021acfcb14e0d68792f33e006e7f7e5089b84f2390980d8a4506b28d9d28d50
Jul 29 09:24:46.281756 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.281709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46wdp\" (UniqueName: \"kubernetes.io/projected/c00601c6-9407-4bdc-8297-e2d6647cad3a-kube-api-access-46wdp\") pod \"payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5\" (UID: \"c00601c6-9407-4bdc-8297-e2d6647cad3a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:46.282057 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.282038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d7fj\" (UniqueName: \"kubernetes.io/projected/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-kube-api-access-6d7fj\") pod \"payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g\" (UID: \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\") " pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:46.383594 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.383558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:46.411146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.411114    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:46.529255 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.529224    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"]
Jul 29 09:24:46.532609 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:24:46.532575    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2b9716_bab9_4d69_97dd_a8b3c04d3f57.slice/crio-493e8835e1363aad8165bd0351652600a761850965085d01373dcab4406ca1df WatchSource:0}: Error finding container 493e8835e1363aad8165bd0351652600a761850965085d01373dcab4406ca1df: Status 404 returned error can't find the container with id 493e8835e1363aad8165bd0351652600a761850965085d01373dcab4406ca1df
Jul 29 09:24:46.559148 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:46.559117    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"]
Jul 29 09:24:46.568853 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:24:46.568816    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00601c6_9407_4bdc_8297_e2d6647cad3a.slice/crio-cd5ddb276a83e2383e66b3a370eac92777f4849a0245e10a1b19339974bcabf7 WatchSource:0}: Error finding container cd5ddb276a83e2383e66b3a370eac92777f4849a0245e10a1b19339974bcabf7: Status 404 returned error can't find the container with id cd5ddb276a83e2383e66b3a370eac92777f4849a0245e10a1b19339974bcabf7
Jul 29 09:24:47.224387 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.224346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g" event={"ID":"db2b9716-bab9-4d69-97dd-a8b3c04d3f57","Type":"ContainerStarted","Data":"d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81"}
Jul 29 09:24:47.224606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.224412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g" event={"ID":"db2b9716-bab9-4d69-97dd-a8b3c04d3f57","Type":"ContainerStarted","Data":"493e8835e1363aad8165bd0351652600a761850965085d01373dcab4406ca1df"}
Jul 29 09:24:47.224606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.224472    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:47.225905 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.225875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq" event={"ID":"f69a7517-e820-441f-90c8-7640734a6fc8","Type":"ContainerStarted","Data":"9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1"}
Jul 29 09:24:47.226007 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.225926    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:47.226007 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.225952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq" event={"ID":"f69a7517-e820-441f-90c8-7640734a6fc8","Type":"ContainerStarted","Data":"d021acfcb14e0d68792f33e006e7f7e5089b84f2390980d8a4506b28d9d28d50"}
Jul 29 09:24:47.227314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.227262    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5" event={"ID":"c00601c6-9407-4bdc-8297-e2d6647cad3a","Type":"ContainerStarted","Data":"f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39"}
Jul 29 09:24:47.227314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.227297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5" event={"ID":"c00601c6-9407-4bdc-8297-e2d6647cad3a","Type":"ContainerStarted","Data":"cd5ddb276a83e2383e66b3a370eac92777f4849a0245e10a1b19339974bcabf7"}
Jul 29 09:24:47.227478 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.227393    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:47.244646 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.244592    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g" podStartSLOduration=1.2445734210000001 podStartE2EDuration="1.244573421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:24:47.243266348 +0000 UTC m=+2236.014536431" watchObservedRunningTime="2026-07-29 09:24:47.244573421 +0000 UTC m=+2236.015843487"
Jul 29 09:24:47.263140 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.263083    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5" podStartSLOduration=1.263066476 podStartE2EDuration="1.263066476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:24:47.260657323 +0000 UTC m=+2236.031927396" watchObservedRunningTime="2026-07-29 09:24:47.263066476 +0000 UTC m=+2236.034336540"
Jul 29 09:24:47.279539 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:47.279490    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq" podStartSLOduration=1.832137583 podStartE2EDuration="2.27947494s" totalImagesPullingTime="447.337357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:24:47.27797317 +0000 UTC m=+2236.049243235" watchObservedRunningTime="2026-07-29 09:24:47.27947494 +0000 UTC m=+2236.050745001"
Jul 29 09:24:53.237638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:53.237600    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:24:58.233844 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:58.233810    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:24:58.234361 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:58.234071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:24:59.230994 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:59.230959    2564 patch_prober.go:28] interesting pod/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": read tcp 10.132.0.2:50864->10.132.0.49:15021: read: connection reset by peer" start-of-body=
Jul 29 09:24:59.231181 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:59.231028    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": read tcp 10.132.0.2:50864->10.132.0.49:15021: read: connection reset by peer"
Jul 29 09:24:59.287019 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:59.286985    2564 generic.go:356] "Generic (PLEG): container finished" podID="013b745c-cb33-433d-bd99-17713011c74f" containerID="ad238461dc7a022c2af8ccfdef7580c6758bd0365496f60d27829a7b2f9ca742" exitCode=0
Jul 29 09:24:59.287478 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:59.287058    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" event={"ID":"013b745c-cb33-433d-bd99-17713011c74f","Type":"ContainerDied","Data":"ad238461dc7a022c2af8ccfdef7580c6758bd0365496f60d27829a7b2f9ca742"}
Jul 29 09:24:59.287584 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:59.287567    2564 scope.go:117] "RemoveContainer" containerID="ad238461dc7a022c2af8ccfdef7580c6758bd0365496f60d27829a7b2f9ca742"
Jul 29 09:24:59.288582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:59.288557    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:24:59.288643 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:59.288622    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:24:59.288683 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:24:59.288655    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:25:00.293289 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:00.293256    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" event={"ID":"013b745c-cb33-433d-bd99-17713011c74f","Type":"ContainerStarted","Data":"7bf8d0900da1cf1d1d0724dc52fe7481a30e41723d657486981ce801dc2f5d8d"}
Jul 29 09:25:00.449038 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:00.448996    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:25:00.449275 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:00.449256    2564 patch_prober.go:28] interesting pod/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 29 09:25:00.449322 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:00.449300    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 29 09:25:01.449999 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:01.449955    2564 patch_prober.go:28] interesting pod/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 29 09:25:01.450415 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:01.450034    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 29 09:25:02.449226 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:02.449183    2564 patch_prober.go:28] interesting pod/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 29 09:25:02.449414 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:02.449243    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 29 09:25:03.449313 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:03.449269    2564 patch_prober.go:28] interesting pod/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 29 09:25:03.449753 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:03.449345    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 29 09:25:04.452250 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:04.452216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:25:04.452658 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:04.452596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:25:04.453242 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:04.453226    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:25:10.103897 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.103861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:10.439965 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.439928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:10.733735 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.733638    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"]
Jul 29 09:25:10.737030 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.737013    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.739151 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.739129    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-612453-openshift-default-dockercfg-r9pf8\""
Jul 29 09:25:10.751513 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.751483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"]
Jul 29 09:25:10.764298 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.764266    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:10.807064 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-credential-socket\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.807255 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-certs\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.807255 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807113    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-socket\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.807255 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-podinfo\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.807255 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807229    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhghx\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-kube-api-access-vhghx\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.807432 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-token\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.807432 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istiod-ca-cert\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.807432 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-data\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.807432 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.807361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-envoy\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.907983 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.907947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-envoy\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908163 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.907994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-credential-socket\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908163 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-certs\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908289 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-socket\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908289 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-podinfo\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908407 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhghx\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-kube-api-access-vhghx\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908407 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-credential-socket\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908407 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-token\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908407 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istiod-ca-cert\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-data\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908474    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-certs\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-socket\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.908821 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.908748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-data\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.909098 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.909068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istiod-ca-cert\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.910531 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.910503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-envoy\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.910784 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.910766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-podinfo\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.916280 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.916256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-token\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:10.916698 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:10.916679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhghx\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-kube-api-access-vhghx\") pod \"e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") " pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:11.048946 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.048849    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:11.137138 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.137108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:11.188005 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.187982    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"]
Jul 29 09:25:11.190678 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:25:11.190647    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee40fd4_cd52_4cc3_88f7_d0ef0fdc444e.slice/crio-22cc85deb0944eb18c7ce8686a2905e8dd717102581a5e1a4c888002673eef44 WatchSource:0}: Error finding container 22cc85deb0944eb18c7ce8686a2905e8dd717102581a5e1a4c888002673eef44: Status 404 returned error can't find the container with id 22cc85deb0944eb18c7ce8686a2905e8dd717102581a5e1a4c888002673eef44
Jul 29 09:25:11.193303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.193264    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:25:11.193402 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.193344    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:25:11.193402 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.193392    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:25:11.355431 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.355336    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" event={"ID":"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e","Type":"ContainerStarted","Data":"8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba"}
Jul 29 09:25:11.355431 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.355402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" event={"ID":"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e","Type":"ContainerStarted","Data":"22cc85deb0944eb18c7ce8686a2905e8dd717102581a5e1a4c888002673eef44"}
Jul 29 09:25:11.385328 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:11.385274    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" podStartSLOduration=1.385257067 podStartE2EDuration="1.385257067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:25:11.383171118 +0000 UTC m=+2260.154441208" watchObservedRunningTime="2026-07-29 09:25:11.385257067 +0000 UTC m=+2260.156527135"
Jul 29 09:25:12.049394 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:12.049353    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:12.053920 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:12.053898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:12.360427 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:12.360342    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:12.366692 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:12.366659    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:13.297009 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.296974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:13.384337 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.384306    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"]
Jul 29 09:25:13.387831 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.387806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.389728 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.389694    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-612453-serving-cert\""
Jul 29 09:25:13.391890 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.391868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:13.399662 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.399636    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"]
Jul 29 09:25:13.434596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.434566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cllx7\" (UniqueName: \"kubernetes.io/projected/a02e567c-c10b-415c-8698-4b7cfdd8d083-kube-api-access-cllx7\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.434801 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.434675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.434801 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.434704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02e567c-c10b-415c-8698-4b7cfdd8d083-openshift-service-ca\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.468479 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.468450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:13.535906 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.535869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cllx7\" (UniqueName: \"kubernetes.io/projected/a02e567c-c10b-415c-8698-4b7cfdd8d083-kube-api-access-cllx7\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.536097 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.535984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.536097 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.536017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02e567c-c10b-415c-8698-4b7cfdd8d083-openshift-service-ca\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.536223 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:25:13.536135    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-serving-cert: secret "maas-api-e2e-inf-b-612453-serving-cert" not found
Jul 29 09:25:13.536223 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:25:13.536221    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls podName:a02e567c-c10b-415c-8698-4b7cfdd8d083 nodeName:}" failed. No retries permitted until 2026-07-29 09:25:14.036195943 +0000 UTC m=+2262.807465987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls") pod "maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6" (UID: "a02e567c-c10b-415c-8698-4b7cfdd8d083") : secret "maas-api-e2e-inf-b-612453-serving-cert" not found
Jul 29 09:25:13.536737 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.536696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02e567c-c10b-415c-8698-4b7cfdd8d083-openshift-service-ca\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.544411 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.544389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cllx7\" (UniqueName: \"kubernetes.io/projected/a02e567c-c10b-415c-8698-4b7cfdd8d083-kube-api-access-cllx7\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:13.923060 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:13.923016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:14.041615 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.041571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:14.044037 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.044009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls\") pod \"maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:14.051096 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.051053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:14.225694 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.225582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:14.286802 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.286765    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"]
Jul 29 09:25:14.290237 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.290222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:14.293902 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.293878    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-612453-dockercfg-9dtlx\""
Jul 29 09:25:14.294155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.294138    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-612453\""
Jul 29 09:25:14.299963 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.299946    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:14.308265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.308235    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"]
Jul 29 09:25:14.345162 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.345128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5967v\" (UniqueName: \"kubernetes.io/projected/edff2ed8-e6df-4458-8bb6-81feed357898-kube-api-access-5967v\") pod \"payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h\" (UID: \"edff2ed8-e6df-4458-8bb6-81feed357898\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:14.345338 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.345207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edff2ed8-e6df-4458-8bb6-81feed357898-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h\" (UID: \"edff2ed8-e6df-4458-8bb6-81feed357898\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:14.446478 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.446444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edff2ed8-e6df-4458-8bb6-81feed357898-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h\" (UID: \"edff2ed8-e6df-4458-8bb6-81feed357898\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:14.446960 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.446608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5967v\" (UniqueName: \"kubernetes.io/projected/edff2ed8-e6df-4458-8bb6-81feed357898-kube-api-access-5967v\") pod \"payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h\" (UID: \"edff2ed8-e6df-4458-8bb6-81feed357898\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:14.447376 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.447355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edff2ed8-e6df-4458-8bb6-81feed357898-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h\" (UID: \"edff2ed8-e6df-4458-8bb6-81feed357898\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:14.456802 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.456773    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5967v\" (UniqueName: \"kubernetes.io/projected/edff2ed8-e6df-4458-8bb6-81feed357898-kube-api-access-5967v\") pod \"payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h\" (UID: \"edff2ed8-e6df-4458-8bb6-81feed357898\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:14.600029 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.599935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:14.650234 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.650202    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"]
Jul 29 09:25:14.653566 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:25:14.653529    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02e567c_c10b_415c_8698_4b7cfdd8d083.slice/crio-808f55a1803ab6b8e363a15d1622dbdd34590c921584948aa590b808d900e2e5 WatchSource:0}: Error finding container 808f55a1803ab6b8e363a15d1622dbdd34590c921584948aa590b808d900e2e5: Status 404 returned error can't find the container with id 808f55a1803ab6b8e363a15d1622dbdd34590c921584948aa590b808d900e2e5
Jul 29 09:25:14.738420 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:14.738392    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"]
Jul 29 09:25:14.740347 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:25:14.740322    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedff2ed8_e6df_4458_8bb6_81feed357898.slice/crio-18c303eb32d169bee7a198b1424f7f7e1b678386bef2bdea2ea986db492ea78d WatchSource:0}: Error finding container 18c303eb32d169bee7a198b1424f7f7e1b678386bef2bdea2ea986db492ea78d: Status 404 returned error can't find the container with id 18c303eb32d169bee7a198b1424f7f7e1b678386bef2bdea2ea986db492ea78d
Jul 29 09:25:15.377166 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:15.377134    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h" event={"ID":"edff2ed8-e6df-4458-8bb6-81feed357898","Type":"ContainerStarted","Data":"69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478"}
Jul 29 09:25:15.377356 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:15.377194    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h" event={"ID":"edff2ed8-e6df-4458-8bb6-81feed357898","Type":"ContainerStarted","Data":"18c303eb32d169bee7a198b1424f7f7e1b678386bef2bdea2ea986db492ea78d"}
Jul 29 09:25:15.377356 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:15.377223    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:15.378679 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:15.378657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6" event={"ID":"a02e567c-c10b-415c-8698-4b7cfdd8d083","Type":"ContainerStarted","Data":"b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c"}
Jul 29 09:25:15.378769 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:15.378698    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:15.378769 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:15.378729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6" event={"ID":"a02e567c-c10b-415c-8698-4b7cfdd8d083","Type":"ContainerStarted","Data":"808f55a1803ab6b8e363a15d1622dbdd34590c921584948aa590b808d900e2e5"}
Jul 29 09:25:15.404871 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:15.404814    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h" podStartSLOduration=1.404796189 podStartE2EDuration="1.404796189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:25:15.404056444 +0000 UTC m=+2264.175326505" watchObservedRunningTime="2026-07-29 09:25:15.404796189 +0000 UTC m=+2264.176066274"
Jul 29 09:25:15.425629 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:15.425582    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6" podStartSLOduration=2.025678358 podStartE2EDuration="2.425567577s" totalImagesPullingTime="399.889219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:25:15.424425579 +0000 UTC m=+2264.195695642" watchObservedRunningTime="2026-07-29 09:25:15.425567577 +0000 UTC m=+2264.196837638"
Jul 29 09:25:21.390203 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:21.390166    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:25:26.386079 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:26.386046    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:25:28.189540 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:28.189504    2564 patch_prober.go:28] interesting pod/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:41448->10.132.0.53:15021: read: connection reset by peer" start-of-body=
Jul 29 09:25:28.189978 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:28.189598    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:41448->10.132.0.53:15021: read: connection reset by peer"
Jul 29 09:25:28.447151 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:28.447064    2564 generic.go:356] "Generic (PLEG): container finished" podID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerID="8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba" exitCode=0
Jul 29 09:25:28.447151 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:28.447111    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" event={"ID":"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e","Type":"ContainerDied","Data":"8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba"}
Jul 29 09:25:28.447487 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:28.447471    2564 scope.go:117] "RemoveContainer" containerID="8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba"
Jul 29 09:25:28.448512 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:28.448478    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:25:28.448566 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:28.448553    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:25:28.448606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:28.448586    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:25:29.457736 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:29.454377    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" event={"ID":"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e","Type":"ContainerStarted","Data":"341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428"}
Jul 29 09:25:30.049688 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:30.049642    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:30.050031 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:30.050006    2564 patch_prober.go:28] interesting pod/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 29 09:25:30.050086 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:30.050071    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 29 09:25:31.049432 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:31.049392    2564 patch_prober.go:28] interesting pod/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 29 09:25:31.049858 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:31.049451    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 29 09:25:32.049577 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:32.049537    2564 patch_prober.go:28] interesting pod/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 29 09:25:32.050020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:32.049612    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 29 09:25:33.050188 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:33.050149    2564 patch_prober.go:28] interesting pod/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 29 09:25:33.050586 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:33.050205    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 29 09:25:34.052995 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:34.052962    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:34.053372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:34.053216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:34.054043 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:34.054024    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:25:38.337250 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:38.337193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:25:42.760171 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:25:42.760117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:26:10.945689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:10.945656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:26:38.523544 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:38.523508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:26:52.861067 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:52.861029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:26:53.095907 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:53.095873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:26:53.785537 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:53.785488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:26:53.880769 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:53.880737    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"]
Jul 29 09:26:53.884324 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:53.884303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"
Jul 29 09:26:53.886344 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:53.886326    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:26:53.891928 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:53.891906    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"]
Jul 29 09:26:53.979530 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:53.979492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/375038d0-fe8a-4dc1-b617-65777254a640-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4\" (UID: \"375038d0-fe8a-4dc1-b617-65777254a640\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"
Jul 29 09:26:54.080276 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:54.080201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/375038d0-fe8a-4dc1-b617-65777254a640-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4\" (UID: \"375038d0-fe8a-4dc1-b617-65777254a640\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"
Jul 29 09:26:54.080835 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:54.080816    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/375038d0-fe8a-4dc1-b617-65777254a640-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4\" (UID: \"375038d0-fe8a-4dc1-b617-65777254a640\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"
Jul 29 09:26:54.195776 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:54.195743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"
Jul 29 09:26:54.327392 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:54.327366    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"]
Jul 29 09:26:54.330378 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:26:54.330306    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375038d0_fe8a_4dc1_b617_65777254a640.slice/crio-68c7d1bfbf24a2a0b8718c422d19e2e842e63ad4821fdc998ee2a4c967e50bf9 WatchSource:0}: Error finding container 68c7d1bfbf24a2a0b8718c422d19e2e842e63ad4821fdc998ee2a4c967e50bf9: Status 404 returned error can't find the container with id 68c7d1bfbf24a2a0b8718c422d19e2e842e63ad4821fdc998ee2a4c967e50bf9
Jul 29 09:26:54.851734 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:54.851683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4" event={"ID":"375038d0-fe8a-4dc1-b617-65777254a640","Type":"ContainerStarted","Data":"3ac8e5b46e863e83b99029cc6215b4d56b302b8a0fcedf8e61ab888b5a03cf36"}
Jul 29 09:26:54.851899 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:54.851753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4" event={"ID":"375038d0-fe8a-4dc1-b617-65777254a640","Type":"ContainerStarted","Data":"68c7d1bfbf24a2a0b8718c422d19e2e842e63ad4821fdc998ee2a4c967e50bf9"}
Jul 29 09:26:54.869329 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:54.869250    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4" podStartSLOduration=1.8692301260000002 podStartE2EDuration="1.869230126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:26:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:26:54.867189657 +0000 UTC m=+2363.638459722" watchObservedRunningTime="2026-07-29 09:26:54.869230126 +0000 UTC m=+2363.640500192"
Jul 29 09:26:55.857923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:55.857892    2564 generic.go:356] "Generic (PLEG): container finished" podID="375038d0-fe8a-4dc1-b617-65777254a640" containerID="3ac8e5b46e863e83b99029cc6215b4d56b302b8a0fcedf8e61ab888b5a03cf36" exitCode=0
Jul 29 09:26:55.858301 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:55.857940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4" event={"ID":"375038d0-fe8a-4dc1-b617-65777254a640","Type":"ContainerDied","Data":"3ac8e5b46e863e83b99029cc6215b4d56b302b8a0fcedf8e61ab888b5a03cf36"}
Jul 29 09:26:56.996470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:56.996439    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"
Jul 29 09:26:57.107704 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:57.107666    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/375038d0-fe8a-4dc1-b617-65777254a640-maas-api-service-ca\") pod \"375038d0-fe8a-4dc1-b617-65777254a640\" (UID: \"375038d0-fe8a-4dc1-b617-65777254a640\") "
Jul 29 09:26:57.108087 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:57.108066    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/375038d0-fe8a-4dc1-b617-65777254a640-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "375038d0-fe8a-4dc1-b617-65777254a640" (UID: "375038d0-fe8a-4dc1-b617-65777254a640"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:26:57.208460 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:57.208413    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/375038d0-fe8a-4dc1-b617-65777254a640-maas-api-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:26:57.868621 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:57.868588    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"
Jul 29 09:26:57.868787 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:57.868623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4" event={"ID":"375038d0-fe8a-4dc1-b617-65777254a640","Type":"ContainerDied","Data":"68c7d1bfbf24a2a0b8718c422d19e2e842e63ad4821fdc998ee2a4c967e50bf9"}
Jul 29 09:26:57.868787 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:57.868671    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68c7d1bfbf24a2a0b8718c422d19e2e842e63ad4821fdc998ee2a4c967e50bf9"
Jul 29 09:26:58.884209 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:58.884173    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"]
Jul 29 09:26:58.884618 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:58.884463    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq" podUID="f69a7517-e820-441f-90c8-7640734a6fc8" containerName="maas-api" containerID="cri-o://9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1" gracePeriod=30
Jul 29 09:26:58.909043 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:58.909010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:26:58.938442 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:58.938407    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"]
Jul 29 09:26:58.938708 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:58.938678    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g" podUID="db2b9716-bab9-4d69-97dd-a8b3c04d3f57" containerName="payload-processing" containerID="cri-o://d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81" gracePeriod=30
Jul 29 09:26:58.944911 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:58.944882    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"]
Jul 29 09:26:58.945222 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:58.945196    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5" podUID="c00601c6-9407-4bdc-8297-e2d6647cad3a" containerName="payload-pre-processing" containerID="cri-o://f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39" gracePeriod=30
Jul 29 09:26:59.099732 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.099643    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"]
Jul 29 09:26:59.102749 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.102697    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-306d65-qhbg4"]
Jul 29 09:26:59.205180 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.205155    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:26:59.237902 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.237870    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:26:59.248355 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.248327    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:26:59.328466 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.328434    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d7fj\" (UniqueName: \"kubernetes.io/projected/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-kube-api-access-6d7fj\") pod \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\" (UID: \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\") "
Jul 29 09:26:59.328636 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.328485    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-plugins-config-volume\") pod \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\" (UID: \"db2b9716-bab9-4d69-97dd-a8b3c04d3f57\") "
Jul 29 09:26:59.328915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.328886    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db2b9716-bab9-4d69-97dd-a8b3c04d3f57" (UID: "db2b9716-bab9-4d69-97dd-a8b3c04d3f57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:26:59.330602 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.330580    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-kube-api-access-6d7fj" (OuterVolumeSpecName: "kube-api-access-6d7fj") pod "db2b9716-bab9-4d69-97dd-a8b3c04d3f57" (UID: "db2b9716-bab9-4d69-97dd-a8b3c04d3f57"). InnerVolumeSpecName "kube-api-access-6d7fj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:26:59.429654 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.429570    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00601c6-9407-4bdc-8297-e2d6647cad3a-plugins-config-volume\") pod \"c00601c6-9407-4bdc-8297-e2d6647cad3a\" (UID: \"c00601c6-9407-4bdc-8297-e2d6647cad3a\") "
Jul 29 09:26:59.429842 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.429660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/f69a7517-e820-441f-90c8-7640734a6fc8-kube-api-access-snd6z\") pod \"f69a7517-e820-441f-90c8-7640734a6fc8\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") "
Jul 29 09:26:59.429842 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.429787    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69a7517-e820-441f-90c8-7640734a6fc8-openshift-service-ca\") pod \"f69a7517-e820-441f-90c8-7640734a6fc8\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") "
Jul 29 09:26:59.429842 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.429827    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls\") pod \"f69a7517-e820-441f-90c8-7640734a6fc8\" (UID: \"f69a7517-e820-441f-90c8-7640734a6fc8\") "
Jul 29 09:26:59.429989 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.429856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46wdp\" (UniqueName: \"kubernetes.io/projected/c00601c6-9407-4bdc-8297-e2d6647cad3a-kube-api-access-46wdp\") pod \"c00601c6-9407-4bdc-8297-e2d6647cad3a\" (UID: \"c00601c6-9407-4bdc-8297-e2d6647cad3a\") "
Jul 29 09:26:59.429989 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.429960    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00601c6-9407-4bdc-8297-e2d6647cad3a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c00601c6-9407-4bdc-8297-e2d6647cad3a" (UID: "c00601c6-9407-4bdc-8297-e2d6647cad3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:26:59.430122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.430097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69a7517-e820-441f-90c8-7640734a6fc8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f69a7517-e820-441f-90c8-7640734a6fc8" (UID: "f69a7517-e820-441f-90c8-7640734a6fc8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:26:59.430187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.430169    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69a7517-e820-441f-90c8-7640734a6fc8-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:26:59.430235 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.430189    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00601c6-9407-4bdc-8297-e2d6647cad3a-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:26:59.430235 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.430200    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d7fj\" (UniqueName: \"kubernetes.io/projected/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-kube-api-access-6d7fj\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:26:59.430235 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.430208    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db2b9716-bab9-4d69-97dd-a8b3c04d3f57-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:26:59.431797 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.431772    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69a7517-e820-441f-90c8-7640734a6fc8-kube-api-access-snd6z" (OuterVolumeSpecName: "kube-api-access-snd6z") pod "f69a7517-e820-441f-90c8-7640734a6fc8" (UID: "f69a7517-e820-441f-90c8-7640734a6fc8"). InnerVolumeSpecName "kube-api-access-snd6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:26:59.431909 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.431890    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00601c6-9407-4bdc-8297-e2d6647cad3a-kube-api-access-46wdp" (OuterVolumeSpecName: "kube-api-access-46wdp") pod "c00601c6-9407-4bdc-8297-e2d6647cad3a" (UID: "c00601c6-9407-4bdc-8297-e2d6647cad3a"). InnerVolumeSpecName "kube-api-access-46wdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:26:59.431975 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.431947    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f69a7517-e820-441f-90c8-7640734a6fc8" (UID: "f69a7517-e820-441f-90c8-7640734a6fc8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:26:59.531152 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.531105    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/f69a7517-e820-441f-90c8-7640734a6fc8-kube-api-access-snd6z\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:26:59.531152 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.531147    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69a7517-e820-441f-90c8-7640734a6fc8-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:26:59.531152 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.531158    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46wdp\" (UniqueName: \"kubernetes.io/projected/c00601c6-9407-4bdc-8297-e2d6647cad3a-kube-api-access-46wdp\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:26:59.762082 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.762001    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="375038d0-fe8a-4dc1-b617-65777254a640" path="/var/lib/kubelet/pods/375038d0-fe8a-4dc1-b617-65777254a640/volumes"
Jul 29 09:26:59.879729 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.879688    2564 generic.go:356] "Generic (PLEG): container finished" podID="db2b9716-bab9-4d69-97dd-a8b3c04d3f57" containerID="d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81" exitCode=0
Jul 29 09:26:59.879926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.879756    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"
Jul 29 09:26:59.879926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.879776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g" event={"ID":"db2b9716-bab9-4d69-97dd-a8b3c04d3f57","Type":"ContainerDied","Data":"d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81"}
Jul 29 09:26:59.879926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.879835    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g" event={"ID":"db2b9716-bab9-4d69-97dd-a8b3c04d3f57","Type":"ContainerDied","Data":"493e8835e1363aad8165bd0351652600a761850965085d01373dcab4406ca1df"}
Jul 29 09:26:59.879926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.879868    2564 scope.go:117] "RemoveContainer" containerID="d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81"
Jul 29 09:26:59.881163 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.881133    2564 generic.go:356] "Generic (PLEG): container finished" podID="f69a7517-e820-441f-90c8-7640734a6fc8" containerID="9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1" exitCode=0
Jul 29 09:26:59.881259 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.881187    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"
Jul 29 09:26:59.881259 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.881200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq" event={"ID":"f69a7517-e820-441f-90c8-7640734a6fc8","Type":"ContainerDied","Data":"9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1"}
Jul 29 09:26:59.881259 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.881239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq" event={"ID":"f69a7517-e820-441f-90c8-7640734a6fc8","Type":"ContainerDied","Data":"d021acfcb14e0d68792f33e006e7f7e5089b84f2390980d8a4506b28d9d28d50"}
Jul 29 09:26:59.882769 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.882746    2564 generic.go:356] "Generic (PLEG): container finished" podID="c00601c6-9407-4bdc-8297-e2d6647cad3a" containerID="f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39" exitCode=0
Jul 29 09:26:59.882892 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.882815    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"
Jul 29 09:26:59.882892 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.882835    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5" event={"ID":"c00601c6-9407-4bdc-8297-e2d6647cad3a","Type":"ContainerDied","Data":"f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39"}
Jul 29 09:26:59.882892 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.882877    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5" event={"ID":"c00601c6-9407-4bdc-8297-e2d6647cad3a","Type":"ContainerDied","Data":"cd5ddb276a83e2383e66b3a370eac92777f4849a0245e10a1b19339974bcabf7"}
Jul 29 09:26:59.891217 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.891044    2564 scope.go:117] "RemoveContainer" containerID="d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81"
Jul 29 09:26:59.891436 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:26:59.891318    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81\": container with ID starting with d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81 not found: ID does not exist" containerID="d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81"
Jul 29 09:26:59.891436 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.891342    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81"} err="failed to get container status \"d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81\": rpc error: code = NotFound desc = could not find container \"d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81\": container with ID starting with d07df06511956fe79044a318771614cddc8385aaaf54414e7188095c3ecf4e81 not found: ID does not exist"
Jul 29 09:26:59.891436 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.891360    2564 scope.go:117] "RemoveContainer" containerID="9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1"
Jul 29 09:26:59.898786 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.898769    2564 scope.go:117] "RemoveContainer" containerID="9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1"
Jul 29 09:26:59.899048 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:26:59.899031    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1\": container with ID starting with 9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1 not found: ID does not exist" containerID="9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1"
Jul 29 09:26:59.899106 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.899056    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1"} err="failed to get container status \"9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1\": rpc error: code = NotFound desc = could not find container \"9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1\": container with ID starting with 9088a97817bbaef2994be361ac8745f4b03187b374d7eef8e441f078ae60d1f1 not found: ID does not exist"
Jul 29 09:26:59.899106 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.899074    2564 scope.go:117] "RemoveContainer" containerID="f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39"
Jul 29 09:26:59.904602 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.904574    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"]
Jul 29 09:26:59.910748 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.910728    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-306d65-869fbf4cd4-rtzs5"]
Jul 29 09:26:59.914442 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.914424    2564 scope.go:117] "RemoveContainer" containerID="f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39"
Jul 29 09:26:59.914767 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:26:59.914744    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39\": container with ID starting with f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39 not found: ID does not exist" containerID="f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39"
Jul 29 09:26:59.914843 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.914777    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39"} err="failed to get container status \"f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39\": rpc error: code = NotFound desc = could not find container \"f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39\": container with ID starting with f36c4ab3c029adaf63a5892998011d49ad91005cdf15168f72477727b3ccac39 not found: ID does not exist"
Jul 29 09:26:59.923106 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.923079    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"]
Jul 29 09:26:59.926244 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.926226    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-306d65-78f95654bb-r4rqq"]
Jul 29 09:26:59.939292 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.939270    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"]
Jul 29 09:26:59.951992 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:26:59.951969    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-306d65-575757bbcd-7jp2g"]
Jul 29 09:27:00.653078 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:00.653046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:01.760667 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:01.760634    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00601c6-9407-4bdc-8297-e2d6647cad3a" path="/var/lib/kubelet/pods/c00601c6-9407-4bdc-8297-e2d6647cad3a/volumes"
Jul 29 09:27:01.761076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:01.761005    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db2b9716-bab9-4d69-97dd-a8b3c04d3f57" path="/var/lib/kubelet/pods/db2b9716-bab9-4d69-97dd-a8b3c04d3f57/volumes"
Jul 29 09:27:01.761350 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:01.761337    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69a7517-e820-441f-90c8-7640734a6fc8" path="/var/lib/kubelet/pods/f69a7517-e820-441f-90c8-7640734a6fc8/volumes"
Jul 29 09:27:04.546413 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:04.546381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:10.499402 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:10.499369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:10.762228 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:10.762132    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"]
Jul 29 09:27:10.762403 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:10.762335    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy" containerID="cri-o://7bf8d0900da1cf1d1d0724dc52fe7481a30e41723d657486981ce801dc2f5d8d" gracePeriod=30
Jul 29 09:27:10.782206 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:10.782175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:11.009966 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.009933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:11.126425 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126387    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"]
Jul 29 09:27:11.126746 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126733    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db2b9716-bab9-4d69-97dd-a8b3c04d3f57" containerName="payload-processing"
Jul 29 09:27:11.126808 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126747    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db2b9716-bab9-4d69-97dd-a8b3c04d3f57" containerName="payload-processing"
Jul 29 09:27:11.126808 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126758    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375038d0-fe8a-4dc1-b617-65777254a640" containerName="revoke-keys"
Jul 29 09:27:11.126808 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126763    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="375038d0-fe8a-4dc1-b617-65777254a640" containerName="revoke-keys"
Jul 29 09:27:11.126808 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126776    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69a7517-e820-441f-90c8-7640734a6fc8" containerName="maas-api"
Jul 29 09:27:11.126808 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126783    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69a7517-e820-441f-90c8-7640734a6fc8" containerName="maas-api"
Jul 29 09:27:11.126808 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126796    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00601c6-9407-4bdc-8297-e2d6647cad3a" containerName="payload-pre-processing"
Jul 29 09:27:11.126808 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126801    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00601c6-9407-4bdc-8297-e2d6647cad3a" containerName="payload-pre-processing"
Jul 29 09:27:11.127015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126857    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="375038d0-fe8a-4dc1-b617-65777254a640" containerName="revoke-keys"
Jul 29 09:27:11.127015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126867    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69a7517-e820-441f-90c8-7640734a6fc8" containerName="maas-api"
Jul 29 09:27:11.127015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126875    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db2b9716-bab9-4d69-97dd-a8b3c04d3f57" containerName="payload-processing"
Jul 29 09:27:11.127015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.126881    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00601c6-9407-4bdc-8297-e2d6647cad3a" containerName="payload-pre-processing"
Jul 29 09:27:11.129784 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.129769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"
Jul 29 09:27:11.131777 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.131756    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:27:11.136622 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.136600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"]
Jul 29 09:27:11.238866 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.238832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9917a7d5-0cfd-4de7-ac88-1f6543548929-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-612453-5wp66\" (UID: \"9917a7d5-0cfd-4de7-ac88-1f6543548929\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"
Jul 29 09:27:11.339459 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.339422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9917a7d5-0cfd-4de7-ac88-1f6543548929-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-612453-5wp66\" (UID: \"9917a7d5-0cfd-4de7-ac88-1f6543548929\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"
Jul 29 09:27:11.340086 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.340068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9917a7d5-0cfd-4de7-ac88-1f6543548929-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-612453-5wp66\" (UID: \"9917a7d5-0cfd-4de7-ac88-1f6543548929\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"
Jul 29 09:27:11.442865 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.442777    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"
Jul 29 09:27:11.569995 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.569962    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"]
Jul 29 09:27:11.572830 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:27:11.572802    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9917a7d5_0cfd_4de7_ac88_1f6543548929.slice/crio-4a0b955a85377eb422808de0da8ff4ce63a385c7451abf5572757ad3274407ff WatchSource:0}: Error finding container 4a0b955a85377eb422808de0da8ff4ce63a385c7451abf5572757ad3274407ff: Status 404 returned error can't find the container with id 4a0b955a85377eb422808de0da8ff4ce63a385c7451abf5572757ad3274407ff
Jul 29 09:27:11.939795 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.939759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66" event={"ID":"9917a7d5-0cfd-4de7-ac88-1f6543548929","Type":"ContainerStarted","Data":"52534892c0c8f53cb42ca97b0bcc23af41653b3a605663ab56714a4a81105674"}
Jul 29 09:27:11.939971 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.939818    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66" event={"ID":"9917a7d5-0cfd-4de7-ac88-1f6543548929","Type":"ContainerStarted","Data":"4a0b955a85377eb422808de0da8ff4ce63a385c7451abf5572757ad3274407ff"}
Jul 29 09:27:11.968994 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:11.968940    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66" podStartSLOduration=0.968922239 podStartE2EDuration="968.922239ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:27:11.968351352 +0000 UTC m=+2380.739621415" watchObservedRunningTime="2026-07-29 09:27:11.968922239 +0000 UTC m=+2380.740192303"
Jul 29 09:27:12.945146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:12.945111    2564 generic.go:356] "Generic (PLEG): container finished" podID="9917a7d5-0cfd-4de7-ac88-1f6543548929" containerID="52534892c0c8f53cb42ca97b0bcc23af41653b3a605663ab56714a4a81105674" exitCode=0
Jul 29 09:27:12.945527 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:12.945200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66" event={"ID":"9917a7d5-0cfd-4de7-ac88-1f6543548929","Type":"ContainerDied","Data":"52534892c0c8f53cb42ca97b0bcc23af41653b3a605663ab56714a4a81105674"}
Jul 29 09:27:14.076702 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:14.076678    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"
Jul 29 09:27:14.163080 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:14.163045    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9917a7d5-0cfd-4de7-ac88-1f6543548929-maas-api-service-ca\") pod \"9917a7d5-0cfd-4de7-ac88-1f6543548929\" (UID: \"9917a7d5-0cfd-4de7-ac88-1f6543548929\") "
Jul 29 09:27:14.163445 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:14.163423    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9917a7d5-0cfd-4de7-ac88-1f6543548929-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9917a7d5-0cfd-4de7-ac88-1f6543548929" (UID: "9917a7d5-0cfd-4de7-ac88-1f6543548929"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:27:14.264585 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:14.264504    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9917a7d5-0cfd-4de7-ac88-1f6543548929-maas-api-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:14.955877 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:14.955843    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"
Jul 29 09:27:14.956053 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:14.955881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66" event={"ID":"9917a7d5-0cfd-4de7-ac88-1f6543548929","Type":"ContainerDied","Data":"4a0b955a85377eb422808de0da8ff4ce63a385c7451abf5572757ad3274407ff"}
Jul 29 09:27:14.956053 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:14.955922    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a0b955a85377eb422808de0da8ff4ce63a385c7451abf5572757ad3274407ff"
Jul 29 09:27:15.963033 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:15.962998    2564 generic.go:356] "Generic (PLEG): container finished" podID="013b745c-cb33-433d-bd99-17713011c74f" containerID="7bf8d0900da1cf1d1d0724dc52fe7481a30e41723d657486981ce801dc2f5d8d" exitCode=0
Jul 29 09:27:15.963442 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:15.963045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" event={"ID":"013b745c-cb33-433d-bd99-17713011c74f","Type":"ContainerDied","Data":"7bf8d0900da1cf1d1d0724dc52fe7481a30e41723d657486981ce801dc2f5d8d"}
Jul 29 09:27:15.963442 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:15.963110    2564 scope.go:117] "RemoveContainer" containerID="ad238461dc7a022c2af8ccfdef7580c6758bd0365496f60d27829a7b2f9ca742"
Jul 29 09:27:16.014423 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.014402    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:27:16.081182 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081086    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/013b745c-cb33-433d-bd99-17713011c74f-istiod-ca-cert\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081182 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081153    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-certs\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081392 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081191    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-istio-token\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081392 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081230    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/013b745c-cb33-433d-bd99-17713011c74f-istio-podinfo\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081392 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081258    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-data\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081686 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-socket\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081686 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:16.081686 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081452    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-envoy\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081686 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081492    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-credential-socket\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081686 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081517    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tptpq\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-kube-api-access-tptpq\") pod \"013b745c-cb33-433d-bd99-17713011c74f\" (UID: \"013b745c-cb33-433d-bd99-17713011c74f\") "
Jul 29 09:27:16.081686 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081578    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/013b745c-cb33-433d-bd99-17713011c74f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:27:16.082018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081832    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:16.082018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:16.082018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081977    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.082018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.081997    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/013b745c-cb33-433d-bd99-17713011c74f-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.082018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.082013    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.082269 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.082248    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-data" (OuterVolumeSpecName: "istio-data") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:16.083760 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.083708    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:16.083872 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.083845    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/013b745c-cb33-433d-bd99-17713011c74f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:27:16.083938 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.083907    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-kube-api-access-tptpq" (OuterVolumeSpecName: "kube-api-access-tptpq") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "kube-api-access-tptpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:27:16.084010 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.083991    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-istio-token" (OuterVolumeSpecName: "istio-token") pod "013b745c-cb33-433d-bd99-17713011c74f" (UID: "013b745c-cb33-433d-bd99-17713011c74f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:27:16.182896 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.182858    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/013b745c-cb33-433d-bd99-17713011c74f-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.182896 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.182890    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.182896 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.182899    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.183134 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.182912    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/013b745c-cb33-433d-bd99-17713011c74f-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.183134 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.182921    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tptpq\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-kube-api-access-tptpq\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.183134 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.182932    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013b745c-cb33-433d-bd99-17713011c74f-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:16.969628 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.969596    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"
Jul 29 09:27:16.970045 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.969593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml" event={"ID":"013b745c-cb33-433d-bd99-17713011c74f","Type":"ContainerDied","Data":"a3d26c76b077818b4ae87cd9c87eca642d56bc4aba00a2dba32ab088a188ba8b"}
Jul 29 09:27:16.970045 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.969749    2564 scope.go:117] "RemoveContainer" containerID="7bf8d0900da1cf1d1d0724dc52fe7481a30e41723d657486981ce801dc2f5d8d"
Jul 29 09:27:16.991370 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.991341    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"]
Jul 29 09:27:16.995478 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:16.995449    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-306d65-openshift-default-5cd666dc66-xg8ml"]
Jul 29 09:27:17.760599 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:17.760564    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="013b745c-cb33-433d-bd99-17713011c74f" path="/var/lib/kubelet/pods/013b745c-cb33-433d-bd99-17713011c74f/volumes"
Jul 29 09:27:21.559288 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.559256    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"]
Jul 29 09:27:21.559740 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.559460    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6" podUID="a02e567c-c10b-415c-8698-4b7cfdd8d083" containerName="maas-api" containerID="cri-o://b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c" gracePeriod=30
Jul 29 09:27:21.592479 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.592447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:21.626039 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.625993    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"]
Jul 29 09:27:21.626312 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.626273    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h" podUID="edff2ed8-e6df-4458-8bb6-81feed357898" containerName="payload-pre-processing" containerID="cri-o://69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478" gracePeriod=30
Jul 29 09:27:21.693624 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.693588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:21.779054 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.779014    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"]
Jul 29 09:27:21.783437 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.783387    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-612453-5wp66"]
Jul 29 09:27:21.784812 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.784782    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:21.881049 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.881015    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:27:21.894007 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.893972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:21.916212 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.916190    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:27:21.935039 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.935004    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls\") pod \"a02e567c-c10b-415c-8698-4b7cfdd8d083\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") "
Jul 29 09:27:21.935205 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.935066    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cllx7\" (UniqueName: \"kubernetes.io/projected/a02e567c-c10b-415c-8698-4b7cfdd8d083-kube-api-access-cllx7\") pod \"a02e567c-c10b-415c-8698-4b7cfdd8d083\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") "
Jul 29 09:27:21.935295 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.935261    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02e567c-c10b-415c-8698-4b7cfdd8d083-openshift-service-ca\") pod \"a02e567c-c10b-415c-8698-4b7cfdd8d083\" (UID: \"a02e567c-c10b-415c-8698-4b7cfdd8d083\") "
Jul 29 09:27:21.935790 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.935759    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a02e567c-c10b-415c-8698-4b7cfdd8d083-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a02e567c-c10b-415c-8698-4b7cfdd8d083" (UID: "a02e567c-c10b-415c-8698-4b7cfdd8d083"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:27:21.937325 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.937303    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a02e567c-c10b-415c-8698-4b7cfdd8d083-kube-api-access-cllx7" (OuterVolumeSpecName: "kube-api-access-cllx7") pod "a02e567c-c10b-415c-8698-4b7cfdd8d083" (UID: "a02e567c-c10b-415c-8698-4b7cfdd8d083"). InnerVolumeSpecName "kube-api-access-cllx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:27:21.937413 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.937316    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a02e567c-c10b-415c-8698-4b7cfdd8d083" (UID: "a02e567c-c10b-415c-8698-4b7cfdd8d083"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:27:21.993857 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.993825    2564 generic.go:356] "Generic (PLEG): container finished" podID="a02e567c-c10b-415c-8698-4b7cfdd8d083" containerID="b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c" exitCode=0
Jul 29 09:27:21.994048 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.993872    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"
Jul 29 09:27:21.994048 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.993914    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6" event={"ID":"a02e567c-c10b-415c-8698-4b7cfdd8d083","Type":"ContainerDied","Data":"b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c"}
Jul 29 09:27:21.994048 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.994000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6" event={"ID":"a02e567c-c10b-415c-8698-4b7cfdd8d083","Type":"ContainerDied","Data":"808f55a1803ab6b8e363a15d1622dbdd34590c921584948aa590b808d900e2e5"}
Jul 29 09:27:21.994048 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.994030    2564 scope.go:117] "RemoveContainer" containerID="b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c"
Jul 29 09:27:21.995276 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.995257    2564 generic.go:356] "Generic (PLEG): container finished" podID="edff2ed8-e6df-4458-8bb6-81feed357898" containerID="69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478" exitCode=0
Jul 29 09:27:21.995374 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.995293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h" event={"ID":"edff2ed8-e6df-4458-8bb6-81feed357898","Type":"ContainerDied","Data":"69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478"}
Jul 29 09:27:21.995374 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.995301    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"
Jul 29 09:27:21.995374 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:21.995326    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h" event={"ID":"edff2ed8-e6df-4458-8bb6-81feed357898","Type":"ContainerDied","Data":"18c303eb32d169bee7a198b1424f7f7e1b678386bef2bdea2ea986db492ea78d"}
Jul 29 09:27:22.003278 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.003240    2564 scope.go:117] "RemoveContainer" containerID="b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c"
Jul 29 09:27:22.003641 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:27:22.003613    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c\": container with ID starting with b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c not found: ID does not exist" containerID="b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c"
Jul 29 09:27:22.003773 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.003649    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c"} err="failed to get container status \"b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c\": rpc error: code = NotFound desc = could not find container \"b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c\": container with ID starting with b8f20e7944aeae8590ecd4af272b0efe371d443b164ab8fcc56f9ce6ffeb470c not found: ID does not exist"
Jul 29 09:27:22.003773 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.003691    2564 scope.go:117] "RemoveContainer" containerID="69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478"
Jul 29 09:27:22.017179 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.017129    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"]
Jul 29 09:27:22.018607 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.017658    2564 scope.go:117] "RemoveContainer" containerID="69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478"
Jul 29 09:27:22.018607 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:27:22.018559    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478\": container with ID starting with 69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478 not found: ID does not exist" containerID="69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478"
Jul 29 09:27:22.018607 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.018592    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478"} err="failed to get container status \"69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478\": rpc error: code = NotFound desc = could not find container \"69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478\": container with ID starting with 69898878bd4a021745a658c18f719defd5530b3202e0dc317d65b1ee9c730478 not found: ID does not exist"
Jul 29 09:27:22.021358 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.021332    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-612453-67b4fbb85d-sd5n6"]
Jul 29 09:27:22.036444 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.036404    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5967v\" (UniqueName: \"kubernetes.io/projected/edff2ed8-e6df-4458-8bb6-81feed357898-kube-api-access-5967v\") pod \"edff2ed8-e6df-4458-8bb6-81feed357898\" (UID: \"edff2ed8-e6df-4458-8bb6-81feed357898\") "
Jul 29 09:27:22.036444 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.036448    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edff2ed8-e6df-4458-8bb6-81feed357898-plugins-config-volume\") pod \"edff2ed8-e6df-4458-8bb6-81feed357898\" (UID: \"edff2ed8-e6df-4458-8bb6-81feed357898\") "
Jul 29 09:27:22.036677 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.036625    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02e567c-c10b-415c-8698-4b7cfdd8d083-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:22.036677 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.036638    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02e567c-c10b-415c-8698-4b7cfdd8d083-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:22.036677 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.036647    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cllx7\" (UniqueName: \"kubernetes.io/projected/a02e567c-c10b-415c-8698-4b7cfdd8d083-kube-api-access-cllx7\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:22.036908 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.036882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edff2ed8-e6df-4458-8bb6-81feed357898-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "edff2ed8-e6df-4458-8bb6-81feed357898" (UID: "edff2ed8-e6df-4458-8bb6-81feed357898"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:27:22.038408 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.038388    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edff2ed8-e6df-4458-8bb6-81feed357898-kube-api-access-5967v" (OuterVolumeSpecName: "kube-api-access-5967v") pod "edff2ed8-e6df-4458-8bb6-81feed357898" (UID: "edff2ed8-e6df-4458-8bb6-81feed357898"). InnerVolumeSpecName "kube-api-access-5967v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:27:22.137538 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.137505    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5967v\" (UniqueName: \"kubernetes.io/projected/edff2ed8-e6df-4458-8bb6-81feed357898-kube-api-access-5967v\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:22.137538 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.137536    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edff2ed8-e6df-4458-8bb6-81feed357898-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:22.155695 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.155669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:22.315608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.315571    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"]
Jul 29 09:27:22.319464 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:22.319436    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-612453-54c54f4f6-qvd5h"]
Jul 29 09:27:23.760198 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:23.760163    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9917a7d5-0cfd-4de7-ac88-1f6543548929" path="/var/lib/kubelet/pods/9917a7d5-0cfd-4de7-ac88-1f6543548929/volumes"
Jul 29 09:27:23.760674 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:23.760649    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a02e567c-c10b-415c-8698-4b7cfdd8d083" path="/var/lib/kubelet/pods/a02e567c-c10b-415c-8698-4b7cfdd8d083/volumes"
Jul 29 09:27:23.761013 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:23.760998    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edff2ed8-e6df-4458-8bb6-81feed357898" path="/var/lib/kubelet/pods/edff2ed8-e6df-4458-8bb6-81feed357898/volumes"
Jul 29 09:27:28.145444 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:28.145405    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:28.245566 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:28.245531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:28.367291 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:28.367257    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"]
Jul 29 09:27:28.367470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:28.367448    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy" containerID="cri-o://341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428" gracePeriod=30
Jul 29 09:27:28.408884 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:28.408800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:28.885659 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:28.885622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:28.987296 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:28.987257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:29.214068 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.213955    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"]
Jul 29 09:27:29.214470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214375    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy"
Jul 29 09:27:29.214470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214391    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy"
Jul 29 09:27:29.214470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214407    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9917a7d5-0cfd-4de7-ac88-1f6543548929" containerName="revoke-keys"
Jul 29 09:27:29.214470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214413    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9917a7d5-0cfd-4de7-ac88-1f6543548929" containerName="revoke-keys"
Jul 29 09:27:29.214470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214424    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edff2ed8-e6df-4458-8bb6-81feed357898" containerName="payload-pre-processing"
Jul 29 09:27:29.214470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214430    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="edff2ed8-e6df-4458-8bb6-81feed357898" containerName="payload-pre-processing"
Jul 29 09:27:29.214470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214438    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a02e567c-c10b-415c-8698-4b7cfdd8d083" containerName="maas-api"
Jul 29 09:27:29.214470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214445    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a02e567c-c10b-415c-8698-4b7cfdd8d083" containerName="maas-api"
Jul 29 09:27:29.214788 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214498    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a02e567c-c10b-415c-8698-4b7cfdd8d083" containerName="maas-api"
Jul 29 09:27:29.214788 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214508    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="edff2ed8-e6df-4458-8bb6-81feed357898" containerName="payload-pre-processing"
Jul 29 09:27:29.214788 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214516    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy"
Jul 29 09:27:29.214788 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214522    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9917a7d5-0cfd-4de7-ac88-1f6543548929" containerName="revoke-keys"
Jul 29 09:27:29.214788 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.214528    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy"
Jul 29 09:27:29.219127 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.219106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.221145 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.221123    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d0f1b8-openshift-default-dockercfg-72kdh\""
Jul 29 09:27:29.231854 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.231829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"]
Jul 29 09:27:29.242961 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.242922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:29.305200 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-data\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.305200 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-podinfo\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.305458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-credential-socket\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.305458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwnd\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-kube-api-access-cpwnd\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.305458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-certs\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.305619 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-envoy\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.305619 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-socket\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.305747 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aae234a-7181-4ea6-aba8-0d0541389ec2-istiod-ca-cert\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.305747 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.305650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-token\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406561 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-data\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406561 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-podinfo\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-credential-socket\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwnd\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-kube-api-access-cpwnd\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-certs\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-envoy\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-socket\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aae234a-7181-4ea6-aba8-0d0541389ec2-istiod-ca-cert\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.406860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-token\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.407186 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.406994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-data\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.407186 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.407030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-credential-socket\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.407450 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.407424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-certs\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.407537 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.407508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-socket\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.407627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.407606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aae234a-7181-4ea6-aba8-0d0541389ec2-istiod-ca-cert\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.409070 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.409045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-envoy\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.409178 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.409158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-podinfo\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.414634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.414610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwnd\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-kube-api-access-cpwnd\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.414730 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.414689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-token\") pod \"e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") " pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.529015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.528916    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:29.668703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.668655    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"]
Jul 29 09:27:29.671404 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:27:29.671375    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aae234a_7181_4ea6_aba8_0d0541389ec2.slice/crio-8a0e7dc239c6f79cd1abc7cdab0871e95b2548e68fecc56ceb9a4bfadfbfd1b7 WatchSource:0}: Error finding container 8a0e7dc239c6f79cd1abc7cdab0871e95b2548e68fecc56ceb9a4bfadfbfd1b7: Status 404 returned error can't find the container with id 8a0e7dc239c6f79cd1abc7cdab0871e95b2548e68fecc56ceb9a4bfadfbfd1b7
Jul 29 09:27:29.673629 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.673594    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:29.673737 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.673676    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:29.673799 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.673762    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:29.728376 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:29.728350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:30.039242 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:30.039195    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" event={"ID":"6aae234a-7181-4ea6-aba8-0d0541389ec2","Type":"ContainerStarted","Data":"247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b"}
Jul 29 09:27:30.039449 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:30.039267    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" event={"ID":"6aae234a-7181-4ea6-aba8-0d0541389ec2","Type":"ContainerStarted","Data":"8a0e7dc239c6f79cd1abc7cdab0871e95b2548e68fecc56ceb9a4bfadfbfd1b7"}
Jul 29 09:27:30.062024 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:30.061977    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" podStartSLOduration=1.061960732 podStartE2EDuration="1.061960732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:27:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:27:30.060611829 +0000 UTC m=+2398.831881908" watchObservedRunningTime="2026-07-29 09:27:30.061960732 +0000 UTC m=+2398.833230861"
Jul 29 09:27:30.529655 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:30.529619    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:30.534589 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:30.534566    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:31.044305 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:31.044270    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:31.045272 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:31.045254    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:31.945630 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:31.945592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:32.030508 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.030473    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"]
Jul 29 09:27:32.031020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.030986    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy"
Jul 29 09:27:32.031020 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.031005    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="013b745c-cb33-433d-bd99-17713011c74f" containerName="istio-proxy"
Jul 29 09:27:32.032443 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.032416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:32.035807 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.035787    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.037679 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.037657    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:27:32.038138 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.038119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d0f1b8-serving-cert\""
Jul 29 09:27:32.038237 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.038119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:27:32.038237 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.038160    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:27:32.042446 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.042410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"]
Jul 29 09:27:32.094987 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.094951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:32.132355 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.132307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.132562 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.132433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8drm\" (UniqueName: \"kubernetes.io/projected/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-kube-api-access-h8drm\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.132562 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.132478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-openshift-service-ca\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.233521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.233429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.233521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.233481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8drm\" (UniqueName: \"kubernetes.io/projected/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-kube-api-access-h8drm\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.233521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.233517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-openshift-service-ca\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.233793 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:27:32.233589    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-serving-cert: secret "maas-api-e2e-api-a-d0f1b8-serving-cert" not found
Jul 29 09:27:32.233793 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:27:32.233674    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls podName:7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a nodeName:}" failed. No retries permitted until 2026-07-29 09:27:32.733653429 +0000 UTC m=+2401.504923479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls") pod "maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2" (UID: "7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a") : secret "maas-api-e2e-api-a-d0f1b8-serving-cert" not found
Jul 29 09:27:32.234246 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.234227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-openshift-service-ca\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.251044 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.251020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8drm\" (UniqueName: \"kubernetes.io/projected/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-kube-api-access-h8drm\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.316362 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.316331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:32.709098 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.709048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:32.737383 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.737347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.739810 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.739790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls\") pod \"maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.832122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.832091    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:32.915093 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.915061    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"]
Jul 29 09:27:32.918472 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.918452    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:32.920501 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.920477    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-d0f1b8-dockercfg-cvp78\""
Jul 29 09:27:32.920616 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.920517    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-d0f1b8\""
Jul 29 09:27:32.925923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.925901    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"]
Jul 29 09:27:32.948361 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.948324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:32.973415 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.973332    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"]
Jul 29 09:27:32.977899 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.977876    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:32.985337 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:32.985263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"]
Jul 29 09:27:33.040078 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.040048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47lhb\" (UniqueName: \"kubernetes.io/projected/c8ef602e-1c11-4e57-94cd-79e22222fe2c-kube-api-access-47lhb\") pod \"payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg\" (UID: \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:33.040250 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.040113    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ef602e-1c11-4e57-94cd-79e22222fe2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg\" (UID: \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:33.094243 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.094184    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"]
Jul 29 09:27:33.096277 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:27:33.096240    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2b34c1_5b32_4bd9_b38a_4ee3d1333d2a.slice/crio-819a92c5a005e13fda250cafeca101d1f7cfa2a92e1b253feba9400a47f02c5a WatchSource:0}: Error finding container 819a92c5a005e13fda250cafeca101d1f7cfa2a92e1b253feba9400a47f02c5a: Status 404 returned error can't find the container with id 819a92c5a005e13fda250cafeca101d1f7cfa2a92e1b253feba9400a47f02c5a
Jul 29 09:27:33.097658 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.097639    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 09:27:33.141308 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.141267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47lhb\" (UniqueName: \"kubernetes.io/projected/c8ef602e-1c11-4e57-94cd-79e22222fe2c-kube-api-access-47lhb\") pod \"payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg\" (UID: \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:33.141482 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.141346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ef602e-1c11-4e57-94cd-79e22222fe2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg\" (UID: \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:33.141482 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.141416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49fd0bae-6b88-46ed-b407-3bda6d06419a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft\" (UID: \"49fd0bae-6b88-46ed-b407-3bda6d06419a\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:33.141482 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.141462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz9jf\" (UniqueName: \"kubernetes.io/projected/49fd0bae-6b88-46ed-b407-3bda6d06419a-kube-api-access-pz9jf\") pod \"payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft\" (UID: \"49fd0bae-6b88-46ed-b407-3bda6d06419a\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:33.142154 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.142131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ef602e-1c11-4e57-94cd-79e22222fe2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg\" (UID: \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:33.149659 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.149637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47lhb\" (UniqueName: \"kubernetes.io/projected/c8ef602e-1c11-4e57-94cd-79e22222fe2c-kube-api-access-47lhb\") pod \"payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg\" (UID: \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:33.230747 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.230620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:33.242091 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.242064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49fd0bae-6b88-46ed-b407-3bda6d06419a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft\" (UID: \"49fd0bae-6b88-46ed-b407-3bda6d06419a\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:33.242223 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.242106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz9jf\" (UniqueName: \"kubernetes.io/projected/49fd0bae-6b88-46ed-b407-3bda6d06419a-kube-api-access-pz9jf\") pod \"payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft\" (UID: \"49fd0bae-6b88-46ed-b407-3bda6d06419a\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:33.242810 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.242788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49fd0bae-6b88-46ed-b407-3bda6d06419a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft\" (UID: \"49fd0bae-6b88-46ed-b407-3bda6d06419a\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:33.249390 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.249366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz9jf\" (UniqueName: \"kubernetes.io/projected/49fd0bae-6b88-46ed-b407-3bda6d06419a-kube-api-access-pz9jf\") pod \"payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft\" (UID: \"49fd0bae-6b88-46ed-b407-3bda6d06419a\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:33.298506 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.298470    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:33.368461 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.368425    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"]
Jul 29 09:27:33.373495 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:27:33.373199    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ef602e_1c11_4e57_94cd_79e22222fe2c.slice/crio-496e2a5886a0843fb3a2e5cdf8c04e45b9a7eb07a680bfb45d9b2861ef56d1b1 WatchSource:0}: Error finding container 496e2a5886a0843fb3a2e5cdf8c04e45b9a7eb07a680bfb45d9b2861ef56d1b1: Status 404 returned error can't find the container with id 496e2a5886a0843fb3a2e5cdf8c04e45b9a7eb07a680bfb45d9b2861ef56d1b1
Jul 29 09:27:33.610844 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.610811    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:27:33.656215 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.656190    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"]
Jul 29 09:27:33.658587 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:27:33.658561    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49fd0bae_6b88_46ed_b407_3bda6d06419a.slice/crio-a4087d0b94f93b13107a9b2ce4c5241e4dd7cc9454eddcaefe7721c1594a9a47 WatchSource:0}: Error finding container a4087d0b94f93b13107a9b2ce4c5241e4dd7cc9454eddcaefe7721c1594a9a47: Status 404 returned error can't find the container with id a4087d0b94f93b13107a9b2ce4c5241e4dd7cc9454eddcaefe7721c1594a9a47
Jul 29 09:27:33.747864 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.747835    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhghx\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-kube-api-access-vhghx\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.747975 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.747896    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-certs\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.747975 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.747926    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istiod-ca-cert\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.747975 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.747955    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-credential-socket\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.748127 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.747979    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-token\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.748127 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748030    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-podinfo\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.748127 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748089    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-socket\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.748127 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748115    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-envoy\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.748262 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-data\") pod \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\" (UID: \"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e\") "
Jul 29 09:27:33.748262 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748199    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:33.748469 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748451    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:33.748544 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:33.748606 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748587    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:27:33.749023 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.748870    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:33.749284 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.749248    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-data" (OuterVolumeSpecName: "istio-data") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:33.750814 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.750764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-kube-api-access-vhghx" (OuterVolumeSpecName: "kube-api-access-vhghx") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "kube-api-access-vhghx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:27:33.750936 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.750906    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:27:33.751046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.751027    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:27:33.751221 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.751200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-token" (OuterVolumeSpecName: "istio-token") pod "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" (UID: "bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:27:33.849155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.849118    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhghx\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-kube-api-access-vhghx\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:33.849155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.849153    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:33.849373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.849166    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:33.849373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.849179    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:33.849373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.849191    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:33.849373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.849206    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:33.849373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.849229    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:33.849373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:33.849241    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:27:34.067920 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.067814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2" event={"ID":"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a","Type":"ContainerStarted","Data":"2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38"}
Jul 29 09:27:34.067920 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.067895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2" event={"ID":"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a","Type":"ContainerStarted","Data":"819a92c5a005e13fda250cafeca101d1f7cfa2a92e1b253feba9400a47f02c5a"}
Jul 29 09:27:34.068391 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.067924    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:34.069511 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.069483    2564 generic.go:356] "Generic (PLEG): container finished" podID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerID="341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428" exitCode=0
Jul 29 09:27:34.069627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.069531    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"
Jul 29 09:27:34.069627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.069560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" event={"ID":"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e","Type":"ContainerDied","Data":"341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428"}
Jul 29 09:27:34.069627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.069605    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq" event={"ID":"bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e","Type":"ContainerDied","Data":"22cc85deb0944eb18c7ce8686a2905e8dd717102581a5e1a4c888002673eef44"}
Jul 29 09:27:34.069822 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.069636    2564 scope.go:117] "RemoveContainer" containerID="341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428"
Jul 29 09:27:34.071290 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.071261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft" event={"ID":"49fd0bae-6b88-46ed-b407-3bda6d06419a","Type":"ContainerStarted","Data":"c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b"}
Jul 29 09:27:34.071399 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.071311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft" event={"ID":"49fd0bae-6b88-46ed-b407-3bda6d06419a","Type":"ContainerStarted","Data":"a4087d0b94f93b13107a9b2ce4c5241e4dd7cc9454eddcaefe7721c1594a9a47"}
Jul 29 09:27:34.071399 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.071392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:34.073048 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.073027    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg" event={"ID":"c8ef602e-1c11-4e57-94cd-79e22222fe2c","Type":"ContainerStarted","Data":"f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc"}
Jul 29 09:27:34.073173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.073074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:34.073173 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.073100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg" event={"ID":"c8ef602e-1c11-4e57-94cd-79e22222fe2c","Type":"ContainerStarted","Data":"496e2a5886a0843fb3a2e5cdf8c04e45b9a7eb07a680bfb45d9b2861ef56d1b1"}
Jul 29 09:27:34.078875 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.078860    2564 scope.go:117] "RemoveContainer" containerID="8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba"
Jul 29 09:27:34.082756 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.082692    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2" podStartSLOduration=1.4459658499999999 podStartE2EDuration="2.082679919s" totalImagesPullingTime="636.714069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:27:34.08066907 +0000 UTC m=+2402.851939135" watchObservedRunningTime="2026-07-29 09:27:34.082679919 +0000 UTC m=+2402.853949995"
Jul 29 09:27:34.087551 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.087534    2564 scope.go:117] "RemoveContainer" containerID="341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428"
Jul 29 09:27:34.087878 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:27:34.087850    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428\": container with ID starting with 341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428 not found: ID does not exist" containerID="341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428"
Jul 29 09:27:34.087942 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.087882    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428"} err="failed to get container status \"341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428\": rpc error: code = NotFound desc = could not find container \"341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428\": container with ID starting with 341c0b9ecf8b5326ddb2e89e57cb3f0d1a91c80b0c4ad4eaed85fee581158428 not found: ID does not exist"
Jul 29 09:27:34.087942 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.087900    2564 scope.go:117] "RemoveContainer" containerID="8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba"
Jul 29 09:27:34.088228 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:27:34.088197    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba\": container with ID starting with 8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba not found: ID does not exist" containerID="8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba"
Jul 29 09:27:34.088332 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.088234    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba"} err="failed to get container status \"8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba\": rpc error: code = NotFound desc = could not find container \"8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba\": container with ID starting with 8bdc81d5db1a6cd4b946af35add1b3f57cb956b763dfaaaf4b47a96892133fba not found: ID does not exist"
Jul 29 09:27:34.090539 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.090384    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"]
Jul 29 09:27:34.092247 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.092227    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-612453-openshift-default-696d5c78f4-blhsq"]
Jul 29 09:27:34.118149 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.118101    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg" podStartSLOduration=2.118086365 podStartE2EDuration="2.118086365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:27:34.102322605 +0000 UTC m=+2402.873592672" watchObservedRunningTime="2026-07-29 09:27:34.118086365 +0000 UTC m=+2402.889356428"
Jul 29 09:27:34.118325 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:34.118272    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft" podStartSLOduration=2.118266574 podStartE2EDuration="2.118266574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:27:34.116757793 +0000 UTC m=+2402.888027881" watchObservedRunningTime="2026-07-29 09:27:34.118266574 +0000 UTC m=+2402.889536671"
Jul 29 09:27:35.761257 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:35.761224    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" path="/var/lib/kubelet/pods/bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e/volumes"
Jul 29 09:27:40.084793 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:40.084759    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:27:45.082119 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:45.082087    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:27:45.082591 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:45.082385    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:27:46.411936 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:46.411180    2564 patch_prober.go:28] interesting pod/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:35506->10.132.0.58:15021: read: connection reset by peer" start-of-body=
Jul 29 09:27:46.411936 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:46.411257    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:35506->10.132.0.58:15021: read: connection reset by peer"
Jul 29 09:27:47.147309 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:47.147277    2564 generic.go:356] "Generic (PLEG): container finished" podID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerID="247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b" exitCode=0
Jul 29 09:27:47.147480 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:47.147348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" event={"ID":"6aae234a-7181-4ea6-aba8-0d0541389ec2","Type":"ContainerDied","Data":"247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b"}
Jul 29 09:27:47.147759 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:47.147744    2564 scope.go:117] "RemoveContainer" containerID="247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b"
Jul 29 09:27:47.148860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:47.148831    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:47.148933 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:47.148913    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:47.148973 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:47.148964    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:48.153749 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:48.153684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" event={"ID":"6aae234a-7181-4ea6-aba8-0d0541389ec2","Type":"ContainerStarted","Data":"9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e"}
Jul 29 09:27:48.529219 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:48.529138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:48.529375 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:48.529349    2564 patch_prober.go:28] interesting pod/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 29 09:27:48.529428 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:48.529398    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 29 09:27:49.529289 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:49.529247    2564 patch_prober.go:28] interesting pod/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 29 09:27:49.529697 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:49.529306    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 29 09:27:50.529314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:50.529269    2564 patch_prober.go:28] interesting pod/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 29 09:27:50.529756 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:50.529336    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 29 09:27:51.530113 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:51.530071    2564 patch_prober.go:28] interesting pod/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 29 09:27:51.530540 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:51.530130    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 29 09:27:52.533597 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:52.533560    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:52.533998 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:52.533944    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:52.534780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:52.534759    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:27:56.914922 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:56.914835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:57.364787 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.364677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:57.643155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.643123    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"]
Jul 29 09:27:57.643604 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.643588    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy"
Jul 29 09:27:57.643696 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.643606    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy"
Jul 29 09:27:57.643791 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.643704    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy"
Jul 29 09:27:57.643791 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.643732    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy"
Jul 29 09:27:57.647031 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.647008    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.651375 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.651352    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-cddb75-openshift-default-dockercfg-w95kj\""
Jul 29 09:27:57.658469 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.658446    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"]
Jul 29 09:27:57.674104 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.674075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:57.790258 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-token\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.790258 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790264    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l25vd\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-kube-api-access-l25vd\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.790500 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istiod-ca-cert\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.790500 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-envoy\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.790500 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-podinfo\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.790500 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-data\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.790500 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-certs\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.790500 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-credential-socket\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.790500 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.790490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-socket\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891034 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.890996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istiod-ca-cert\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891034 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891038    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-envoy\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891295 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-podinfo\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891295 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-data\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891295 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-certs\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891295 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-credential-socket\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891295 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-socket\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891557 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-token\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891557 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l25vd\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-kube-api-access-l25vd\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891557 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-data\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891754 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-credential-socket\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891823 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-socket\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.891917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-certs\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.892051 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.891931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istiod-ca-cert\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.893524 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.893469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-envoy\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.894003 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.893983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-podinfo\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.899700 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.899675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-token\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.899917 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.899896    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l25vd\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-kube-api-access-l25vd\") pod \"e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") " pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.957872 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.957833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:57.993019 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:57.992980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:27:58.101067 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:58.101041    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"]
Jul 29 09:27:58.102817 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:27:58.102783    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c684ac_1960_4f8c_b4eb_3a36b0cf0540.slice/crio-e23298658fa75683e5f8387ab031a5bbc6a62fb95b567a1f8578c326d787fccf WatchSource:0}: Error finding container e23298658fa75683e5f8387ab031a5bbc6a62fb95b567a1f8578c326d787fccf: Status 404 returned error can't find the container with id e23298658fa75683e5f8387ab031a5bbc6a62fb95b567a1f8578c326d787fccf
Jul 29 09:27:58.105090 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:58.105052    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:58.105188 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:58.105125    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:58.105188 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:58.105158    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:27:58.203446 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:58.203405    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" event={"ID":"28c684ac-1960-4f8c-b4eb-3a36b0cf0540","Type":"ContainerStarted","Data":"13daa04c7e17f9500da4715d3de197ff31a0c430288d9f343c95dc9b0862e3c5"}
Jul 29 09:27:58.203635 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:58.203456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" event={"ID":"28c684ac-1960-4f8c-b4eb-3a36b0cf0540","Type":"ContainerStarted","Data":"e23298658fa75683e5f8387ab031a5bbc6a62fb95b567a1f8578c326d787fccf"}
Jul 29 09:27:58.220532 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:58.220465    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" podStartSLOduration=1.22044196 podStartE2EDuration="1.22044196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:27:58.219970442 +0000 UTC m=+2426.991240542" watchObservedRunningTime="2026-07-29 09:27:58.22044196 +0000 UTC m=+2426.991712015"
Jul 29 09:27:58.957941 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:58.957899    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:27:59.963517 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:27:59.963485    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:28:00.081399 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.081371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:00.182908 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.182869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:00.215771 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.215682    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:28:00.216584 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.216560    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:28:00.308837 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.308803    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"]
Jul 29 09:28:00.309372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.309354    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy"
Jul 29 09:28:00.309372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.309372    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee40fd4-cd52-4cc3-88f7-d0ef0fdc444e" containerName="istio-proxy"
Jul 29 09:28:00.312755 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.312733    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.314908 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.314702    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-cddb75-serving-cert\""
Jul 29 09:28:00.320418 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.320378    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"]
Jul 29 09:28:00.359486 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.359445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:00.415530 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.415485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/973b5638-24af-42c0-8ee5-de7cf1258ae2-openshift-service-ca\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.415765 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.415612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.415765 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.415695    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7blq\" (UniqueName: \"kubernetes.io/projected/973b5638-24af-42c0-8ee5-de7cf1258ae2-kube-api-access-b7blq\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.516942 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.516842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7blq\" (UniqueName: \"kubernetes.io/projected/973b5638-24af-42c0-8ee5-de7cf1258ae2-kube-api-access-b7blq\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.516942 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.516925    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/973b5638-24af-42c0-8ee5-de7cf1258ae2-openshift-service-ca\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.517196 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.516988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.517196 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:28:00.517111    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-serving-cert: secret "maas-api-e2e-api-b-cddb75-serving-cert" not found
Jul 29 09:28:00.517196 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:28:00.517183    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls podName:973b5638-24af-42c0-8ee5-de7cf1258ae2 nodeName:}" failed. No retries permitted until 2026-07-29 09:28:01.017160716 +0000 UTC m=+2429.788430759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls") pod "maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8" (UID: "973b5638-24af-42c0-8ee5-de7cf1258ae2") : secret "maas-api-e2e-api-b-cddb75-serving-cert" not found
Jul 29 09:28:00.517756 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.517707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/973b5638-24af-42c0-8ee5-de7cf1258ae2-openshift-service-ca\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.524810 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.524783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7blq\" (UniqueName: \"kubernetes.io/projected/973b5638-24af-42c0-8ee5-de7cf1258ae2-kube-api-access-b7blq\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:00.870355 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:00.870266    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:01.017315 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.017282    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"]
Jul 29 09:28:01.018087 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.018062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:01.020820 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.020804    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:01.021474 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.021453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:01.023569 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.023547    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-cddb75-dockercfg-m2q7w\""
Jul 29 09:28:01.024078 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.024050    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls\") pod \"maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:01.024499 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.024485    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-cddb75\""
Jul 29 09:28:01.049835 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.049802    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"]
Jul 29 09:28:01.122410 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.122316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt5mg\" (UniqueName: \"kubernetes.io/projected/251e1fdf-6608-4cf2-8434-4551507d1ab5-kube-api-access-kt5mg\") pod \"payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd\" (UID: \"251e1fdf-6608-4cf2-8434-4551507d1ab5\") " pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:01.122565 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.122482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251e1fdf-6608-4cf2-8434-4551507d1ab5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd\" (UID: \"251e1fdf-6608-4cf2-8434-4551507d1ab5\") " pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:01.223597 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.223563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt5mg\" (UniqueName: \"kubernetes.io/projected/251e1fdf-6608-4cf2-8434-4551507d1ab5-kube-api-access-kt5mg\") pod \"payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd\" (UID: \"251e1fdf-6608-4cf2-8434-4551507d1ab5\") " pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:01.223760 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.223629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251e1fdf-6608-4cf2-8434-4551507d1ab5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd\" (UID: \"251e1fdf-6608-4cf2-8434-4551507d1ab5\") " pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:01.224297 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.224279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251e1fdf-6608-4cf2-8434-4551507d1ab5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd\" (UID: \"251e1fdf-6608-4cf2-8434-4551507d1ab5\") " pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:01.230416 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.230388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:01.231456 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.231432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt5mg\" (UniqueName: \"kubernetes.io/projected/251e1fdf-6608-4cf2-8434-4551507d1ab5-kube-api-access-kt5mg\") pod \"payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd\" (UID: \"251e1fdf-6608-4cf2-8434-4551507d1ab5\") " pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:01.339107 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.338859    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:01.372246 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.372218    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"]
Jul 29 09:28:01.373861 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:28:01.373799    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973b5638_24af_42c0_8ee5_de7cf1258ae2.slice/crio-561761fa835a4353e579d5e4b15e41d674d93f3e0d4592abee6ef33105c1bd87 WatchSource:0}: Error finding container 561761fa835a4353e579d5e4b15e41d674d93f3e0d4592abee6ef33105c1bd87: Status 404 returned error can't find the container with id 561761fa835a4353e579d5e4b15e41d674d93f3e0d4592abee6ef33105c1bd87
Jul 29 09:28:01.682695 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:01.682669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"]
Jul 29 09:28:01.685192 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:28:01.685154    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251e1fdf_6608_4cf2_8434_4551507d1ab5.slice/crio-fae2ba3e43eb49edffd636610bbe9770f0a6476b0360e7017aacce992140c04f WatchSource:0}: Error finding container fae2ba3e43eb49edffd636610bbe9770f0a6476b0360e7017aacce992140c04f: Status 404 returned error can't find the container with id fae2ba3e43eb49edffd636610bbe9770f0a6476b0360e7017aacce992140c04f
Jul 29 09:28:02.228880 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:02.228776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8" event={"ID":"973b5638-24af-42c0-8ee5-de7cf1258ae2","Type":"ContainerStarted","Data":"ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c"}
Jul 29 09:28:02.228880 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:02.228841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8" event={"ID":"973b5638-24af-42c0-8ee5-de7cf1258ae2","Type":"ContainerStarted","Data":"561761fa835a4353e579d5e4b15e41d674d93f3e0d4592abee6ef33105c1bd87"}
Jul 29 09:28:02.229373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:02.228927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:02.230649 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:02.230611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd" event={"ID":"251e1fdf-6608-4cf2-8434-4551507d1ab5","Type":"ContainerStarted","Data":"5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5"}
Jul 29 09:28:02.230795 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:02.230664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd" event={"ID":"251e1fdf-6608-4cf2-8434-4551507d1ab5","Type":"ContainerStarted","Data":"fae2ba3e43eb49edffd636610bbe9770f0a6476b0360e7017aacce992140c04f"}
Jul 29 09:28:02.242263 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:02.242209    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8" podStartSLOduration=1.733673139 podStartE2EDuration="2.242192569s" totalImagesPullingTime="508.51943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:28:02.242139252 +0000 UTC m=+2431.013409317" watchObservedRunningTime="2026-07-29 09:28:02.242192569 +0000 UTC m=+2431.013462633"
Jul 29 09:28:02.256066 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:02.256007    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd" podStartSLOduration=2.255986929 podStartE2EDuration="2.255986929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:28:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:28:02.255533302 +0000 UTC m=+2431.026803370" watchObservedRunningTime="2026-07-29 09:28:02.255986929 +0000 UTC m=+2431.027256992"
Jul 29 09:28:03.235889 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:03.235851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:08.241373 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:08.241345    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:28:14.243283 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:14.243255    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:28:15.216535 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:15.216461    2564 patch_prober.go:28] interesting pod/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 09:28:15.216535 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:15.216513    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 09:28:15.296847 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:15.296812    2564 generic.go:356] "Generic (PLEG): container finished" podID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerID="13daa04c7e17f9500da4715d3de197ff31a0c430288d9f343c95dc9b0862e3c5" exitCode=0
Jul 29 09:28:15.297226 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:15.296889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" event={"ID":"28c684ac-1960-4f8c-b4eb-3a36b0cf0540","Type":"ContainerDied","Data":"13daa04c7e17f9500da4715d3de197ff31a0c430288d9f343c95dc9b0862e3c5"}
Jul 29 09:28:15.297287 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:15.297272    2564 scope.go:117] "RemoveContainer" containerID="13daa04c7e17f9500da4715d3de197ff31a0c430288d9f343c95dc9b0862e3c5"
Jul 29 09:28:15.298269 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:15.298244    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:28:15.298324 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:15.298311    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:28:15.298359 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:15.298341    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:28:16.306913 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:16.306864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" event={"ID":"28c684ac-1960-4f8c-b4eb-3a36b0cf0540","Type":"ContainerStarted","Data":"2304d6f10bfdc8857c4393b2d5a5caec467400395cf6f637ead37a7e14883585"}
Jul 29 09:28:16.958992 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:16.958950    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:28:16.959208 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:16.959181    2564 patch_prober.go:28] interesting pod/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 09:28:16.959261 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:16.959244    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 09:28:17.958750 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:17.958702    2564 patch_prober.go:28] interesting pod/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 09:28:17.959147 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:17.958785    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 09:28:18.958846 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:18.958809    2564 patch_prober.go:28] interesting pod/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 09:28:18.959218 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:18.958872    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 09:28:19.958923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:19.958891    2564 patch_prober.go:28] interesting pod/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 29 09:28:19.959314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:19.958950    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 29 09:28:20.962697 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:20.962664    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:28:20.963103 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:20.962939    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:28:20.963588 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:20.963570    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:28:25.075306 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:25.075259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:32.005062 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:32.005029    2564 scope.go:117] "RemoveContainer" containerID="a1d64cf8b67804a305851e101be447a7ef2a4eb975bf6d1513b0f218235c1cfb"
Jul 29 09:28:43.378563 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.378516    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"]
Jul 29 09:28:43.379033 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.378794    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2" podUID="7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" containerName="maas-api" containerID="cri-o://2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38" gracePeriod=30
Jul 29 09:28:43.407458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.407428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:43.434250 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.434215    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"]
Jul 29 09:28:43.434521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.434493    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft" podUID="49fd0bae-6b88-46ed-b407-3bda6d06419a" containerName="payload-processing" containerID="cri-o://c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b" gracePeriod=30
Jul 29 09:28:43.442381 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.442347    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"]
Jul 29 09:28:43.443011 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.442977    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg" podUID="c8ef602e-1c11-4e57-94cd-79e22222fe2c" containerName="payload-pre-processing" containerID="cri-o://f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc" gracePeriod=30
Jul 29 09:28:43.477023 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.476989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:43.535684 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.535637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:43.597021 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.596189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:43.713755 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.713685    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:28:43.738098 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.738074    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:28:43.749479 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.749459    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:28:43.837591 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.837551    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls\") pod \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") "
Jul 29 09:28:43.837591 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.837592    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz9jf\" (UniqueName: \"kubernetes.io/projected/49fd0bae-6b88-46ed-b407-3bda6d06419a-kube-api-access-pz9jf\") pod \"49fd0bae-6b88-46ed-b407-3bda6d06419a\" (UID: \"49fd0bae-6b88-46ed-b407-3bda6d06419a\") "
Jul 29 09:28:43.837837 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.837620    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49fd0bae-6b88-46ed-b407-3bda6d06419a-plugins-config-volume\") pod \"49fd0bae-6b88-46ed-b407-3bda6d06419a\" (UID: \"49fd0bae-6b88-46ed-b407-3bda6d06419a\") "
Jul 29 09:28:43.837837 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.837771    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-openshift-service-ca\") pod \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") "
Jul 29 09:28:43.837837 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.837813    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47lhb\" (UniqueName: \"kubernetes.io/projected/c8ef602e-1c11-4e57-94cd-79e22222fe2c-kube-api-access-47lhb\") pod \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\" (UID: \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\") "
Jul 29 09:28:43.838004 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.837840    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ef602e-1c11-4e57-94cd-79e22222fe2c-plugins-config-volume\") pod \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\" (UID: \"c8ef602e-1c11-4e57-94cd-79e22222fe2c\") "
Jul 29 09:28:43.838004 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.837917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8drm\" (UniqueName: \"kubernetes.io/projected/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-kube-api-access-h8drm\") pod \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\" (UID: \"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a\") "
Jul 29 09:28:43.838145 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.838121    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" (UID: "7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:28:43.838239 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.838047    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49fd0bae-6b88-46ed-b407-3bda6d06419a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49fd0bae-6b88-46ed-b407-3bda6d06419a" (UID: "49fd0bae-6b88-46ed-b407-3bda6d06419a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:28:43.838239 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.838230    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ef602e-1c11-4e57-94cd-79e22222fe2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8ef602e-1c11-4e57-94cd-79e22222fe2c" (UID: "c8ef602e-1c11-4e57-94cd-79e22222fe2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:28:43.838354 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.838247    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49fd0bae-6b88-46ed-b407-3bda6d06419a-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:43.838354 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.838268    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:43.839940 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.839914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ef602e-1c11-4e57-94cd-79e22222fe2c-kube-api-access-47lhb" (OuterVolumeSpecName: "kube-api-access-47lhb") pod "c8ef602e-1c11-4e57-94cd-79e22222fe2c" (UID: "c8ef602e-1c11-4e57-94cd-79e22222fe2c"). InnerVolumeSpecName "kube-api-access-47lhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:28:43.839940 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.839931    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49fd0bae-6b88-46ed-b407-3bda6d06419a-kube-api-access-pz9jf" (OuterVolumeSpecName: "kube-api-access-pz9jf") pod "49fd0bae-6b88-46ed-b407-3bda6d06419a" (UID: "49fd0bae-6b88-46ed-b407-3bda6d06419a"). InnerVolumeSpecName "kube-api-access-pz9jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:28:43.840084 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.839941    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" (UID: "7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:28:43.840084 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.839999    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-kube-api-access-h8drm" (OuterVolumeSpecName: "kube-api-access-h8drm") pod "7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" (UID: "7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a"). InnerVolumeSpecName "kube-api-access-h8drm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:28:43.939148 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.939065    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8drm\" (UniqueName: \"kubernetes.io/projected/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-kube-api-access-h8drm\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:43.939148 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.939096    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:43.939148 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.939106    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz9jf\" (UniqueName: \"kubernetes.io/projected/49fd0bae-6b88-46ed-b407-3bda6d06419a-kube-api-access-pz9jf\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:43.939148 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.939115    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47lhb\" (UniqueName: \"kubernetes.io/projected/c8ef602e-1c11-4e57-94cd-79e22222fe2c-kube-api-access-47lhb\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:43.939148 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.939124    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ef602e-1c11-4e57-94cd-79e22222fe2c-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:43.943421 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:43.943393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:44.449601 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.449565    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" containerID="2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38" exitCode=0
Jul 29 09:28:44.450076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.449615    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"
Jul 29 09:28:44.450076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.449658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2" event={"ID":"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a","Type":"ContainerDied","Data":"2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38"}
Jul 29 09:28:44.450076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.449727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2" event={"ID":"7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a","Type":"ContainerDied","Data":"819a92c5a005e13fda250cafeca101d1f7cfa2a92e1b253feba9400a47f02c5a"}
Jul 29 09:28:44.450076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.449757    2564 scope.go:117] "RemoveContainer" containerID="2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38"
Jul 29 09:28:44.451299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.451126    2564 generic.go:356] "Generic (PLEG): container finished" podID="49fd0bae-6b88-46ed-b407-3bda6d06419a" containerID="c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b" exitCode=0
Jul 29 09:28:44.451299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.451168    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"
Jul 29 09:28:44.451299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.451200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft" event={"ID":"49fd0bae-6b88-46ed-b407-3bda6d06419a","Type":"ContainerDied","Data":"c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b"}
Jul 29 09:28:44.451299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.451247    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft" event={"ID":"49fd0bae-6b88-46ed-b407-3bda6d06419a","Type":"ContainerDied","Data":"a4087d0b94f93b13107a9b2ce4c5241e4dd7cc9454eddcaefe7721c1594a9a47"}
Jul 29 09:28:44.452614 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.452592    2564 generic.go:356] "Generic (PLEG): container finished" podID="c8ef602e-1c11-4e57-94cd-79e22222fe2c" containerID="f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc" exitCode=0
Jul 29 09:28:44.452781 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.452627    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"
Jul 29 09:28:44.452781 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.452670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg" event={"ID":"c8ef602e-1c11-4e57-94cd-79e22222fe2c","Type":"ContainerDied","Data":"f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc"}
Jul 29 09:28:44.452781 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.452738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg" event={"ID":"c8ef602e-1c11-4e57-94cd-79e22222fe2c","Type":"ContainerDied","Data":"496e2a5886a0843fb3a2e5cdf8c04e45b9a7eb07a680bfb45d9b2861ef56d1b1"}
Jul 29 09:28:44.463043 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.463026    2564 scope.go:117] "RemoveContainer" containerID="2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38"
Jul 29 09:28:44.463397 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:28:44.463376    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38\": container with ID starting with 2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38 not found: ID does not exist" containerID="2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38"
Jul 29 09:28:44.463496 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.463408    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38"} err="failed to get container status \"2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38\": rpc error: code = NotFound desc = could not find container \"2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38\": container with ID starting with 2d423dd4adf27fb1918c5a0936e8cb3c439a69071296622aa507ed8ce7e0bd38 not found: ID does not exist"
Jul 29 09:28:44.463496 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.463429    2564 scope.go:117] "RemoveContainer" containerID="c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b"
Jul 29 09:28:44.471985 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.471915    2564 scope.go:117] "RemoveContainer" containerID="c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b"
Jul 29 09:28:44.472218 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:28:44.472198    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b\": container with ID starting with c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b not found: ID does not exist" containerID="c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b"
Jul 29 09:28:44.472299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.472232    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b"} err="failed to get container status \"c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b\": rpc error: code = NotFound desc = could not find container \"c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b\": container with ID starting with c096028f9336d311e376844d4d018bfbe5eb2138fee7154ea9fe5d6221de108b not found: ID does not exist"
Jul 29 09:28:44.472299 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.472248    2564 scope.go:117] "RemoveContainer" containerID="f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc"
Jul 29 09:28:44.480267 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.480250    2564 scope.go:117] "RemoveContainer" containerID="f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc"
Jul 29 09:28:44.480508 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:28:44.480489    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc\": container with ID starting with f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc not found: ID does not exist" containerID="f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc"
Jul 29 09:28:44.480569 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.480514    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc"} err="failed to get container status \"f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc\": rpc error: code = NotFound desc = could not find container \"f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc\": container with ID starting with f6b914ae9b967e8b43976c81cb4ea5585d8458de16c847ff5844f957c1eae1cc not found: ID does not exist"
Jul 29 09:28:44.480736 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.480702    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"]
Jul 29 09:28:44.483450 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.483431    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0f1b8-77c457db94-p2kft"]
Jul 29 09:28:44.493078 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.493054    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"]
Jul 29 09:28:44.496852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.496832    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0f1b8-5b49bc56bd-cm5z2"]
Jul 29 09:28:44.506817 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.506797    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"]
Jul 29 09:28:44.515672 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:44.515653    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0f1b8-7ffd78c7bd-ts8cg"]
Jul 29 09:28:45.761078 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:45.761040    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49fd0bae-6b88-46ed-b407-3bda6d06419a" path="/var/lib/kubelet/pods/49fd0bae-6b88-46ed-b407-3bda6d06419a/volumes"
Jul 29 09:28:45.761449 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:45.761424    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" path="/var/lib/kubelet/pods/7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a/volumes"
Jul 29 09:28:45.761766 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:45.761750    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ef602e-1c11-4e57-94cd-79e22222fe2c" path="/var/lib/kubelet/pods/c8ef602e-1c11-4e57-94cd-79e22222fe2c/volumes"
Jul 29 09:28:49.836250 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:49.836212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:49.916014 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:49.915982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:50.081626 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:50.081588    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"]
Jul 29 09:28:50.081900 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:50.081871    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy" containerID="cri-o://9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e" gracePeriod=30
Jul 29 09:28:50.102283 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:50.102205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:50.492767 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:50.492729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:28:52.536314 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:52.536269    2564 patch_prober.go:28] interesting pod/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 09:28:52.536736 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:52.536340    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 09:28:55.337209 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.337185    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:28:55.435790 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.435751    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-credential-socket\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.435968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.435810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-socket\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.435968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.435850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpwnd\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-kube-api-access-cpwnd\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.435968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.435872    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-podinfo\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.435968 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.435927    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-data\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.436185 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436044    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:28:55.436185 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436063    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-token\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.436185 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436113    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aae234a-7181-4ea6-aba8-0d0541389ec2-istiod-ca-cert\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.436185 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436125    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:28:55.436185 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-envoy\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.436185 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436181    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-certs\") pod \"6aae234a-7181-4ea6-aba8-0d0541389ec2\" (UID: \"6aae234a-7181-4ea6-aba8-0d0541389ec2\") "
Jul 29 09:28:55.436483 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436472    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.436536 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436490    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.436536 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436488    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:28:55.436624 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436542    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aae234a-7181-4ea6-aba8-0d0541389ec2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:28:55.436909 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.436883    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-data" (OuterVolumeSpecName: "istio-data") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:28:55.438336 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.438306    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:28:55.438336 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.438329    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-token" (OuterVolumeSpecName: "istio-token") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:28:55.438610 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.438588    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:28:55.438610 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.438601    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-kube-api-access-cpwnd" (OuterVolumeSpecName: "kube-api-access-cpwnd") pod "6aae234a-7181-4ea6-aba8-0d0541389ec2" (UID: "6aae234a-7181-4ea6-aba8-0d0541389ec2"). InnerVolumeSpecName "kube-api-access-cpwnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:28:55.508422 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.508388    2564 generic.go:356] "Generic (PLEG): container finished" podID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerID="9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e" exitCode=0
Jul 29 09:28:55.508593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.508441    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"
Jul 29 09:28:55.508593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.508469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" event={"ID":"6aae234a-7181-4ea6-aba8-0d0541389ec2","Type":"ContainerDied","Data":"9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e"}
Jul 29 09:28:55.508593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.508546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527" event={"ID":"6aae234a-7181-4ea6-aba8-0d0541389ec2","Type":"ContainerDied","Data":"8a0e7dc239c6f79cd1abc7cdab0871e95b2548e68fecc56ceb9a4bfadfbfd1b7"}
Jul 29 09:28:55.508593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.508568    2564 scope.go:117] "RemoveContainer" containerID="9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e"
Jul 29 09:28:55.517759 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.517736    2564 scope.go:117] "RemoveContainer" containerID="247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b"
Jul 29 09:28:55.525397 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.525379    2564 scope.go:117] "RemoveContainer" containerID="9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e"
Jul 29 09:28:55.525641 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:28:55.525626    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e\": container with ID starting with 9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e not found: ID does not exist" containerID="9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e"
Jul 29 09:28:55.525687 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.525647    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e"} err="failed to get container status \"9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e\": rpc error: code = NotFound desc = could not find container \"9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e\": container with ID starting with 9f74e665cf9fe921652d0fe45c11c4cdc3388498b6a422be8e3dfb10d8e3a52e not found: ID does not exist"
Jul 29 09:28:55.525687 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.525663    2564 scope.go:117] "RemoveContainer" containerID="247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b"
Jul 29 09:28:55.525915 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:28:55.525898    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b\": container with ID starting with 247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b not found: ID does not exist" containerID="247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b"
Jul 29 09:28:55.525958 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.525921    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b"} err="failed to get container status \"247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b\": rpc error: code = NotFound desc = could not find container \"247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b\": container with ID starting with 247cd654ce8f9e990f0a3a6eee39a00b42e2e8e27843680f6d563baf7084283b not found: ID does not exist"
Jul 29 09:28:55.530017 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.529997    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"]
Jul 29 09:28:55.534375 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.534355    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d0f1b8-openshift-default-6c7d789b6-4h527"]
Jul 29 09:28:55.536919 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.536904    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.536967 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.536921    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.536967 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.536931    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.536967 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.536939    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aae234a-7181-4ea6-aba8-0d0541389ec2-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.536967 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.536947    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.536967 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.536954    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aae234a-7181-4ea6-aba8-0d0541389ec2-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.536967 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.536963    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpwnd\" (UniqueName: \"kubernetes.io/projected/6aae234a-7181-4ea6-aba8-0d0541389ec2-kube-api-access-cpwnd\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:28:55.760169 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:28:55.760088    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" path="/var/lib/kubelet/pods/6aae234a-7181-4ea6-aba8-0d0541389ec2/volumes"
Jul 29 09:29:05.924780 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:05.924741    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"]
Jul 29 09:29:05.925385 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:05.925013    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8" podUID="973b5638-24af-42c0-8ee5-de7cf1258ae2" containerName="maas-api" containerID="cri-o://ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c" gracePeriod=30
Jul 29 09:29:05.981145 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:05.981110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:05.981427 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:05.981403    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"]
Jul 29 09:29:05.981615 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:05.981588    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd" podUID="251e1fdf-6608-4cf2-8434-4551507d1ab5" containerName="payload-processing" containerID="cri-o://5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5" gracePeriod=30
Jul 29 09:29:06.076592 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.076553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:06.143186 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.143113    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:06.232842 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.232818    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:29:06.265513 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.265489    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:29:06.331742 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.331688    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7blq\" (UniqueName: \"kubernetes.io/projected/973b5638-24af-42c0-8ee5-de7cf1258ae2-kube-api-access-b7blq\") pod \"973b5638-24af-42c0-8ee5-de7cf1258ae2\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") "
Jul 29 09:29:06.331940 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.331751    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/973b5638-24af-42c0-8ee5-de7cf1258ae2-openshift-service-ca\") pod \"973b5638-24af-42c0-8ee5-de7cf1258ae2\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") "
Jul 29 09:29:06.331940 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.331781    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt5mg\" (UniqueName: \"kubernetes.io/projected/251e1fdf-6608-4cf2-8434-4551507d1ab5-kube-api-access-kt5mg\") pod \"251e1fdf-6608-4cf2-8434-4551507d1ab5\" (UID: \"251e1fdf-6608-4cf2-8434-4551507d1ab5\") "
Jul 29 09:29:06.331940 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.331928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251e1fdf-6608-4cf2-8434-4551507d1ab5-plugins-config-volume\") pod \"251e1fdf-6608-4cf2-8434-4551507d1ab5\" (UID: \"251e1fdf-6608-4cf2-8434-4551507d1ab5\") "
Jul 29 09:29:06.332123 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.331961    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls\") pod \"973b5638-24af-42c0-8ee5-de7cf1258ae2\" (UID: \"973b5638-24af-42c0-8ee5-de7cf1258ae2\") "
Jul 29 09:29:06.332242 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.332210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/973b5638-24af-42c0-8ee5-de7cf1258ae2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "973b5638-24af-42c0-8ee5-de7cf1258ae2" (UID: "973b5638-24af-42c0-8ee5-de7cf1258ae2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:29:06.332342 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.332296    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/251e1fdf-6608-4cf2-8434-4551507d1ab5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "251e1fdf-6608-4cf2-8434-4551507d1ab5" (UID: "251e1fdf-6608-4cf2-8434-4551507d1ab5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:29:06.333951 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.333925    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/251e1fdf-6608-4cf2-8434-4551507d1ab5-kube-api-access-kt5mg" (OuterVolumeSpecName: "kube-api-access-kt5mg") pod "251e1fdf-6608-4cf2-8434-4551507d1ab5" (UID: "251e1fdf-6608-4cf2-8434-4551507d1ab5"). InnerVolumeSpecName "kube-api-access-kt5mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:29:06.334046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.333989    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "973b5638-24af-42c0-8ee5-de7cf1258ae2" (UID: "973b5638-24af-42c0-8ee5-de7cf1258ae2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:29:06.334046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.333993    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973b5638-24af-42c0-8ee5-de7cf1258ae2-kube-api-access-b7blq" (OuterVolumeSpecName: "kube-api-access-b7blq") pod "973b5638-24af-42c0-8ee5-de7cf1258ae2" (UID: "973b5638-24af-42c0-8ee5-de7cf1258ae2"). InnerVolumeSpecName "kube-api-access-b7blq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:29:06.433122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.433081    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7blq\" (UniqueName: \"kubernetes.io/projected/973b5638-24af-42c0-8ee5-de7cf1258ae2-kube-api-access-b7blq\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:06.433122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.433111    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/973b5638-24af-42c0-8ee5-de7cf1258ae2-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:06.433122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.433121    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt5mg\" (UniqueName: \"kubernetes.io/projected/251e1fdf-6608-4cf2-8434-4551507d1ab5-kube-api-access-kt5mg\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:06.433122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.433130    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/251e1fdf-6608-4cf2-8434-4551507d1ab5-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:06.433400 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.433139    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/973b5638-24af-42c0-8ee5-de7cf1258ae2-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:06.514040 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.513953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:06.559599 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.559565    2564 generic.go:356] "Generic (PLEG): container finished" podID="973b5638-24af-42c0-8ee5-de7cf1258ae2" containerID="ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c" exitCode=0
Jul 29 09:29:06.559820 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.559617    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"
Jul 29 09:29:06.559820 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.559654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8" event={"ID":"973b5638-24af-42c0-8ee5-de7cf1258ae2","Type":"ContainerDied","Data":"ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c"}
Jul 29 09:29:06.559820 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.559703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8" event={"ID":"973b5638-24af-42c0-8ee5-de7cf1258ae2","Type":"ContainerDied","Data":"561761fa835a4353e579d5e4b15e41d674d93f3e0d4592abee6ef33105c1bd87"}
Jul 29 09:29:06.559820 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.559750    2564 scope.go:117] "RemoveContainer" containerID="ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c"
Jul 29 09:29:06.561104 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.561078    2564 generic.go:356] "Generic (PLEG): container finished" podID="251e1fdf-6608-4cf2-8434-4551507d1ab5" containerID="5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5" exitCode=0
Jul 29 09:29:06.561209 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.561112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd" event={"ID":"251e1fdf-6608-4cf2-8434-4551507d1ab5","Type":"ContainerDied","Data":"5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5"}
Jul 29 09:29:06.561209 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.561118    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"
Jul 29 09:29:06.561209 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.561150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd" event={"ID":"251e1fdf-6608-4cf2-8434-4551507d1ab5","Type":"ContainerDied","Data":"fae2ba3e43eb49edffd636610bbe9770f0a6476b0360e7017aacce992140c04f"}
Jul 29 09:29:06.568596 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.568572    2564 scope.go:117] "RemoveContainer" containerID="ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c"
Jul 29 09:29:06.568991 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:29:06.568901    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c\": container with ID starting with ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c not found: ID does not exist" containerID="ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c"
Jul 29 09:29:06.568991 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.568924    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c"} err="failed to get container status \"ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c\": rpc error: code = NotFound desc = could not find container \"ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c\": container with ID starting with ce4e7cf4d5677cf8fe08ccafe49f12ce6dbe9ae805651ce4a4c63da0266d714c not found: ID does not exist"
Jul 29 09:29:06.568991 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.568939    2564 scope.go:117] "RemoveContainer" containerID="5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5"
Jul 29 09:29:06.576557 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.576541    2564 scope.go:117] "RemoveContainer" containerID="5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5"
Jul 29 09:29:06.576826 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:29:06.576810    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5\": container with ID starting with 5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5 not found: ID does not exist" containerID="5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5"
Jul 29 09:29:06.576885 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.576830    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5"} err="failed to get container status \"5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5\": rpc error: code = NotFound desc = could not find container \"5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5\": container with ID starting with 5d36adf8313faff9d71493e23d3cdc42be6fa999104f2d2f7fbcbc7d112d6ee5 not found: ID does not exist"
Jul 29 09:29:06.581525 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.581501    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"]
Jul 29 09:29:06.585389 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.585368    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cddb75-57cf7fd6d5-ck2z8"]
Jul 29 09:29:06.594413 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.594391    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"]
Jul 29 09:29:06.596558 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:06.596539    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cddb75-79f4c86d44-nz6hd"]
Jul 29 09:29:07.760848 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:07.760807    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="251e1fdf-6608-4cf2-8434-4551507d1ab5" path="/var/lib/kubelet/pods/251e1fdf-6608-4cf2-8434-4551507d1ab5/volumes"
Jul 29 09:29:07.761362 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:07.761343    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="973b5638-24af-42c0-8ee5-de7cf1258ae2" path="/var/lib/kubelet/pods/973b5638-24af-42c0-8ee5-de7cf1258ae2/volumes"
Jul 29 09:29:10.418275 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:10.418231    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:12.222033 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:12.221999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:12.285993 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:12.285959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:12.463007 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:12.462973    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"]
Jul 29 09:29:12.463210 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:12.463183    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy" containerID="cri-o://2304d6f10bfdc8857c4393b2d5a5caec467400395cf6f637ead37a7e14883585" gracePeriod=30
Jul 29 09:29:12.480393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:12.480326    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:12.711934 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:12.711900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:13.045264 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.045215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:13.326099 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326015    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"]
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326373    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fd0bae-6b88-46ed-b407-3bda6d06419a" containerName="payload-processing"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326391    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fd0bae-6b88-46ed-b407-3bda6d06419a" containerName="payload-processing"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326410    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ef602e-1c11-4e57-94cd-79e22222fe2c" containerName="payload-pre-processing"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326416    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ef602e-1c11-4e57-94cd-79e22222fe2c" containerName="payload-pre-processing"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326423    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326431    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326440    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="973b5638-24af-42c0-8ee5-de7cf1258ae2" containerName="maas-api"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326448    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="973b5638-24af-42c0-8ee5-de7cf1258ae2" containerName="maas-api"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326456    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" containerName="maas-api"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326461    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" containerName="maas-api"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326471    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326476    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326485    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="251e1fdf-6608-4cf2-8434-4551507d1ab5" containerName="payload-processing"
Jul 29 09:29:13.326534 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326493    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="251e1fdf-6608-4cf2-8434-4551507d1ab5" containerName="payload-processing"
Jul 29 09:29:13.327286 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326550    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="251e1fdf-6608-4cf2-8434-4551507d1ab5" containerName="payload-processing"
Jul 29 09:29:13.327286 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326564    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy"
Jul 29 09:29:13.327286 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326574    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="49fd0bae-6b88-46ed-b407-3bda6d06419a" containerName="payload-processing"
Jul 29 09:29:13.327286 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326586    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="973b5638-24af-42c0-8ee5-de7cf1258ae2" containerName="maas-api"
Jul 29 09:29:13.327286 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326595    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c2b34c1-5b32-4bd9-b38a-4ee3d1333d2a" containerName="maas-api"
Jul 29 09:29:13.327286 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326601    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aae234a-7181-4ea6-aba8-0d0541389ec2" containerName="istio-proxy"
Jul 29 09:29:13.327286 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.326608    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ef602e-1c11-4e57-94cd-79e22222fe2c" containerName="payload-pre-processing"
Jul 29 09:29:13.329703 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.329682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.331988 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.331970    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0abb48-openshift-default-dockercfg-22tgw\""
Jul 29 09:29:13.345265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.345240    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"]
Jul 29 09:29:13.354745 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.354694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:13.394241 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-envoy\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.394440 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-certs\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.394440 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/031c76d8-c909-4fb1-976a-350b62d604d6-istiod-ca-cert\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.394440 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/031c76d8-c909-4fb1-976a-350b62d604d6-istio-podinfo\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.394440 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-istio-token\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.394627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-credential-socket\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.394627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-data\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.394627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mjjn\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-kube-api-access-8mjjn\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.394627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.394539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-socket\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495154 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mjjn\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-kube-api-access-8mjjn\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495154 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-socket\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495367 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-envoy\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495367 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-certs\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495445 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/031c76d8-c909-4fb1-976a-350b62d604d6-istiod-ca-cert\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495501 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/031c76d8-c909-4fb1-976a-350b62d604d6-istio-podinfo\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-socket\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-istio-token\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495800 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-credential-socket\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495800 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-data\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495800 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-certs\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.495972 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-credential-socket\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.496014 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.495974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-data\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.496187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.496159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/031c76d8-c909-4fb1-976a-350b62d604d6-istiod-ca-cert\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.497640 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.497617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-envoy\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.498221 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.498199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/031c76d8-c909-4fb1-976a-350b62d604d6-istio-podinfo\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.503372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.503347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mjjn\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-kube-api-access-8mjjn\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.503464 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.503424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-istio-token\") pod \"e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") " pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.640727 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.640684    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:13.787885 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.787852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"]
Jul 29 09:29:13.790862 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:29:13.790831    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031c76d8_c909_4fb1_976a_350b62d604d6.slice/crio-9d49ab5fcceef4d21916de594613149ca580c2c6e7462ed959a923c59ad7dab1 WatchSource:0}: Error finding container 9d49ab5fcceef4d21916de594613149ca580c2c6e7462ed959a923c59ad7dab1: Status 404 returned error can't find the container with id 9d49ab5fcceef4d21916de594613149ca580c2c6e7462ed959a923c59ad7dab1
Jul 29 09:29:13.792907 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.792873    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:13.792981 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.792945    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:13.792981 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.792976    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:13.938181 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:13.938085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:14.607370 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:14.607330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" event={"ID":"031c76d8-c909-4fb1-976a-350b62d604d6","Type":"ContainerStarted","Data":"2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5"}
Jul 29 09:29:14.607760 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:14.607411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" event={"ID":"031c76d8-c909-4fb1-976a-350b62d604d6","Type":"ContainerStarted","Data":"9d49ab5fcceef4d21916de594613149ca580c2c6e7462ed959a923c59ad7dab1"}
Jul 29 09:29:14.640876 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:14.640841    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:14.645564 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:14.645540    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:14.666521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:14.666465    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" podStartSLOduration=1.6664461940000002 podStartE2EDuration="1.666446194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:29:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:29:14.625053055 +0000 UTC m=+2503.396323140" watchObservedRunningTime="2026-07-29 09:29:14.666446194 +0000 UTC m=+2503.437716259"
Jul 29 09:29:15.611864 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:15.611829    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:15.612893 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:15.612874    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:16.530591 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.530562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:16.625872 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.625827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:16.736707 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.736675    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"]
Jul 29 09:29:16.740049 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.740021    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.742223 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.742200    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0abb48-serving-cert\""
Jul 29 09:29:16.742384 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.742312    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2twj8\""
Jul 29 09:29:16.742459 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.742418    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 09:29:16.742683 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.742668    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 09:29:16.750814 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.750775    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"]
Jul 29 09:29:16.770216 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.770183    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:16.827197 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.827109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672e2b88-f7fb-468c-bb4c-79528c3de67f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.827197 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.827160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672e2b88-f7fb-468c-bb4c-79528c3de67f-maas-api-tls\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.827394 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.827278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-684vp\" (UniqueName: \"kubernetes.io/projected/672e2b88-f7fb-468c-bb4c-79528c3de67f-kube-api-access-684vp\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.910091 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.910055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:16.928129 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.928096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672e2b88-f7fb-468c-bb4c-79528c3de67f-maas-api-tls\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.928300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.928174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-684vp\" (UniqueName: \"kubernetes.io/projected/672e2b88-f7fb-468c-bb4c-79528c3de67f-kube-api-access-684vp\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.928300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.928239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672e2b88-f7fb-468c-bb4c-79528c3de67f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.928860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.928832    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672e2b88-f7fb-468c-bb4c-79528c3de67f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.930620 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.930589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672e2b88-f7fb-468c-bb4c-79528c3de67f-maas-api-tls\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:16.935424 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:16.935396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-684vp\" (UniqueName: \"kubernetes.io/projected/672e2b88-f7fb-468c-bb4c-79528c3de67f-kube-api-access-684vp\") pod \"maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:17.053186 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.053146    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:17.197910 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.197885    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"]
Jul 29 09:29:17.200440 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:29:17.200407    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672e2b88_f7fb_468c_bb4c_79528c3de67f.slice/crio-d5c96b135639bbbb110d1abade10c669199caa5e27fc902865f243323e8f98ca WatchSource:0}: Error finding container d5c96b135639bbbb110d1abade10c669199caa5e27fc902865f243323e8f98ca: Status 404 returned error can't find the container with id d5c96b135639bbbb110d1abade10c669199caa5e27fc902865f243323e8f98ca
Jul 29 09:29:17.485025 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.484995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:17.586662 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.586635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:17.622303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.622264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9" event={"ID":"672e2b88-f7fb-468c-bb4c-79528c3de67f","Type":"ContainerStarted","Data":"4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0"}
Jul 29 09:29:17.622482 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.622360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9" event={"ID":"672e2b88-f7fb-468c-bb4c-79528c3de67f","Type":"ContainerStarted","Data":"d5c96b135639bbbb110d1abade10c669199caa5e27fc902865f243323e8f98ca"}
Jul 29 09:29:17.622558 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.622492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:17.625892 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.625842    2564 generic.go:356] "Generic (PLEG): container finished" podID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerID="2304d6f10bfdc8857c4393b2d5a5caec467400395cf6f637ead37a7e14883585" exitCode=0
Jul 29 09:29:17.626319 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.626004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" event={"ID":"28c684ac-1960-4f8c-b4eb-3a36b0cf0540","Type":"ContainerDied","Data":"2304d6f10bfdc8857c4393b2d5a5caec467400395cf6f637ead37a7e14883585"}
Jul 29 09:29:17.626319 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.626073    2564 scope.go:117] "RemoveContainer" containerID="13daa04c7e17f9500da4715d3de197ff31a0c430288d9f343c95dc9b0862e3c5"
Jul 29 09:29:17.626468 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.626364    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"]
Jul 29 09:29:17.630118 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.630096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:17.632336 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.632311    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-0abb48-dockercfg-qgbf7\""
Jul 29 09:29:17.632623 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.632604    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-0abb48\""
Jul 29 09:29:17.637538 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.637508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"]
Jul 29 09:29:17.640570 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.640523    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9" podStartSLOduration=1.31824801 podStartE2EDuration="1.640505943s" totalImagesPullingTime="322.257933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:29:17.638071171 +0000 UTC m=+2506.409341263" watchObservedRunningTime="2026-07-29 09:29:17.640505943 +0000 UTC m=+2506.411776008"
Jul 29 09:29:17.664092 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.664054    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"]
Jul 29 09:29:17.669107 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.669081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:17.675584 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.675472    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"]
Jul 29 09:29:17.722937 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.722878    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:29:17.735169 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.735139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147ffe14-e5cb-4a2b-913b-d9e1ff084888-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t\" (UID: \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:17.735323 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.735196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvjz\" (UniqueName: \"kubernetes.io/projected/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-kube-api-access-pbvjz\") pod \"payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx\" (UID: \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:17.735467 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.735438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx\" (UID: \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:17.735593 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.735481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm5zj\" (UniqueName: \"kubernetes.io/projected/147ffe14-e5cb-4a2b-913b-d9e1ff084888-kube-api-access-rm5zj\") pod \"payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t\" (UID: \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:17.836953 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.836906    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-data\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837142 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.836965    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-envoy\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837142 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837020    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l25vd\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-kube-api-access-l25vd\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837142 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-podinfo\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837142 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837090    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-socket\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837142 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-certs\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837401 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837175    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-credential-socket\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837401 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837241    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-token\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837401 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837266    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istiod-ca-cert\") pod \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\" (UID: \"28c684ac-1960-4f8c-b4eb-3a36b0cf0540\") "
Jul 29 09:29:17.837401 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837364    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:29:17.837601 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837441    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:29:17.837601 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147ffe14-e5cb-4a2b-913b-d9e1ff084888-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t\" (UID: \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:17.837601 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvjz\" (UniqueName: \"kubernetes.io/projected/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-kube-api-access-pbvjz\") pod \"payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx\" (UID: \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:17.837786 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx\" (UID: \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:17.837786 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm5zj\" (UniqueName: \"kubernetes.io/projected/147ffe14-e5cb-4a2b-913b-d9e1ff084888-kube-api-access-rm5zj\") pod \"payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t\" (UID: \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:17.837786 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837766    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-data" (OuterVolumeSpecName: "istio-data") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:29:17.837949 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837871    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.837949 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837889    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.837949 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.837903    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.838524 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.838479    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147ffe14-e5cb-4a2b-913b-d9e1ff084888-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t\" (UID: \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:17.838656 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.838517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:29:17.838759 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.838737    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:29:17.838832 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.838810    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx\" (UID: \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:17.839448 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.839418    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:29:17.840050 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.840025    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-kube-api-access-l25vd" (OuterVolumeSpecName: "kube-api-access-l25vd") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "kube-api-access-l25vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:29:17.840381 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.840361    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-token" (OuterVolumeSpecName: "istio-token") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:29:17.840599 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.840577    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28c684ac-1960-4f8c-b4eb-3a36b0cf0540" (UID: "28c684ac-1960-4f8c-b4eb-3a36b0cf0540"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:29:17.845589 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.845559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvjz\" (UniqueName: \"kubernetes.io/projected/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-kube-api-access-pbvjz\") pod \"payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx\" (UID: \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:17.845675 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.845662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm5zj\" (UniqueName: \"kubernetes.io/projected/147ffe14-e5cb-4a2b-913b-d9e1ff084888-kube-api-access-rm5zj\") pod \"payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t\" (UID: \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:17.938508 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.938483    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.938638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.938513    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.938638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.938530    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.938638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.938539    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.938638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.938547    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l25vd\" (UniqueName: \"kubernetes.io/projected/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-kube-api-access-l25vd\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.938638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.938556    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28c684ac-1960-4f8c-b4eb-3a36b0cf0540-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:29:17.944350 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.944324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:17.983434 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:17.983349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:18.093132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.092643    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"]
Jul 29 09:29:18.096282 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:29:18.096239    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd605e60_c4e3_4c4c_9fcf_bbf19cf620a5.slice/crio-a4e08fe39dd89fb44b73a50e4ad0c3ccb4bbbc1dc9052c221019a536ed9b0461 WatchSource:0}: Error finding container a4e08fe39dd89fb44b73a50e4ad0c3ccb4bbbc1dc9052c221019a536ed9b0461: Status 404 returned error can't find the container with id a4e08fe39dd89fb44b73a50e4ad0c3ccb4bbbc1dc9052c221019a536ed9b0461
Jul 29 09:29:18.134660 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.134633    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"]
Jul 29 09:29:18.137315 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:29:18.137291    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147ffe14_e5cb_4a2b_913b_d9e1ff084888.slice/crio-e6a314aceebdb51eb5b155f19f80b9c292d54c49f67818a47568f254d55b8bec WatchSource:0}: Error finding container e6a314aceebdb51eb5b155f19f80b9c292d54c49f67818a47568f254d55b8bec: Status 404 returned error can't find the container with id e6a314aceebdb51eb5b155f19f80b9c292d54c49f67818a47568f254d55b8bec
Jul 29 09:29:18.632634 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.632597    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx" event={"ID":"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5","Type":"ContainerStarted","Data":"d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3"}
Jul 29 09:29:18.633130 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.632692    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:18.633130 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.632740    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx" event={"ID":"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5","Type":"ContainerStarted","Data":"a4e08fe39dd89fb44b73a50e4ad0c3ccb4bbbc1dc9052c221019a536ed9b0461"}
Jul 29 09:29:18.633982 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.633954    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"
Jul 29 09:29:18.634062 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.633988    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f" event={"ID":"28c684ac-1960-4f8c-b4eb-3a36b0cf0540","Type":"ContainerDied","Data":"e23298658fa75683e5f8387ab031a5bbc6a62fb95b567a1f8578c326d787fccf"}
Jul 29 09:29:18.634062 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.634048    2564 scope.go:117] "RemoveContainer" containerID="2304d6f10bfdc8857c4393b2d5a5caec467400395cf6f637ead37a7e14883585"
Jul 29 09:29:18.635641 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.635602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t" event={"ID":"147ffe14-e5cb-4a2b-913b-d9e1ff084888","Type":"ContainerStarted","Data":"f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278"}
Jul 29 09:29:18.635757 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.635655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t" event={"ID":"147ffe14-e5cb-4a2b-913b-d9e1ff084888","Type":"ContainerStarted","Data":"e6a314aceebdb51eb5b155f19f80b9c292d54c49f67818a47568f254d55b8bec"}
Jul 29 09:29:18.647649 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.647605    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx" podStartSLOduration=1.647591246 podStartE2EDuration="1.647591246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:29:18.646581388 +0000 UTC m=+2507.417851469" watchObservedRunningTime="2026-07-29 09:29:18.647591246 +0000 UTC m=+2507.418861310"
Jul 29 09:29:18.660660 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.660633    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"]
Jul 29 09:29:18.664452 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.664423    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-cddb75-openshift-default-6f4c8c56dd-x6f7f"]
Jul 29 09:29:18.676691 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:18.676642    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t" podStartSLOduration=1.676625684 podStartE2EDuration="1.676625684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:29:18.676400429 +0000 UTC m=+2507.447670512" watchObservedRunningTime="2026-07-29 09:29:18.676625684 +0000 UTC m=+2507.447895753"
Jul 29 09:29:19.641860 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:19.641826    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:19.761076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:19.761043    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" path="/var/lib/kubelet/pods/28c684ac-1960-4f8c-b4eb-3a36b0cf0540/volumes"
Jul 29 09:29:23.640970 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:23.640941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:29:29.643686 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:29.643649    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:29:30.613462 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.613435    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 09:29:30.613614 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.613502    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 09:29:30.648728 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.648692    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:29:30.698304 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.698271    2564 generic.go:356] "Generic (PLEG): container finished" podID="031c76d8-c909-4fb1-976a-350b62d604d6" containerID="2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5" exitCode=0
Jul 29 09:29:30.698447 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.698335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" event={"ID":"031c76d8-c909-4fb1-976a-350b62d604d6","Type":"ContainerDied","Data":"2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5"}
Jul 29 09:29:30.698916 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.698799    2564 scope.go:117] "RemoveContainer" containerID="2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5"
Jul 29 09:29:30.700129 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.700099    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:30.700219 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.700184    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:30.700265 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:30.700221    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:31.706674 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:31.706625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" event={"ID":"031c76d8-c909-4fb1-976a-350b62d604d6","Type":"ContainerStarted","Data":"11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b"}
Jul 29 09:29:32.641385 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:32.641349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:32.641608 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:32.641585    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 09:29:32.641656 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:32.641633    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 09:29:33.641927 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:33.641889    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 09:29:33.642315 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:33.641969    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 09:29:34.641114 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:34.641077    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 09:29:34.641298 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:34.641134    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 09:29:35.641595 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:35.641557    2564 patch_prober.go:28] interesting pod/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 09:29:35.642031 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:35.641613    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 09:29:36.645112 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:36.645083    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:36.645511 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:36.645349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:36.646174 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:36.646155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:29:41.481440 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:41.481406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:41.836105 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:41.836007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:42.072550 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.072513    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"]
Jul 29 09:29:42.072875 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.072860    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy"
Jul 29 09:29:42.072927 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.072877    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy"
Jul 29 09:29:42.072927 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.072887    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy"
Jul 29 09:29:42.072927 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.072893    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy"
Jul 29 09:29:42.073026 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.072951    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy"
Jul 29 09:29:42.073026 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.072959    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="28c684ac-1960-4f8c-b4eb-3a36b0cf0540" containerName="istio-proxy"
Jul 29 09:29:42.075693 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.075671    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.077928 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.077892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-27430b-openshift-default-dockercfg-qdvt2\""
Jul 29 09:29:42.086739 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.086662    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"]
Jul 29 09:29:42.099993 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.099956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:42.190480 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-socket\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.190655 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-podinfo\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.190655 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-certs\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.190655 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istiod-ca-cert\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.190655 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-credential-socket\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.190655 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-envoy\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.190894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-data\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.190894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgb58\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-kube-api-access-kgb58\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.190894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.190841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-token\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.291570 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.291533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istiod-ca-cert\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.291570 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.291574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-credential-socket\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.291865 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.291595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-envoy\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.291865 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.291613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-data\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.291865 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.291762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgb58\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-kube-api-access-kgb58\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.291865 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.291851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-token\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.292083 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.291896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-socket\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.292083 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.291944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-podinfo\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.292083 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.292025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-certs\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.292083 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.292026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-data\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.292290 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.292146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-credential-socket\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.292352 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.292290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istiod-ca-cert\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.292454 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.292419    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-certs\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.292522 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.292489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-socket\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.294410 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.294378    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-envoy\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.294523 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.294478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-podinfo\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.299849 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.299822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-token\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.299849 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.299833    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgb58\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-kube-api-access-kgb58\") pod \"e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") " pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.387916 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.387876    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:42.485388 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.485351    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:42.532172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.532049    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"]
Jul 29 09:29:42.534669 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:29:42.534645    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23ef7f4_9ab1_4eb9_be10_bc514103acd8.slice/crio-049e4132c3ac43548533ab8e7738cf54f07a57d61eb52e2c307833187acc3a9f WatchSource:0}: Error finding container 049e4132c3ac43548533ab8e7738cf54f07a57d61eb52e2c307833187acc3a9f: Status 404 returned error can't find the container with id 049e4132c3ac43548533ab8e7738cf54f07a57d61eb52e2c307833187acc3a9f
Jul 29 09:29:42.536924 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.536889    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:42.537029 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.536967    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:42.537029 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.537011    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:42.765852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.765767    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" event={"ID":"a23ef7f4-9ab1-4eb9-be10-bc514103acd8","Type":"ContainerStarted","Data":"5f61ab37a3b7ad6c869590e5ea09e9ac0583eaed86c9c79743e808de3395387f"}
Jul 29 09:29:42.765852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.765814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" event={"ID":"a23ef7f4-9ab1-4eb9-be10-bc514103acd8","Type":"ContainerStarted","Data":"049e4132c3ac43548533ab8e7738cf54f07a57d61eb52e2c307833187acc3a9f"}
Jul 29 09:29:42.788026 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:42.787973    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" podStartSLOduration=0.787955346 podStartE2EDuration="787.955346ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:29:42.786673275 +0000 UTC m=+2531.557943364" watchObservedRunningTime="2026-07-29 09:29:42.787955346 +0000 UTC m=+2531.559225415"
Jul 29 09:29:43.388541 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:43.388502    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:43.394461 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:43.394431    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:43.770824 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:43.770738    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:43.771892 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:43.771870    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:29:44.666524 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.666480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:44.750884 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.750850    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"]
Jul 29 09:29:44.753607 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.753532    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:44.754322 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.754306    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.756809 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.756788    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-27430b-serving-cert\""
Jul 29 09:29:44.764352 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.764316    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"]
Jul 29 09:29:44.816138 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.816099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.816638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.816291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d4a631-79ae-47b0-9b03-2e20371b61ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.816638 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.816417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgjxf\" (UniqueName: \"kubernetes.io/projected/e2d4a631-79ae-47b0-9b03-2e20371b61ba-kube-api-access-mgjxf\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.834510 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.834479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:44.917733 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.917634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d4a631-79ae-47b0-9b03-2e20371b61ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.917733 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.917689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgjxf\" (UniqueName: \"kubernetes.io/projected/e2d4a631-79ae-47b0-9b03-2e20371b61ba-kube-api-access-mgjxf\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.917973 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.917735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.917973 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:29:44.917892    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-serving-cert: secret "maas-api-e2e-shared-b-27430b-serving-cert" not found
Jul 29 09:29:44.917973 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:29:44.917949    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls podName:e2d4a631-79ae-47b0-9b03-2e20371b61ba nodeName:}" failed. No retries permitted until 2026-07-29 09:29:45.417933643 +0000 UTC m=+2534.189203689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls") pod "maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p" (UID: "e2d4a631-79ae-47b0-9b03-2e20371b61ba") : secret "maas-api-e2e-shared-b-27430b-serving-cert" not found
Jul 29 09:29:44.918378 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.918354    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d4a631-79ae-47b0-9b03-2e20371b61ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.925455 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.925433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgjxf\" (UniqueName: \"kubernetes.io/projected/e2d4a631-79ae-47b0-9b03-2e20371b61ba-kube-api-access-mgjxf\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:44.988886 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:44.988852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:45.423420 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.423389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:45.425907 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.425887    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:45.464343 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.464312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:45.558626 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.558595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:45.668691 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.668652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:45.671492 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.671468    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"]
Jul 29 09:29:45.674732 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.674654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:45.677507 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.677483    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-27430b\""
Jul 29 09:29:45.680132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.680098    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-27430b-dockercfg-7t28q\""
Jul 29 09:29:45.700654 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.700623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"]
Jul 29 09:29:45.726441 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.726400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a467c79c-89fb-4ee9-b4d7-d69a2f373588-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj\" (UID: \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:45.726633 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.726473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d27g2\" (UniqueName: \"kubernetes.io/projected/a467c79c-89fb-4ee9-b4d7-d69a2f373588-kube-api-access-d27g2\") pod \"payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj\" (UID: \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:45.827610 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.827566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a467c79c-89fb-4ee9-b4d7-d69a2f373588-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj\" (UID: \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:45.828099 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.827628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27g2\" (UniqueName: \"kubernetes.io/projected/a467c79c-89fb-4ee9-b4d7-d69a2f373588-kube-api-access-d27g2\") pod \"payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj\" (UID: \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:45.828345 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.828325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a467c79c-89fb-4ee9-b4d7-d69a2f373588-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj\" (UID: \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:45.836073 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:45.836046    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d27g2\" (UniqueName: \"kubernetes.io/projected/a467c79c-89fb-4ee9-b4d7-d69a2f373588-kube-api-access-d27g2\") pod \"payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj\" (UID: \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:46.014236 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.014159    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:46.032032 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.032001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"]
Jul 29 09:29:46.033993 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:29:46.033956    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d4a631_79ae_47b0_9b03_2e20371b61ba.slice/crio-63fb541e7d9a254638f26c470b763b19208b23f4e05cdd4a8de56e543f23fef7 WatchSource:0}: Error finding container 63fb541e7d9a254638f26c470b763b19208b23f4e05cdd4a8de56e543f23fef7: Status 404 returned error can't find the container with id 63fb541e7d9a254638f26c470b763b19208b23f4e05cdd4a8de56e543f23fef7
Jul 29 09:29:46.143183 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.143156    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"]
Jul 29 09:29:46.145471 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:29:46.145444    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda467c79c_89fb_4ee9_b4d7_d69a2f373588.slice/crio-defb73c178cd9c8b593234325fcf43f63c28362316711d617d30f96b21106d21 WatchSource:0}: Error finding container defb73c178cd9c8b593234325fcf43f63c28362316711d617d30f96b21106d21: Status 404 returned error can't find the container with id defb73c178cd9c8b593234325fcf43f63c28362316711d617d30f96b21106d21
Jul 29 09:29:46.787473 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.787369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p" event={"ID":"e2d4a631-79ae-47b0-9b03-2e20371b61ba","Type":"ContainerStarted","Data":"59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d"}
Jul 29 09:29:46.787645 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.787555    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:46.787645 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.787586    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p" event={"ID":"e2d4a631-79ae-47b0-9b03-2e20371b61ba","Type":"ContainerStarted","Data":"63fb541e7d9a254638f26c470b763b19208b23f4e05cdd4a8de56e543f23fef7"}
Jul 29 09:29:46.788813 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.788792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj" event={"ID":"a467c79c-89fb-4ee9-b4d7-d69a2f373588","Type":"ContainerStarted","Data":"8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc"}
Jul 29 09:29:46.788888 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.788833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj" event={"ID":"a467c79c-89fb-4ee9-b4d7-d69a2f373588","Type":"ContainerStarted","Data":"defb73c178cd9c8b593234325fcf43f63c28362316711d617d30f96b21106d21"}
Jul 29 09:29:46.788888 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.788853    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:46.812333 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.812266    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p" podStartSLOduration=2.44101522 podStartE2EDuration="2.812245101s" totalImagesPullingTime="371.229881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:29:46.810711092 +0000 UTC m=+2535.581981180" watchObservedRunningTime="2026-07-29 09:29:46.812245101 +0000 UTC m=+2535.583515167"
Jul 29 09:29:46.843551 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:46.843493    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj" podStartSLOduration=1.8434748810000001 podStartE2EDuration="1.843474881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:29:46.842757002 +0000 UTC m=+2535.614027070" watchObservedRunningTime="2026-07-29 09:29:46.843474881 +0000 UTC m=+2535.614744946"
Jul 29 09:29:52.799390 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:52.799350    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:29:56.833565 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:56.833531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:29:57.797165 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:57.797131    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:29:59.523933 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:59.523750    2564 patch_prober.go:28] interesting pod/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:58178->10.132.0.69:15021: read: connection reset by peer" start-of-body=
Jul 29 09:29:59.523933 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:59.523843    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:58178->10.132.0.69:15021: read: connection reset by peer"
Jul 29 09:29:59.855080 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:59.854975    2564 generic.go:356] "Generic (PLEG): container finished" podID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerID="5f61ab37a3b7ad6c869590e5ea09e9ac0583eaed86c9c79743e808de3395387f" exitCode=0
Jul 29 09:29:59.855080 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:59.855045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" event={"ID":"a23ef7f4-9ab1-4eb9-be10-bc514103acd8","Type":"ContainerDied","Data":"5f61ab37a3b7ad6c869590e5ea09e9ac0583eaed86c9c79743e808de3395387f"}
Jul 29 09:29:59.855429 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:59.855416    2564 scope.go:117] "RemoveContainer" containerID="5f61ab37a3b7ad6c869590e5ea09e9ac0583eaed86c9c79743e808de3395387f"
Jul 29 09:29:59.856583 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:59.856553    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:59.856656 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:59.856642    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:29:59.856694 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:29:59.856679    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:30:00.129957 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.129922    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"]
Jul 29 09:30:00.133039 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.133018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"
Jul 29 09:30:00.134861 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.134842    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:30:00.138416 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.138394    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"]
Jul 29 09:30:00.145920 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.145729    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"
Jul 29 09:30:00.282402 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.282374    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"]
Jul 29 09:30:00.284556 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:30:00.284519    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb564a411_7348_45ea_ba4f_ec3199caa5ba.slice/crio-e395349ce2afa39832a51e38f053a439de2d8465ddfefff1e69ef96c047d463c WatchSource:0}: Error finding container e395349ce2afa39832a51e38f053a439de2d8465ddfefff1e69ef96c047d463c: Status 404 returned error can't find the container with id e395349ce2afa39832a51e38f053a439de2d8465ddfefff1e69ef96c047d463c
Jul 29 09:30:00.861544 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.861450    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" event={"ID":"a23ef7f4-9ab1-4eb9-be10-bc514103acd8","Type":"ContainerStarted","Data":"19f100f76e4c8e768dd6f85c2dc9457d3195fd1bf0bb9cde982511976d0023b4"}
Jul 29 09:30:00.863034 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.863012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg" event={"ID":"b564a411-7348-45ea-ba4f-ec3199caa5ba","Type":"ContainerStarted","Data":"ced244c4ef93dc8798e64edae5b6e10b682d81c2c1bbf2db740caf0e6a1a214b"}
Jul 29 09:30:00.863116 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.863050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg" event={"ID":"b564a411-7348-45ea-ba4f-ec3199caa5ba","Type":"ContainerStarted","Data":"e395349ce2afa39832a51e38f053a439de2d8465ddfefff1e69ef96c047d463c"}
Jul 29 09:30:00.894761 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:00.894681    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg" podStartSLOduration=0.894664805 podStartE2EDuration="894.664805ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:30:00.89276767 +0000 UTC m=+2549.664037745" watchObservedRunningTime="2026-07-29 09:30:00.894664805 +0000 UTC m=+2549.665934869"
Jul 29 09:30:01.388286 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:01.388246    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:30:01.388473 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:01.388428    2564 patch_prober.go:28] interesting pod/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 29 09:30:01.388521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:01.388487    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 29 09:30:01.869668 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:01.869573    2564 generic.go:356] "Generic (PLEG): container finished" podID="b564a411-7348-45ea-ba4f-ec3199caa5ba" containerID="ced244c4ef93dc8798e64edae5b6e10b682d81c2c1bbf2db740caf0e6a1a214b" exitCode=0
Jul 29 09:30:01.869668 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:01.869658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg" event={"ID":"b564a411-7348-45ea-ba4f-ec3199caa5ba","Type":"ContainerDied","Data":"ced244c4ef93dc8798e64edae5b6e10b682d81c2c1bbf2db740caf0e6a1a214b"}
Jul 29 09:30:02.388924 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:02.388883    2564 patch_prober.go:28] interesting pod/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 29 09:30:02.389111 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:02.388939    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 29 09:30:03.048034 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:03.048005    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"
Jul 29 09:30:03.389395 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:03.389362    2564 patch_prober.go:28] interesting pod/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 29 09:30:03.389565 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:03.389432    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 29 09:30:03.881438 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:03.881399    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg" event={"ID":"b564a411-7348-45ea-ba4f-ec3199caa5ba","Type":"ContainerDied","Data":"e395349ce2afa39832a51e38f053a439de2d8465ddfefff1e69ef96c047d463c"}
Jul 29 09:30:03.881438 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:03.881421    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"
Jul 29 09:30:03.881644 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:03.881455    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e395349ce2afa39832a51e38f053a439de2d8465ddfefff1e69ef96c047d463c"
Jul 29 09:30:04.388468 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:04.388426    2564 patch_prober.go:28] interesting pod/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 29 09:30:04.388893 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:04.388486    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 29 09:30:05.392065 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:05.392035    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:30:05.392565 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:05.392426    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:30:05.393203 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:05.393184    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:30:09.619192 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:09.619157    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:30:18.783890 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:18.783846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:30:18.836949 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:18.836917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:30:33.020393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:30:33.020359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:31:02.555270 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:31:02.555194    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:31:57.992028 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:31:57.991990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:32:09.146289 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:32:09.146250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:33:32.078056 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:33:32.078016    2564 scope.go:117] "RemoveContainer" containerID="52534892c0c8f53cb42ca97b0bcc23af41653b3a605663ab56714a4a81105674"
Jul 29 09:33:32.086113 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:33:32.086093    2564 scope.go:117] "RemoveContainer" containerID="3ac8e5b46e863e83b99029cc6215b4d56b302b8a0fcedf8e61ab888b5a03cf36"
Jul 29 09:34:46.067339 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:34:46.067296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:35:24.837272 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:35:24.837194    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:35:25.757814 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:35:25.757777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:35:34.949071 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:35:34.949024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:36:09.548950 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:36:09.548905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:37:30.420097 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:37:30.420044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:37:32.068478 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:37:32.068442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:37:40.777636 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:37:40.777533    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:37:57.565222 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:37:57.565185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:06.617533 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:06.617491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:07.626346 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:07.626308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:21.717365 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:21.717329    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:28.105017 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.104976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:28.376066 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.376033    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"]
Jul 29 09:39:28.376532 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.376513    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b564a411-7348-45ea-ba4f-ec3199caa5ba" containerName="cleanup"
Jul 29 09:39:28.376612 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.376536    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b564a411-7348-45ea-ba4f-ec3199caa5ba" containerName="cleanup"
Jul 29 09:39:28.376654 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.376626    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b564a411-7348-45ea-ba4f-ec3199caa5ba" containerName="cleanup"
Jul 29 09:39:28.379503 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.379489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.381688 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.381669    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b9d569-openshift-default-dockercfg-ktncg\""
Jul 29 09:39:28.391325 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.391303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"]
Jul 29 09:39:28.398397 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.398373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:28.436963 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.436930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-certs\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.437115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.436977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-envoy\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.437115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.436999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-data\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.437115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.437017    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-token\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.437115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.437054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkb5v\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-kube-api-access-lkb5v\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.437115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.437090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-podinfo\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.437115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.437109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-credential-socket\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.437438 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.437139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1566122-9b40-42f5-8c82-e94d1823bacf-istiod-ca-cert\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.437438 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.437181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-socket\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.538404 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5v\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-kube-api-access-lkb5v\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.538598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-podinfo\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.538598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-credential-socket\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.538598 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1566122-9b40-42f5-8c82-e94d1823bacf-istiod-ca-cert\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.538792 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-socket\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.538792 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-certs\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.538792 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-envoy\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.538792 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-data\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.539016 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.538802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-token\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.539071 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.539033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-credential-socket\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.539285 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.539264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-socket\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.539383 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.539341    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-certs\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.539692 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.539672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-data\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.539886 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.539866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1566122-9b40-42f5-8c82-e94d1823bacf-istiod-ca-cert\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.541063 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.541046    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-podinfo\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.541255 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.541238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-envoy\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.545950 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.545932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-token\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.546280 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.546261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkb5v\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-kube-api-access-lkb5v\") pod \"e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") " pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.690664 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.690576    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:28.718266 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.718225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:28.826624 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.826598    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"]
Jul 29 09:39:28.828627 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:39:28.828599    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1566122_9b40_42f5_8c82_e94d1823bacf.slice/crio-ea41d8e95eafa5179f08749428c74bf2666d26612c742944d1e5886d933610ae WatchSource:0}: Error finding container ea41d8e95eafa5179f08749428c74bf2666d26612c742944d1e5886d933610ae: Status 404 returned error can't find the container with id ea41d8e95eafa5179f08749428c74bf2666d26612c742944d1e5886d933610ae
Jul 29 09:39:28.831134 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.831104    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:39:28.831207 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.831166    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:39:28.831207 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:28.831198    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:39:29.509063 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:29.509021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" event={"ID":"c1566122-9b40-42f5-8c82-e94d1823bacf","Type":"ContainerStarted","Data":"d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe"}
Jul 29 09:39:29.509487 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:29.509086    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" event={"ID":"c1566122-9b40-42f5-8c82-e94d1823bacf","Type":"ContainerStarted","Data":"ea41d8e95eafa5179f08749428c74bf2666d26612c742944d1e5886d933610ae"}
Jul 29 09:39:29.530131 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:29.530080    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" podStartSLOduration=1.530062845 podStartE2EDuration="1.530062845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:39:29.527352423 +0000 UTC m=+3118.298622486" watchObservedRunningTime="2026-07-29 09:39:29.530062845 +0000 UTC m=+3118.301332908"
Jul 29 09:39:29.691133 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:29.691089    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:29.695926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:29.695900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:30.513388 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:30.513355    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:30.514215 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:30.514195    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:31.517335 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.517299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:31.619504 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.619461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:31.620072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.620047    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"]
Jul 29 09:39:31.623573 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.623552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.625581 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.625558    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b9d569-serving-cert\""
Jul 29 09:39:31.636252 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.636226    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"]
Jul 29 09:39:31.669342 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.669309    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a148410e-df75-4bb1-911f-899fdaa9d262-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.669537 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.669373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp7hc\" (UniqueName: \"kubernetes.io/projected/a148410e-df75-4bb1-911f-899fdaa9d262-kube-api-access-qp7hc\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.669537 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.669403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.700924 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.700891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:31.770759 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.770646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a148410e-df75-4bb1-911f-899fdaa9d262-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.770759 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.770739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp7hc\" (UniqueName: \"kubernetes.io/projected/a148410e-df75-4bb1-911f-899fdaa9d262-kube-api-access-qp7hc\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.771008 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.770762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.771558 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.771531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a148410e-df75-4bb1-911f-899fdaa9d262-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.773196 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.773174    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b9d569-serving-cert\""
Jul 29 09:39:31.781056 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:39:31.781028    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-serving-cert: secret "maas-api-e2e-ipp-a-b9d569-serving-cert" not found
Jul 29 09:39:31.781214 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:39:31.781129    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls podName:a148410e-df75-4bb1-911f-899fdaa9d262 nodeName:}" failed. No retries permitted until 2026-07-29 09:39:32.281104883 +0000 UTC m=+3121.052374924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls") pod "maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2" (UID: "a148410e-df75-4bb1-911f-899fdaa9d262") : secret "maas-api-e2e-ipp-a-b9d569-serving-cert" not found
Jul 29 09:39:31.781545 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.781526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp7hc\" (UniqueName: \"kubernetes.io/projected/a148410e-df75-4bb1-911f-899fdaa9d262-kube-api-access-qp7hc\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:31.969324 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:31.969286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:32.180579 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:32.180544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:32.281886 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:32.281845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:32.375311 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:32.375280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:32.377844 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:32.377824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:32.536477 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:32.536385    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:32.667574 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:32.667548    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"]
Jul 29 09:39:32.669673 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:39:32.669648    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda148410e_df75_4bb1_911f_899fdaa9d262.slice/crio-ff09085cb3093d7c80c0e85c959d77c428017582fe0b1d581008b6278d7a1eb0 WatchSource:0}: Error finding container ff09085cb3093d7c80c0e85c959d77c428017582fe0b1d581008b6278d7a1eb0: Status 404 returned error can't find the container with id ff09085cb3093d7c80c0e85c959d77c428017582fe0b1d581008b6278d7a1eb0
Jul 29 09:39:32.671226 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:32.671206    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 09:39:33.529582 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:33.529550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2" event={"ID":"a148410e-df75-4bb1-911f-899fdaa9d262","Type":"ContainerStarted","Data":"b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053"}
Jul 29 09:39:33.529795 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:33.529600    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2" event={"ID":"a148410e-df75-4bb1-911f-899fdaa9d262","Type":"ContainerStarted","Data":"ff09085cb3093d7c80c0e85c959d77c428017582fe0b1d581008b6278d7a1eb0"}
Jul 29 09:39:33.529795 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:33.529629    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:33.546137 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:33.546092    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2" podStartSLOduration=2.097935605 podStartE2EDuration="2.546076709s" totalImagesPullingTime="448.141104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:39:33.544415219 +0000 UTC m=+3122.315685279" watchObservedRunningTime="2026-07-29 09:39:33.546076709 +0000 UTC m=+3122.317346774"
Jul 29 09:39:39.540800 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:39.540766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:39:40.565154 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:40.565116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:49.607684 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:49.607651    2564 generic.go:356] "Generic (PLEG): container finished" podID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerID="d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe" exitCode=0
Jul 29 09:39:49.608168 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:49.607734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" event={"ID":"c1566122-9b40-42f5-8c82-e94d1823bacf","Type":"ContainerDied","Data":"d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe"}
Jul 29 09:39:49.608168 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:49.608116    2564 scope.go:117] "RemoveContainer" containerID="d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe"
Jul 29 09:39:49.609311 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:49.609273    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:39:49.609388 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:49.609371    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:39:49.609428 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:49.609409    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:39:50.621859 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:50.621818    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" event={"ID":"c1566122-9b40-42f5-8c82-e94d1823bacf","Type":"ContainerStarted","Data":"8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b"}
Jul 29 09:39:50.691639 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:50.691598    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:50.691904 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:50.691877    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 29 09:39:50.691971 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:50.691947    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 29 09:39:51.691568 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:51.691532    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 29 09:39:51.691997 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:51.691583    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 29 09:39:52.691894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:52.691859    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 29 09:39:52.692342 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:52.691913    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 29 09:39:53.691831 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:53.691787    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 29 09:39:53.692012 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:53.691849    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 29 09:39:54.694171 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:54.694099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:54.694509 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:54.694421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:54.695129 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:54.695110    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:39:54.774340 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:54.774291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:54.831214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:54.831099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:56.496905 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:56.496855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:57.207678 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:57.207637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:57.590254 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:57.590167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:39:58.044133 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:39:58.044097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:00.641124 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.641087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:00.739708 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.739675    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"]
Jul 29 09:40:00.742397 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.742378    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:00.744844 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.744825    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-150c68-serving-cert\""
Jul 29 09:40:00.756940 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.756917    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"]
Jul 29 09:40:00.776609 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.776571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:00.855826 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.855792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c643f-faa4-41a0-8159-6bf32bc2174e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:00.856191 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.856166    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs6zb\" (UniqueName: \"kubernetes.io/projected/4a1c643f-faa4-41a0-8159-6bf32bc2174e-kube-api-access-vs6zb\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:00.856377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.856357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:00.873078 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.873037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:00.957188 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.957109    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs6zb\" (UniqueName: \"kubernetes.io/projected/4a1c643f-faa4-41a0-8159-6bf32bc2174e-kube-api-access-vs6zb\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:00.957188 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.957166    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:00.957385 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.957197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c643f-faa4-41a0-8159-6bf32bc2174e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:00.957385 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:40:00.957299    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-serving-cert: secret "maas-api-e2e-ipp-b-150c68-serving-cert" not found
Jul 29 09:40:00.957385 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:40:00.957370    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls podName:4a1c643f-faa4-41a0-8159-6bf32bc2174e nodeName:}" failed. No retries permitted until 2026-07-29 09:40:01.457355534 +0000 UTC m=+3150.228625577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls") pod "maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z" (UID: "4a1c643f-faa4-41a0-8159-6bf32bc2174e") : secret "maas-api-e2e-ipp-b-150c68-serving-cert" not found
Jul 29 09:40:00.957886 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.957868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c643f-faa4-41a0-8159-6bf32bc2174e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:00.966238 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:00.966214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs6zb\" (UniqueName: \"kubernetes.io/projected/4a1c643f-faa4-41a0-8159-6bf32bc2174e-kube-api-access-vs6zb\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:01.099139 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.099101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:01.462524 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.462478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:01.465064 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.465037    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:01.652757 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.652693    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:01.690763 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.690730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:01.726415 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.726323    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"]
Jul 29 09:40:01.730558 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.730533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:01.733155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.733065    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-150c68\""
Jul 29 09:40:01.733155 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.733127    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-150c68-dockercfg-hjk68\""
Jul 29 09:40:01.741159 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.740181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"]
Jul 29 09:40:01.765543 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.765505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bmc7\" (UniqueName: \"kubernetes.io/projected/da817b21-7785-4aae-b573-e28550f78082-kube-api-access-7bmc7\") pod \"payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76\" (UID: \"da817b21-7785-4aae-b573-e28550f78082\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:01.765738 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.765602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da817b21-7785-4aae-b573-e28550f78082-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76\" (UID: \"da817b21-7785-4aae-b573-e28550f78082\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:01.817149 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.816913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:01.819129 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.819103    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"]
Jul 29 09:40:01.821238 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:40:01.821199    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1c643f_faa4_41a0_8159_6bf32bc2174e.slice/crio-87bfbc0d9ecee42f1dbb466d41f00bcf52502b0a5dc9d16967fe44d5a0e5ae76 WatchSource:0}: Error finding container 87bfbc0d9ecee42f1dbb466d41f00bcf52502b0a5dc9d16967fe44d5a0e5ae76: Status 404 returned error can't find the container with id 87bfbc0d9ecee42f1dbb466d41f00bcf52502b0a5dc9d16967fe44d5a0e5ae76
Jul 29 09:40:01.866523 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.866484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bmc7\" (UniqueName: \"kubernetes.io/projected/da817b21-7785-4aae-b573-e28550f78082-kube-api-access-7bmc7\") pod \"payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76\" (UID: \"da817b21-7785-4aae-b573-e28550f78082\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:01.866708 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.866538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da817b21-7785-4aae-b573-e28550f78082-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76\" (UID: \"da817b21-7785-4aae-b573-e28550f78082\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:01.867347 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.867327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da817b21-7785-4aae-b573-e28550f78082-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76\" (UID: \"da817b21-7785-4aae-b573-e28550f78082\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:01.894799 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:01.894765    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bmc7\" (UniqueName: \"kubernetes.io/projected/da817b21-7785-4aae-b573-e28550f78082-kube-api-access-7bmc7\") pod \"payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76\" (UID: \"da817b21-7785-4aae-b573-e28550f78082\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:02.046883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.046775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:02.189992 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.189967    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"]
Jul 29 09:40:02.194033 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:40:02.194000    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda817b21_7785_4aae_b573_e28550f78082.slice/crio-f49001ab92782d9d49e9e6e5f3117ffc04f80a621c6a7d4426f272bf83533e73 WatchSource:0}: Error finding container f49001ab92782d9d49e9e6e5f3117ffc04f80a621c6a7d4426f272bf83533e73: Status 404 returned error can't find the container with id f49001ab92782d9d49e9e6e5f3117ffc04f80a621c6a7d4426f272bf83533e73
Jul 29 09:40:02.684792 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.684757    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z" event={"ID":"4a1c643f-faa4-41a0-8159-6bf32bc2174e","Type":"ContainerStarted","Data":"9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91"}
Jul 29 09:40:02.685268 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.684814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z" event={"ID":"4a1c643f-faa4-41a0-8159-6bf32bc2174e","Type":"ContainerStarted","Data":"87bfbc0d9ecee42f1dbb466d41f00bcf52502b0a5dc9d16967fe44d5a0e5ae76"}
Jul 29 09:40:02.685268 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.684844    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:02.686146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.686123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76" event={"ID":"da817b21-7785-4aae-b573-e28550f78082","Type":"ContainerStarted","Data":"5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556"}
Jul 29 09:40:02.686226 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.686164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76" event={"ID":"da817b21-7785-4aae-b573-e28550f78082","Type":"ContainerStarted","Data":"f49001ab92782d9d49e9e6e5f3117ffc04f80a621c6a7d4426f272bf83533e73"}
Jul 29 09:40:02.686274 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.686239    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:02.702333 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.702272    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z" podStartSLOduration=2.375005335 podStartE2EDuration="2.702253949s" totalImagesPullingTime="327.248614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:40:02.699600786 +0000 UTC m=+3151.470870871" watchObservedRunningTime="2026-07-29 09:40:02.702253949 +0000 UTC m=+3151.473524012"
Jul 29 09:40:02.713931 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:02.713864    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76" podStartSLOduration=1.713843394 podStartE2EDuration="1.713843394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:40:02.713215144 +0000 UTC m=+3151.484485217" watchObservedRunningTime="2026-07-29 09:40:02.713843394 +0000 UTC m=+3151.485113462"
Jul 29 09:40:08.696303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:08.696267    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:40:10.687836 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:10.687803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:10.788921 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:10.788879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:13.484102 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:13.484057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:13.693782 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:13.693746    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:40:25.634662 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:25.634628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:40:39.866942 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:40:39.866907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:22.823479 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:22.823435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:23.162513 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.162473    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"]
Jul 29 09:41:23.165885 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.165863    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.171426 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.171398    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-82acc2-openshift-default-dockercfg-4tgc9\""
Jul 29 09:41:23.185748 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.185700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"]
Jul 29 09:41:23.202405 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.202369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2wt\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-kube-api-access-qj2wt\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-data\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-envoy\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-socket\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-podinfo\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-certs\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-token\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-credential-socket\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.255758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.255438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.356974 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.356934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-certs\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.356974 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.356977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-token\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357228 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-credential-socket\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357228 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357228 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2wt\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-kube-api-access-qj2wt\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357228 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-data\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357228 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-envoy\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357228 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-socket\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357558 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-podinfo\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357558 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-credential-socket\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357659 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-certs\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357731 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-data\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.357779 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.357747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-socket\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.358037 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.358013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.359746 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.359702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-envoy\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.359984 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.359962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-podinfo\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.366361 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.366332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-token\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.366554 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.366535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2wt\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-kube-api-access-qj2wt\") pod \"e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") " pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.476429 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.476336    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:23.548814 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.548706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:23.632092 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.632063    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"]
Jul 29 09:41:23.634202 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:41:23.634164    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e97828_4a38_4f60_a9b7_df90e6b2a91a.slice/crio-9125a7241470f6b762e08f2fa40bb9b0e6b6f918b94207c45431dd19e002ce4e WatchSource:0}: Error finding container 9125a7241470f6b762e08f2fa40bb9b0e6b6f918b94207c45431dd19e002ce4e: Status 404 returned error can't find the container with id 9125a7241470f6b762e08f2fa40bb9b0e6b6f918b94207c45431dd19e002ce4e
Jul 29 09:41:23.636417 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.636361    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:41:23.636517 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.636450    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:41:23.636517 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:23.636483    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:41:24.084594 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:24.084556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" event={"ID":"e8e97828-4a38-4f60-a9b7-df90e6b2a91a","Type":"ContainerStarted","Data":"91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c"}
Jul 29 09:41:24.085000 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:24.084616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" event={"ID":"e8e97828-4a38-4f60-a9b7-df90e6b2a91a","Type":"ContainerStarted","Data":"9125a7241470f6b762e08f2fa40bb9b0e6b6f918b94207c45431dd19e002ce4e"}
Jul 29 09:41:24.105569 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:24.105508    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" podStartSLOduration=1.105491561 podStartE2EDuration="1.105491561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:41:24.10317368 +0000 UTC m=+3232.874443744" watchObservedRunningTime="2026-07-29 09:41:24.105491561 +0000 UTC m=+3232.876761625"
Jul 29 09:41:24.476881 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:24.476847    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:24.482317 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:24.482292    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:25.089956 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:25.089923    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:25.090892 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:25.090873    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:26.039591 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.039553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:26.131656 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.131626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:26.205435 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.205400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:26.515645 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.515610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:26.736926 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.736891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:26.843256 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.843169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:26.870857 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.870823    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"]
Jul 29 09:41:26.879175 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.879141    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:26.881817 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.881639    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-82acc2\""
Jul 29 09:41:26.882648 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.882625    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-82acc2-dockercfg-qknt4\""
Jul 29 09:41:26.885410 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.885390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"]
Jul 29 09:41:26.990623 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.990587    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n84rq\" (UniqueName: \"kubernetes.io/projected/aee99bad-542d-47aa-aed0-aa8977f0ebbb-kube-api-access-n84rq\") pod \"payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz\" (UID: \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:26.991025 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:26.990999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee99bad-542d-47aa-aed0-aa8977f0ebbb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz\" (UID: \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:27.092489 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:27.092449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee99bad-542d-47aa-aed0-aa8977f0ebbb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz\" (UID: \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:27.092667 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:27.092509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n84rq\" (UniqueName: \"kubernetes.io/projected/aee99bad-542d-47aa-aed0-aa8977f0ebbb-kube-api-access-n84rq\") pod \"payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz\" (UID: \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:27.093218 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:27.093200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee99bad-542d-47aa-aed0-aa8977f0ebbb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz\" (UID: \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:27.100794 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:27.100732    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n84rq\" (UniqueName: \"kubernetes.io/projected/aee99bad-542d-47aa-aed0-aa8977f0ebbb-kube-api-access-n84rq\") pod \"payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz\" (UID: \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:27.192576 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:27.192545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:27.327883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:27.327840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"]
Jul 29 09:41:27.330024 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:41:27.329988    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee99bad_542d_47aa_aed0_aa8977f0ebbb.slice/crio-8d96e49b42ecdd1b095897bfe0431823c8c4a9b69471a50d1fd7b5c0a3d530b9 WatchSource:0}: Error finding container 8d96e49b42ecdd1b095897bfe0431823c8c4a9b69471a50d1fd7b5c0a3d530b9: Status 404 returned error can't find the container with id 8d96e49b42ecdd1b095897bfe0431823c8c4a9b69471a50d1fd7b5c0a3d530b9
Jul 29 09:41:28.104931 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:28.104896    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz" event={"ID":"aee99bad-542d-47aa-aed0-aa8977f0ebbb","Type":"ContainerStarted","Data":"0a2ec02e766b3c1c152721c75f6e5f25b97f1bf0142f69b12717699a5089ddda"}
Jul 29 09:41:28.105119 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:28.104947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz" event={"ID":"aee99bad-542d-47aa-aed0-aa8977f0ebbb","Type":"ContainerStarted","Data":"8d96e49b42ecdd1b095897bfe0431823c8c4a9b69471a50d1fd7b5c0a3d530b9"}
Jul 29 09:41:28.105119 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:28.105038    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:28.121646 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:28.121601    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz" podStartSLOduration=2.121586568 podStartE2EDuration="2.121586568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:41:28.121170712 +0000 UTC m=+3236.892440776" watchObservedRunningTime="2026-07-29 09:41:28.121586568 +0000 UTC m=+3236.892856633"
Jul 29 09:41:39.112229 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:39.112197    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:39.180352 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:39.180319    2564 generic.go:356] "Generic (PLEG): container finished" podID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerID="91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c" exitCode=0
Jul 29 09:41:39.180548 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:39.180391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" event={"ID":"e8e97828-4a38-4f60-a9b7-df90e6b2a91a","Type":"ContainerDied","Data":"91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c"}
Jul 29 09:41:39.180906 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:39.180887    2564 scope.go:117] "RemoveContainer" containerID="91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c"
Jul 29 09:41:39.182114 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:39.182070    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:41:39.182198 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:39.182148    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:41:39.182198 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:39.182191    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 09:41:40.090695 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:40.090657    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:40.187457 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:40.187421    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" event={"ID":"e8e97828-4a38-4f60-a9b7-df90e6b2a91a","Type":"ContainerStarted","Data":"bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846"}
Jul 29 09:41:40.477076 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:40.477038    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:40.478275 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:40.478252    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 29 09:41:40.478344 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:40.478300    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 29 09:41:41.477336 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:41.477298    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 29 09:41:41.477761 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:41.477354    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 29 09:41:42.476889 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:42.476854    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 29 09:41:42.477085 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:42.476908    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 29 09:41:43.477082 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:43.477050    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 29 09:41:43.477458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:43.477102    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 29 09:41:44.480813 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:44.480779    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:44.481201 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:44.481079    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:44.481812 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:44.481793    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:41:51.012509 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:51.012472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:57.045271 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.045227    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"]
Jul 29 09:41:57.045920 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.045479    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz" podUID="aee99bad-542d-47aa-aed0-aa8977f0ebbb" containerName="payload-processing" containerID="cri-o://0a2ec02e766b3c1c152721c75f6e5f25b97f1bf0142f69b12717699a5089ddda" gracePeriod=30
Jul 29 09:41:57.046132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.046085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:57.147318 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.147288    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:57.232623 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.229439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:57.287063 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.287014    2564 generic.go:356] "Generic (PLEG): container finished" podID="aee99bad-542d-47aa-aed0-aa8977f0ebbb" containerID="0a2ec02e766b3c1c152721c75f6e5f25b97f1bf0142f69b12717699a5089ddda" exitCode=0
Jul 29 09:41:57.287241 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.287102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz" event={"ID":"aee99bad-542d-47aa-aed0-aa8977f0ebbb","Type":"ContainerDied","Data":"0a2ec02e766b3c1c152721c75f6e5f25b97f1bf0142f69b12717699a5089ddda"}
Jul 29 09:41:57.320198 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.320174    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:57.402327 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.402296    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee99bad-542d-47aa-aed0-aa8977f0ebbb-plugins-config-volume\") pod \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\" (UID: \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\") "
Jul 29 09:41:57.402496 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.402351    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n84rq\" (UniqueName: \"kubernetes.io/projected/aee99bad-542d-47aa-aed0-aa8977f0ebbb-kube-api-access-n84rq\") pod \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\" (UID: \"aee99bad-542d-47aa-aed0-aa8977f0ebbb\") "
Jul 29 09:41:57.402655 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.402629    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aee99bad-542d-47aa-aed0-aa8977f0ebbb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aee99bad-542d-47aa-aed0-aa8977f0ebbb" (UID: "aee99bad-542d-47aa-aed0-aa8977f0ebbb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:41:57.404317 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.404295    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee99bad-542d-47aa-aed0-aa8977f0ebbb-kube-api-access-n84rq" (OuterVolumeSpecName: "kube-api-access-n84rq") pod "aee99bad-542d-47aa-aed0-aa8977f0ebbb" (UID: "aee99bad-542d-47aa-aed0-aa8977f0ebbb"). InnerVolumeSpecName "kube-api-access-n84rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:41:57.503099 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.503070    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee99bad-542d-47aa-aed0-aa8977f0ebbb-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:41:57.503099 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.503096    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n84rq\" (UniqueName: \"kubernetes.io/projected/aee99bad-542d-47aa-aed0-aa8977f0ebbb-kube-api-access-n84rq\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:41:57.563067 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:57.562978    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:41:58.294066 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:58.294039    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"
Jul 29 09:41:58.294066 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:58.294061    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz" event={"ID":"aee99bad-542d-47aa-aed0-aa8977f0ebbb","Type":"ContainerDied","Data":"8d96e49b42ecdd1b095897bfe0431823c8c4a9b69471a50d1fd7b5c0a3d530b9"}
Jul 29 09:41:58.294538 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:58.294115    2564 scope.go:117] "RemoveContainer" containerID="0a2ec02e766b3c1c152721c75f6e5f25b97f1bf0142f69b12717699a5089ddda"
Jul 29 09:41:58.309431 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:58.309407    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"]
Jul 29 09:41:58.312818 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:58.312800    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-82acc2-59f7fb46fd-65kbz"]
Jul 29 09:41:59.761971 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:41:59.761941    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aee99bad-542d-47aa-aed0-aa8977f0ebbb" path="/var/lib/kubelet/pods/aee99bad-542d-47aa-aed0-aa8977f0ebbb/volumes"
Jul 29 09:42:03.384091 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:03.384048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:03.484794 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:03.484757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:03.622952 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:03.622911    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"]
Jul 29 09:42:03.623184 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:03.623161    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy" containerID="cri-o://bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846" gracePeriod=30
Jul 29 09:42:03.724837 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:03.724747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:03.897367 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:03.897333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:08.890577 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:08.890517    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:42:09.018902 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.018864    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-podinfo\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.018902 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.018908    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-credential-socket\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.019122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.018941    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-envoy\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.019122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.018970    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-socket\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.019122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.019021    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-certs\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.019122 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.019105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-token\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.019306 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.019171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj2wt\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-kube-api-access-qj2wt\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.019306 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.019216    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istiod-ca-cert\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.019306 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.019242    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:42:09.019306 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.019257    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-data\") pod \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\" (UID: \"e8e97828-4a38-4f60-a9b7-df90e6b2a91a\") "
Jul 29 09:42:09.019508 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.019316    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:42:09.019508 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.019411    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:42:09.020303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.020103    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:42:09.020303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.020229    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.020303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.020253    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.020303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.020260    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:42:09.020303 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.020279    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.021637 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.021602    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:42:09.021827 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.021670    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:42:09.022353 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.022257    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-kube-api-access-qj2wt" (OuterVolumeSpecName: "kube-api-access-qj2wt") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "kube-api-access-qj2wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:42:09.028496 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.028466    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8e97828-4a38-4f60-a9b7-df90e6b2a91a" (UID: "e8e97828-4a38-4f60-a9b7-df90e6b2a91a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:42:09.121519 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.121486    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj2wt\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-kube-api-access-qj2wt\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.121519 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.121515    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.121519 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.121524    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.121782 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.121532    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.121782 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.121540    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.121782 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.121548    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e97828-4a38-4f60-a9b7-df90e6b2a91a-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:09.349865 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.349776    2564 generic.go:356] "Generic (PLEG): container finished" podID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerID="bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846" exitCode=0
Jul 29 09:42:09.349865 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.349839    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"
Jul 29 09:42:09.350046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.349862    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" event={"ID":"e8e97828-4a38-4f60-a9b7-df90e6b2a91a","Type":"ContainerDied","Data":"bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846"}
Jul 29 09:42:09.350046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.349961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v" event={"ID":"e8e97828-4a38-4f60-a9b7-df90e6b2a91a","Type":"ContainerDied","Data":"9125a7241470f6b762e08f2fa40bb9b0e6b6f918b94207c45431dd19e002ce4e"}
Jul 29 09:42:09.350046 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.349993    2564 scope.go:117] "RemoveContainer" containerID="bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846"
Jul 29 09:42:09.359437 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.359417    2564 scope.go:117] "RemoveContainer" containerID="91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c"
Jul 29 09:42:09.367154 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.367136    2564 scope.go:117] "RemoveContainer" containerID="bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846"
Jul 29 09:42:09.367389 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:42:09.367371    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846\": container with ID starting with bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846 not found: ID does not exist" containerID="bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846"
Jul 29 09:42:09.367436 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.367398    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846"} err="failed to get container status \"bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846\": rpc error: code = NotFound desc = could not find container \"bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846\": container with ID starting with bb7b0ab2927b4221c04c62eb6d119bfa954c4cc6655dd817eeb46d7649f79846 not found: ID does not exist"
Jul 29 09:42:09.367436 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.367415    2564 scope.go:117] "RemoveContainer" containerID="91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c"
Jul 29 09:42:09.367633 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:42:09.367617    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c\": container with ID starting with 91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c not found: ID does not exist" containerID="91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c"
Jul 29 09:42:09.367668 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.367637    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c"} err="failed to get container status \"91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c\": rpc error: code = NotFound desc = could not find container \"91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c\": container with ID starting with 91e431960fe6727dd65c90c9e4d9ad22586e257283909df8caadc6e664f2d32c not found: ID does not exist"
Jul 29 09:42:09.377148 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.377122    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"]
Jul 29 09:42:09.379146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.379125    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-82acc2-openshift-default-6f57f7c8b6-8ds8v"]
Jul 29 09:42:09.761036 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:09.761003    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" path="/var/lib/kubelet/pods/e8e97828-4a38-4f60-a9b7-df90e6b2a91a/volumes"
Jul 29 09:42:22.626363 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.626325    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"]
Jul 29 09:42:22.626818 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.626615    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2" podUID="a148410e-df75-4bb1-911f-899fdaa9d262" containerName="maas-api" containerID="cri-o://b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053" gracePeriod=30
Jul 29 09:42:22.654946 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.654914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:22.731342 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.731306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:22.801963 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.801929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:22.865806 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.865497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:22.893627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.893553    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:42:22.950818 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.950776    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls\") pod \"a148410e-df75-4bb1-911f-899fdaa9d262\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") "
Jul 29 09:42:22.951025 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.950845    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp7hc\" (UniqueName: \"kubernetes.io/projected/a148410e-df75-4bb1-911f-899fdaa9d262-kube-api-access-qp7hc\") pod \"a148410e-df75-4bb1-911f-899fdaa9d262\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") "
Jul 29 09:42:22.951025 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.950940    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a148410e-df75-4bb1-911f-899fdaa9d262-openshift-service-ca\") pod \"a148410e-df75-4bb1-911f-899fdaa9d262\" (UID: \"a148410e-df75-4bb1-911f-899fdaa9d262\") "
Jul 29 09:42:22.951347 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.951306    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a148410e-df75-4bb1-911f-899fdaa9d262-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a148410e-df75-4bb1-911f-899fdaa9d262" (UID: "a148410e-df75-4bb1-911f-899fdaa9d262"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:42:22.952999 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.952968    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a148410e-df75-4bb1-911f-899fdaa9d262" (UID: "a148410e-df75-4bb1-911f-899fdaa9d262"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:42:22.953135 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:22.953086    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a148410e-df75-4bb1-911f-899fdaa9d262-kube-api-access-qp7hc" (OuterVolumeSpecName: "kube-api-access-qp7hc") pod "a148410e-df75-4bb1-911f-899fdaa9d262" (UID: "a148410e-df75-4bb1-911f-899fdaa9d262"). InnerVolumeSpecName "kube-api-access-qp7hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:42:23.052724 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.052671    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a148410e-df75-4bb1-911f-899fdaa9d262-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:23.052724 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.052702    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a148410e-df75-4bb1-911f-899fdaa9d262-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:23.052724 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.052723    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp7hc\" (UniqueName: \"kubernetes.io/projected/a148410e-df75-4bb1-911f-899fdaa9d262-kube-api-access-qp7hc\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:42:23.216509 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.216418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:42:23.421662 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.421625    2564 generic.go:356] "Generic (PLEG): container finished" podID="a148410e-df75-4bb1-911f-899fdaa9d262" containerID="b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053" exitCode=0
Jul 29 09:42:23.421883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.421674    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"
Jul 29 09:42:23.421883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.421709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2" event={"ID":"a148410e-df75-4bb1-911f-899fdaa9d262","Type":"ContainerDied","Data":"b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053"}
Jul 29 09:42:23.421883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.421792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2" event={"ID":"a148410e-df75-4bb1-911f-899fdaa9d262","Type":"ContainerDied","Data":"ff09085cb3093d7c80c0e85c959d77c428017582fe0b1d581008b6278d7a1eb0"}
Jul 29 09:42:23.421883 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.421816    2564 scope.go:117] "RemoveContainer" containerID="b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053"
Jul 29 09:42:23.430746 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.430704    2564 scope.go:117] "RemoveContainer" containerID="b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053"
Jul 29 09:42:23.431022 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:42:23.431003    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053\": container with ID starting with b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053 not found: ID does not exist" containerID="b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053"
Jul 29 09:42:23.431066 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.431029    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053"} err="failed to get container status \"b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053\": rpc error: code = NotFound desc = could not find container \"b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053\": container with ID starting with b4148a1a159a6412a06e217cf2819a997343bc3f70e99b690da41415d3339053 not found: ID does not exist"
Jul 29 09:42:23.450553 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.450525    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"]
Jul 29 09:42:23.457236 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.457213    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b9d569-5d44bd5785-8z2c2"]
Jul 29 09:42:23.761336 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:23.761302    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a148410e-df75-4bb1-911f-899fdaa9d262" path="/var/lib/kubelet/pods/a148410e-df75-4bb1-911f-899fdaa9d262/volumes"
Jul 29 09:42:28.292413 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:42:28.292372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:04.446112 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:04.446027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:05.807115 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:05.807081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:11.876462 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:11.876421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:18.950551 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:18.950514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:25.600030 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:25.599992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:25.677480 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:25.677451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:25.871301 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:25.871219    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"]
Jul 29 09:43:25.871524 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:25.871495    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy" containerID="cri-o://8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b" gracePeriod=30
Jul 29 09:43:25.890096 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:25.890067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:26.116858 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:26.116827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:31.125462 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.125438    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:43:31.186486 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186405    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkb5v\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-kube-api-access-lkb5v\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186486 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186481    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-credential-socket\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186681 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186506    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-envoy\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186681 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186581    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-data\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186681 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186627    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1566122-9b40-42f5-8c82-e94d1823bacf-istiod-ca-cert\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186681 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186661    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-token\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186740    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-podinfo\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186772    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-certs\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186820    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-socket\") pod \"c1566122-9b40-42f5-8c82-e94d1823bacf\" (UID: \"c1566122-9b40-42f5-8c82-e94d1823bacf\") "
Jul 29 09:43:31.186915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.186853    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:31.187116 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.187087    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:31.187190 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.187172    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.187244 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.187196    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.187359 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.187324    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:31.187459 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.187431    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1566122-9b40-42f5-8c82-e94d1823bacf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:43:31.187643 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.187617    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:31.188778 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.188754    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:43:31.188778 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.188762    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-kube-api-access-lkb5v" (OuterVolumeSpecName: "kube-api-access-lkb5v") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "kube-api-access-lkb5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:31.189170 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.189144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:43:31.189277 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.189234    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1566122-9b40-42f5-8c82-e94d1823bacf" (UID: "c1566122-9b40-42f5-8c82-e94d1823bacf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:31.288161 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.288127    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.288161 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.288155    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkb5v\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-kube-api-access-lkb5v\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.288161 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.288165    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.288393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.288173    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.288393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.288181    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1566122-9b40-42f5-8c82-e94d1823bacf-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.288393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.288189    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.288393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.288196    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1566122-9b40-42f5-8c82-e94d1823bacf-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:31.753965 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.753931    2564 generic.go:356] "Generic (PLEG): container finished" podID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerID="8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b" exitCode=0
Jul 29 09:43:31.754179 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.753974    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"
Jul 29 09:43:31.754179 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.753998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" event={"ID":"c1566122-9b40-42f5-8c82-e94d1823bacf","Type":"ContainerDied","Data":"8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b"}
Jul 29 09:43:31.754179 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.754077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk" event={"ID":"c1566122-9b40-42f5-8c82-e94d1823bacf","Type":"ContainerDied","Data":"ea41d8e95eafa5179f08749428c74bf2666d26612c742944d1e5886d933610ae"}
Jul 29 09:43:31.754179 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.754109    2564 scope.go:117] "RemoveContainer" containerID="8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b"
Jul 29 09:43:31.766689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.766672    2564 scope.go:117] "RemoveContainer" containerID="d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe"
Jul 29 09:43:31.775182 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.775156    2564 scope.go:117] "RemoveContainer" containerID="8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b"
Jul 29 09:43:31.775468 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:43:31.775445    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b\": container with ID starting with 8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b not found: ID does not exist" containerID="8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b"
Jul 29 09:43:31.775571 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.775473    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b"} err="failed to get container status \"8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b\": rpc error: code = NotFound desc = could not find container \"8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b\": container with ID starting with 8e2ea0a7c150b60d93d0f67566d5556e82d80dda336d7d2617b8f7db4d55c05b not found: ID does not exist"
Jul 29 09:43:31.775571 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.775491    2564 scope.go:117] "RemoveContainer" containerID="d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe"
Jul 29 09:43:31.775771 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:43:31.775750    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe\": container with ID starting with d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe not found: ID does not exist" containerID="d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe"
Jul 29 09:43:31.775824 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.775776    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe"} err="failed to get container status \"d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe\": rpc error: code = NotFound desc = could not find container \"d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe\": container with ID starting with d3fb62a7d8ad06f6548b5fba57cbd202534b699a0b6cfb1c931717c49e234afe not found: ID does not exist"
Jul 29 09:43:31.779680 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.779660    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"]
Jul 29 09:43:31.783331 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:31.783311    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b9d569-openshift-default-77b7fbdbd4-ssgpk"]
Jul 29 09:43:33.762151 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:33.762115    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" path="/var/lib/kubelet/pods/c1566122-9b40-42f5-8c82-e94d1823bacf/volumes"
Jul 29 09:43:36.792701 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:36.792667    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"]
Jul 29 09:43:36.793227 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:36.792890    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z" podUID="4a1c643f-faa4-41a0-8159-6bf32bc2174e" containerName="maas-api" containerID="cri-o://9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91" gracePeriod=30
Jul 29 09:43:36.838661 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:36.838634    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:36.893515 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:36.893484    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"]
Jul 29 09:43:36.893774 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:36.893747    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76" podUID="da817b21-7785-4aae-b573-e28550f78082" containerName="payload-pre-processing" containerID="cri-o://5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556" gracePeriod=30
Jul 29 09:43:36.934278 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:36.934245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:37.033586 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.033510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:37.084317 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.084025    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:43:37.097142 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.097063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:37.161308 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.161286    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:43:37.249673 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.249640    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls\") pod \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") "
Jul 29 09:43:37.249867 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.249694    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c643f-faa4-41a0-8159-6bf32bc2174e-openshift-service-ca\") pod \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") "
Jul 29 09:43:37.249867 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.249781    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da817b21-7785-4aae-b573-e28550f78082-plugins-config-volume\") pod \"da817b21-7785-4aae-b573-e28550f78082\" (UID: \"da817b21-7785-4aae-b573-e28550f78082\") "
Jul 29 09:43:37.249867 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.249823    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bmc7\" (UniqueName: \"kubernetes.io/projected/da817b21-7785-4aae-b573-e28550f78082-kube-api-access-7bmc7\") pod \"da817b21-7785-4aae-b573-e28550f78082\" (UID: \"da817b21-7785-4aae-b573-e28550f78082\") "
Jul 29 09:43:37.250052 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.249888    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs6zb\" (UniqueName: \"kubernetes.io/projected/4a1c643f-faa4-41a0-8159-6bf32bc2174e-kube-api-access-vs6zb\") pod \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\" (UID: \"4a1c643f-faa4-41a0-8159-6bf32bc2174e\") "
Jul 29 09:43:37.250175 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.250145    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da817b21-7785-4aae-b573-e28550f78082-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da817b21-7785-4aae-b573-e28550f78082" (UID: "da817b21-7785-4aae-b573-e28550f78082"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:43:37.250242 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.250160    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a1c643f-faa4-41a0-8159-6bf32bc2174e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4a1c643f-faa4-41a0-8159-6bf32bc2174e" (UID: "4a1c643f-faa4-41a0-8159-6bf32bc2174e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:43:37.252015 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.251986    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4a1c643f-faa4-41a0-8159-6bf32bc2174e" (UID: "4a1c643f-faa4-41a0-8159-6bf32bc2174e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:43:37.252109 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.252022    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da817b21-7785-4aae-b573-e28550f78082-kube-api-access-7bmc7" (OuterVolumeSpecName: "kube-api-access-7bmc7") pod "da817b21-7785-4aae-b573-e28550f78082" (UID: "da817b21-7785-4aae-b573-e28550f78082"). InnerVolumeSpecName "kube-api-access-7bmc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:37.252109 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.252053    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a1c643f-faa4-41a0-8159-6bf32bc2174e-kube-api-access-vs6zb" (OuterVolumeSpecName: "kube-api-access-vs6zb") pod "4a1c643f-faa4-41a0-8159-6bf32bc2174e" (UID: "4a1c643f-faa4-41a0-8159-6bf32bc2174e"). InnerVolumeSpecName "kube-api-access-vs6zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:37.351710 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.351621    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs6zb\" (UniqueName: \"kubernetes.io/projected/4a1c643f-faa4-41a0-8159-6bf32bc2174e-kube-api-access-vs6zb\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:37.351710 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.351652    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1c643f-faa4-41a0-8159-6bf32bc2174e-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:37.351710 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.351663    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1c643f-faa4-41a0-8159-6bf32bc2174e-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:37.351710 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.351672    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da817b21-7785-4aae-b573-e28550f78082-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:37.351710 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.351681    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bmc7\" (UniqueName: \"kubernetes.io/projected/da817b21-7785-4aae-b573-e28550f78082-kube-api-access-7bmc7\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:37.438989 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.438957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:37.782236 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.782203    2564 generic.go:356] "Generic (PLEG): container finished" podID="da817b21-7785-4aae-b573-e28550f78082" containerID="5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556" exitCode=0
Jul 29 09:43:37.782372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.782248    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"
Jul 29 09:43:37.782372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.782277    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76" event={"ID":"da817b21-7785-4aae-b573-e28550f78082","Type":"ContainerDied","Data":"5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556"}
Jul 29 09:43:37.782372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.782339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76" event={"ID":"da817b21-7785-4aae-b573-e28550f78082","Type":"ContainerDied","Data":"f49001ab92782d9d49e9e6e5f3117ffc04f80a621c6a7d4426f272bf83533e73"}
Jul 29 09:43:37.782372 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.782371    2564 scope.go:117] "RemoveContainer" containerID="5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556"
Jul 29 09:43:37.783587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.783567    2564 generic.go:356] "Generic (PLEG): container finished" podID="4a1c643f-faa4-41a0-8159-6bf32bc2174e" containerID="9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91" exitCode=0
Jul 29 09:43:37.783673 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.783597    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"
Jul 29 09:43:37.783673 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.783645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z" event={"ID":"4a1c643f-faa4-41a0-8159-6bf32bc2174e","Type":"ContainerDied","Data":"9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91"}
Jul 29 09:43:37.783787 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.783680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z" event={"ID":"4a1c643f-faa4-41a0-8159-6bf32bc2174e","Type":"ContainerDied","Data":"87bfbc0d9ecee42f1dbb466d41f00bcf52502b0a5dc9d16967fe44d5a0e5ae76"}
Jul 29 09:43:37.791313 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.791292    2564 scope.go:117] "RemoveContainer" containerID="5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556"
Jul 29 09:43:37.791562 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:43:37.791541    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556\": container with ID starting with 5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556 not found: ID does not exist" containerID="5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556"
Jul 29 09:43:37.791611 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.791572    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556"} err="failed to get container status \"5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556\": rpc error: code = NotFound desc = could not find container \"5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556\": container with ID starting with 5144ac47b9ac9f37cfac70ec61c1c188ddd41add9e0233c4730585948793d556 not found: ID does not exist"
Jul 29 09:43:37.791611 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.791595    2564 scope.go:117] "RemoveContainer" containerID="9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91"
Jul 29 09:43:37.799571 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.799377    2564 scope.go:117] "RemoveContainer" containerID="9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91"
Jul 29 09:43:37.800036 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:43:37.799820    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91\": container with ID starting with 9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91 not found: ID does not exist" containerID="9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91"
Jul 29 09:43:37.800036 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.799853    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91"} err="failed to get container status \"9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91\": rpc error: code = NotFound desc = could not find container \"9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91\": container with ID starting with 9241f648832838053b53964c454a9b9549505dbf836456157cb63b4aecfd2e91 not found: ID does not exist"
Jul 29 09:43:37.801745 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.801709    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"]
Jul 29 09:43:37.809104 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.809086    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-150c68-7fbbcf8764-g246z"]
Jul 29 09:43:37.819102 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.819078    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"]
Jul 29 09:43:37.823077 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:37.823046    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-150c68-9c8b7dbdd-d9d76"]
Jul 29 09:43:39.761827 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:39.761795    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a1c643f-faa4-41a0-8159-6bf32bc2174e" path="/var/lib/kubelet/pods/4a1c643f-faa4-41a0-8159-6bf32bc2174e/volumes"
Jul 29 09:43:39.762209 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:39.762154    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da817b21-7785-4aae-b573-e28550f78082" path="/var/lib/kubelet/pods/da817b21-7785-4aae-b573-e28550f78082/volumes"
Jul 29 09:43:43.180985 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.180946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:43.244464 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.244433    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:43.441736 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.441631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:43.670943 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.670910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:43.811874 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.811791    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"]
Jul 29 09:43:43.812127 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812114    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aee99bad-542d-47aa-aed0-aa8977f0ebbb" containerName="payload-processing"
Jul 29 09:43:43.812187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812128    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aee99bad-542d-47aa-aed0-aa8977f0ebbb" containerName="payload-processing"
Jul 29 09:43:43.812187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812139    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy"
Jul 29 09:43:43.812187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812147    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy"
Jul 29 09:43:43.812187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812163    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy"
Jul 29 09:43:43.812187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812171    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy"
Jul 29 09:43:43.812187 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812185    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a148410e-df75-4bb1-911f-899fdaa9d262" containerName="maas-api"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812191    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a148410e-df75-4bb1-911f-899fdaa9d262" containerName="maas-api"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812202    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1c643f-faa4-41a0-8159-6bf32bc2174e" containerName="maas-api"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812207    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1c643f-faa4-41a0-8159-6bf32bc2174e" containerName="maas-api"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812214    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da817b21-7785-4aae-b573-e28550f78082" containerName="payload-pre-processing"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812219    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="da817b21-7785-4aae-b573-e28550f78082" containerName="payload-pre-processing"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812227    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812235    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812311    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a148410e-df75-4bb1-911f-899fdaa9d262" containerName="maas-api"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812321    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812329    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812336    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1566122-9b40-42f5-8c82-e94d1823bacf" containerName="istio-proxy"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812341    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812348    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aee99bad-542d-47aa-aed0-aa8977f0ebbb" containerName="payload-processing"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812353    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1c643f-faa4-41a0-8159-6bf32bc2174e" containerName="maas-api"
Jul 29 09:43:43.812458 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.812358    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="da817b21-7785-4aae-b573-e28550f78082" containerName="payload-pre-processing"
Jul 29 09:43:43.816460 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.816441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"
Jul 29 09:43:43.818248 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.818226    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:43:43.821673 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.821651    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"]
Jul 29 09:43:43.911034 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:43.910994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5beddea2-ef73-4d98-bf36-bc0b7cb005f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72\" (UID: \"5beddea2-ef73-4d98-bf36-bc0b7cb005f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"
Jul 29 09:43:44.011617 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:44.011581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5beddea2-ef73-4d98-bf36-bc0b7cb005f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72\" (UID: \"5beddea2-ef73-4d98-bf36-bc0b7cb005f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"
Jul 29 09:43:44.012222 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:44.012203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5beddea2-ef73-4d98-bf36-bc0b7cb005f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72\" (UID: \"5beddea2-ef73-4d98-bf36-bc0b7cb005f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"
Jul 29 09:43:44.128140 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:44.128110    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"
Jul 29 09:43:44.257261 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:44.257230    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"]
Jul 29 09:43:44.259531 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:43:44.259505    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5beddea2_ef73_4d98_bf36_bc0b7cb005f1.slice/crio-e2d1cfbabf464051491971c52afd68976590278ad313df6d69094f90366f2100 WatchSource:0}: Error finding container e2d1cfbabf464051491971c52afd68976590278ad313df6d69094f90366f2100: Status 404 returned error can't find the container with id e2d1cfbabf464051491971c52afd68976590278ad313df6d69094f90366f2100
Jul 29 09:43:44.822746 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:44.822615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72" event={"ID":"5beddea2-ef73-4d98-bf36-bc0b7cb005f1","Type":"ContainerStarted","Data":"082ac7fcc31e1fa4a277aa1716ec52322c622d2a8b206271e328d5f3b39c7072"}
Jul 29 09:43:44.822746 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:44.822692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72" event={"ID":"5beddea2-ef73-4d98-bf36-bc0b7cb005f1","Type":"ContainerStarted","Data":"e2d1cfbabf464051491971c52afd68976590278ad313df6d69094f90366f2100"}
Jul 29 09:43:44.838199 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:44.838145    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72" podStartSLOduration=1.8381277520000001 podStartE2EDuration="1.838127752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:43:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:43:44.83632947 +0000 UTC m=+3373.607599534" watchObservedRunningTime="2026-07-29 09:43:44.838127752 +0000 UTC m=+3373.609397816"
Jul 29 09:43:45.828984 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:45.828955    2564 generic.go:356] "Generic (PLEG): container finished" podID="5beddea2-ef73-4d98-bf36-bc0b7cb005f1" containerID="082ac7fcc31e1fa4a277aa1716ec52322c622d2a8b206271e328d5f3b39c7072" exitCode=0
Jul 29 09:43:45.829394 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:45.829013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72" event={"ID":"5beddea2-ef73-4d98-bf36-bc0b7cb005f1","Type":"ContainerDied","Data":"082ac7fcc31e1fa4a277aa1716ec52322c622d2a8b206271e328d5f3b39c7072"}
Jul 29 09:43:46.965422 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:46.965398    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"
Jul 29 09:43:47.140556 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:47.140522    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5beddea2-ef73-4d98-bf36-bc0b7cb005f1-maas-api-service-ca\") pod \"5beddea2-ef73-4d98-bf36-bc0b7cb005f1\" (UID: \"5beddea2-ef73-4d98-bf36-bc0b7cb005f1\") "
Jul 29 09:43:47.140959 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:47.140932    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5beddea2-ef73-4d98-bf36-bc0b7cb005f1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5beddea2-ef73-4d98-bf36-bc0b7cb005f1" (UID: "5beddea2-ef73-4d98-bf36-bc0b7cb005f1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:43:47.242090 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:47.242055    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5beddea2-ef73-4d98-bf36-bc0b7cb005f1-maas-api-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:47.839731 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:47.839684    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"
Jul 29 09:43:47.839731 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:47.839692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72" event={"ID":"5beddea2-ef73-4d98-bf36-bc0b7cb005f1","Type":"ContainerDied","Data":"e2d1cfbabf464051491971c52afd68976590278ad313df6d69094f90366f2100"}
Jul 29 09:43:47.839989 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:47.839762    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2d1cfbabf464051491971c52afd68976590278ad313df6d69094f90366f2100"
Jul 29 09:43:54.381473 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.381441    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"]
Jul 29 09:43:54.381890 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.381648    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9" podUID="672e2b88-f7fb-468c-bb4c-79528c3de67f" containerName="maas-api" containerID="cri-o://4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0" gracePeriod=30
Jul 29 09:43:54.424660 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.424624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:54.424915 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.424896    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"]
Jul 29 09:43:54.429241 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.429221    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0abb48-29755290-mzcpg"]
Jul 29 09:43:54.453470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.453444    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"]
Jul 29 09:43:54.453691 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.453669    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx" podUID="bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5" containerName="payload-processing" containerID="cri-o://d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3" gracePeriod=30
Jul 29 09:43:54.461512 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.461331    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"]
Jul 29 09:43:54.462003 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.461927    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t" podUID="147ffe14-e5cb-4a2b-913b-d9e1ff084888" containerName="payload-pre-processing" containerID="cri-o://f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278" gracePeriod=30
Jul 29 09:43:54.523202 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.523168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:54.606591 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.606548    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"]
Jul 29 09:43:54.611444 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.611301    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:54.611965 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.611945    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0abb48-rrg72"]
Jul 29 09:43:54.670092 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.670055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:54.739626 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.739601    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:43:54.749902 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.749882    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:43:54.767489 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.767470    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:43:54.803886 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.803856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147ffe14-e5cb-4a2b-913b-d9e1ff084888-plugins-config-volume\") pod \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\" (UID: \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\") "
Jul 29 09:43:54.804072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.803896    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672e2b88-f7fb-468c-bb4c-79528c3de67f-maas-api-tls\") pod \"672e2b88-f7fb-468c-bb4c-79528c3de67f\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") "
Jul 29 09:43:54.804072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.803917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-684vp\" (UniqueName: \"kubernetes.io/projected/672e2b88-f7fb-468c-bb4c-79528c3de67f-kube-api-access-684vp\") pod \"672e2b88-f7fb-468c-bb4c-79528c3de67f\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") "
Jul 29 09:43:54.804072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.803974    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-plugins-config-volume\") pod \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\" (UID: \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\") "
Jul 29 09:43:54.804072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.804038    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbvjz\" (UniqueName: \"kubernetes.io/projected/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-kube-api-access-pbvjz\") pod \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\" (UID: \"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5\") "
Jul 29 09:43:54.804297 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.804084    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672e2b88-f7fb-468c-bb4c-79528c3de67f-openshift-service-ca\") pod \"672e2b88-f7fb-468c-bb4c-79528c3de67f\" (UID: \"672e2b88-f7fb-468c-bb4c-79528c3de67f\") "
Jul 29 09:43:54.804297 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.804132    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm5zj\" (UniqueName: \"kubernetes.io/projected/147ffe14-e5cb-4a2b-913b-d9e1ff084888-kube-api-access-rm5zj\") pod \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\" (UID: \"147ffe14-e5cb-4a2b-913b-d9e1ff084888\") "
Jul 29 09:43:54.804470 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.804383    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/147ffe14-e5cb-4a2b-913b-d9e1ff084888-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "147ffe14-e5cb-4a2b-913b-d9e1ff084888" (UID: "147ffe14-e5cb-4a2b-913b-d9e1ff084888"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:43:54.804535 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.804516    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147ffe14-e5cb-4a2b-913b-d9e1ff084888-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:54.805163 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.804591    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672e2b88-f7fb-468c-bb4c-79528c3de67f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "672e2b88-f7fb-468c-bb4c-79528c3de67f" (UID: "672e2b88-f7fb-468c-bb4c-79528c3de67f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:43:54.805163 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.805121    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5" (UID: "bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:43:54.806771 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.806707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672e2b88-f7fb-468c-bb4c-79528c3de67f-kube-api-access-684vp" (OuterVolumeSpecName: "kube-api-access-684vp") pod "672e2b88-f7fb-468c-bb4c-79528c3de67f" (UID: "672e2b88-f7fb-468c-bb4c-79528c3de67f"). InnerVolumeSpecName "kube-api-access-684vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:54.806907 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.806879    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/147ffe14-e5cb-4a2b-913b-d9e1ff084888-kube-api-access-rm5zj" (OuterVolumeSpecName: "kube-api-access-rm5zj") pod "147ffe14-e5cb-4a2b-913b-d9e1ff084888" (UID: "147ffe14-e5cb-4a2b-913b-d9e1ff084888"). InnerVolumeSpecName "kube-api-access-rm5zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:54.807082 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.807052    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672e2b88-f7fb-468c-bb4c-79528c3de67f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "672e2b88-f7fb-468c-bb4c-79528c3de67f" (UID: "672e2b88-f7fb-468c-bb4c-79528c3de67f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:43:54.807393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.807375    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-kube-api-access-pbvjz" (OuterVolumeSpecName: "kube-api-access-pbvjz") pod "bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5" (UID: "bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5"). InnerVolumeSpecName "kube-api-access-pbvjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:43:54.879832 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.879791    2564 generic.go:356] "Generic (PLEG): container finished" podID="147ffe14-e5cb-4a2b-913b-d9e1ff084888" containerID="f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278" exitCode=0
Jul 29 09:43:54.880010 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.879856    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"
Jul 29 09:43:54.880010 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.879871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t" event={"ID":"147ffe14-e5cb-4a2b-913b-d9e1ff084888","Type":"ContainerDied","Data":"f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278"}
Jul 29 09:43:54.880010 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.879953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t" event={"ID":"147ffe14-e5cb-4a2b-913b-d9e1ff084888","Type":"ContainerDied","Data":"e6a314aceebdb51eb5b155f19f80b9c292d54c49f67818a47568f254d55b8bec"}
Jul 29 09:43:54.880010 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.879987    2564 scope.go:117] "RemoveContainer" containerID="f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278"
Jul 29 09:43:54.881329 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.881308    2564 generic.go:356] "Generic (PLEG): container finished" podID="bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5" containerID="d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3" exitCode=0
Jul 29 09:43:54.881445 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.881352    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"
Jul 29 09:43:54.881445 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.881393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx" event={"ID":"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5","Type":"ContainerDied","Data":"d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3"}
Jul 29 09:43:54.881445 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.881434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx" event={"ID":"bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5","Type":"ContainerDied","Data":"a4e08fe39dd89fb44b73a50e4ad0c3ccb4bbbc1dc9052c221019a536ed9b0461"}
Jul 29 09:43:54.882665 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.882643    2564 generic.go:356] "Generic (PLEG): container finished" podID="672e2b88-f7fb-468c-bb4c-79528c3de67f" containerID="4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0" exitCode=0
Jul 29 09:43:54.882798 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.882698    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"
Jul 29 09:43:54.882889 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.882700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9" event={"ID":"672e2b88-f7fb-468c-bb4c-79528c3de67f","Type":"ContainerDied","Data":"4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0"}
Jul 29 09:43:54.882976 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.882922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9" event={"ID":"672e2b88-f7fb-468c-bb4c-79528c3de67f","Type":"ContainerDied","Data":"d5c96b135639bbbb110d1abade10c669199caa5e27fc902865f243323e8f98ca"}
Jul 29 09:43:54.890461 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.890443    2564 scope.go:117] "RemoveContainer" containerID="f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278"
Jul 29 09:43:54.890795 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:43:54.890772    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278\": container with ID starting with f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278 not found: ID does not exist" containerID="f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278"
Jul 29 09:43:54.890898 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.890805    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278"} err="failed to get container status \"f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278\": rpc error: code = NotFound desc = could not find container \"f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278\": container with ID starting with f77182fdee2ac34ad54aaaef96f0f088e4e13739a994bc2d99c081167b1c1278 not found: ID does not exist"
Jul 29 09:43:54.890898 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.890827    2564 scope.go:117] "RemoveContainer" containerID="d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3"
Jul 29 09:43:54.901079 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.901059    2564 scope.go:117] "RemoveContainer" containerID="d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3"
Jul 29 09:43:54.901343 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:43:54.901318    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3\": container with ID starting with d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3 not found: ID does not exist" containerID="d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3"
Jul 29 09:43:54.901409 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.901353    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3"} err="failed to get container status \"d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3\": rpc error: code = NotFound desc = could not find container \"d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3\": container with ID starting with d36b5b8d8018abff65abae4c3c15b7f92278f2a405ad567b8c28296b8293a1a3 not found: ID does not exist"
Jul 29 09:43:54.901409 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.901376    2564 scope.go:117] "RemoveContainer" containerID="4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0"
Jul 29 09:43:54.905086 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.905059    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:54.905165 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.905097    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbvjz\" (UniqueName: \"kubernetes.io/projected/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5-kube-api-access-pbvjz\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:54.905165 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.905113    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672e2b88-f7fb-468c-bb4c-79528c3de67f-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:54.905165 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.905126    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm5zj\" (UniqueName: \"kubernetes.io/projected/147ffe14-e5cb-4a2b-913b-d9e1ff084888-kube-api-access-rm5zj\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:54.905165 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.905140    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672e2b88-f7fb-468c-bb4c-79528c3de67f-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:54.905165 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.905153    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-684vp\" (UniqueName: \"kubernetes.io/projected/672e2b88-f7fb-468c-bb4c-79528c3de67f-kube-api-access-684vp\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:43:54.910963 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.910938    2564 scope.go:117] "RemoveContainer" containerID="4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0"
Jul 29 09:43:54.911217 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:43:54.911197    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0\": container with ID starting with 4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0 not found: ID does not exist" containerID="4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0"
Jul 29 09:43:54.911296 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.911222    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0"} err="failed to get container status \"4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0\": rpc error: code = NotFound desc = could not find container \"4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0\": container with ID starting with 4c8e9aaee098d346abf5018151b6a0813fd4214ffacd016786d49bf8cdf61ce0 not found: ID does not exist"
Jul 29 09:43:54.911595 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.911576    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"]
Jul 29 09:43:54.914612 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.914593    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-0abb48-86b4bbf57b-8lj7t"]
Jul 29 09:43:54.924709 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.924688    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"]
Jul 29 09:43:54.929605 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.929584    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0abb48-59f5597cc5-rwvm9"]
Jul 29 09:43:54.941237 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.941216    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"]
Jul 29 09:43:54.948658 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.948633    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-0abb48-c8f7d9d46-vrwrx"]
Jul 29 09:43:54.984547 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:54.984517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:43:55.761375 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:55.761296    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="147ffe14-e5cb-4a2b-913b-d9e1ff084888" path="/var/lib/kubelet/pods/147ffe14-e5cb-4a2b-913b-d9e1ff084888/volumes"
Jul 29 09:43:55.761751 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:55.761620    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5beddea2-ef73-4d98-bf36-bc0b7cb005f1" path="/var/lib/kubelet/pods/5beddea2-ef73-4d98-bf36-bc0b7cb005f1/volumes"
Jul 29 09:43:55.761993 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:55.761979    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672e2b88-f7fb-468c-bb4c-79528c3de67f" path="/var/lib/kubelet/pods/672e2b88-f7fb-468c-bb4c-79528c3de67f/volumes"
Jul 29 09:43:55.762223 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:55.762212    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b564a411-7348-45ea-ba4f-ec3199caa5ba" path="/var/lib/kubelet/pods/b564a411-7348-45ea-ba4f-ec3199caa5ba/volumes"
Jul 29 09:43:55.762815 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:43:55.762801    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5" path="/var/lib/kubelet/pods/bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5/volumes"
Jul 29 09:44:00.946205 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:00.946163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:01.048317 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.048282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:01.189574 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.189534    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"]
Jul 29 09:44:01.189818 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.189793    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy" containerID="cri-o://11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b" gracePeriod=30
Jul 29 09:44:01.209520 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.209425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:01.476651 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.476558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:01.547785 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.547747    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"]
Jul 29 09:44:01.548094 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548082    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5beddea2-ef73-4d98-bf36-bc0b7cb005f1" containerName="revoke-keys"
Jul 29 09:44:01.548135 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548096    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5beddea2-ef73-4d98-bf36-bc0b7cb005f1" containerName="revoke-keys"
Jul 29 09:44:01.548135 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548107    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5" containerName="payload-processing"
Jul 29 09:44:01.548135 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548116    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5" containerName="payload-processing"
Jul 29 09:44:01.548135 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548128    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy"
Jul 29 09:44:01.548135 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548135    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e97828-4a38-4f60-a9b7-df90e6b2a91a" containerName="istio-proxy"
Jul 29 09:44:01.548300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548147    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="147ffe14-e5cb-4a2b-913b-d9e1ff084888" containerName="payload-pre-processing"
Jul 29 09:44:01.548300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548153    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="147ffe14-e5cb-4a2b-913b-d9e1ff084888" containerName="payload-pre-processing"
Jul 29 09:44:01.548300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548163    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672e2b88-f7fb-468c-bb4c-79528c3de67f" containerName="maas-api"
Jul 29 09:44:01.548300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548169    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="672e2b88-f7fb-468c-bb4c-79528c3de67f" containerName="maas-api"
Jul 29 09:44:01.548300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548232    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="147ffe14-e5cb-4a2b-913b-d9e1ff084888" containerName="payload-pre-processing"
Jul 29 09:44:01.548300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548240    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5beddea2-ef73-4d98-bf36-bc0b7cb005f1" containerName="revoke-keys"
Jul 29 09:44:01.548300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548248    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="672e2b88-f7fb-468c-bb4c-79528c3de67f" containerName="maas-api"
Jul 29 09:44:01.548300 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.548255    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd605e60-c4e3-4c4c-9fcf-bbf19cf620a5" containerName="payload-processing"
Jul 29 09:44:01.552839 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.552820    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"
Jul 29 09:44:01.555259 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.555236    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:44:01.559083 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.559055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"]
Jul 29 09:44:01.561123 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.561087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c02f9e6c-e6bb-4126-be32-138b1cca7b8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc\" (UID: \"c02f9e6c-e6bb-4126-be32-138b1cca7b8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"
Jul 29 09:44:01.662521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.662479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c02f9e6c-e6bb-4126-be32-138b1cca7b8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc\" (UID: \"c02f9e6c-e6bb-4126-be32-138b1cca7b8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"
Jul 29 09:44:01.663161 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.663141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c02f9e6c-e6bb-4126-be32-138b1cca7b8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc\" (UID: \"c02f9e6c-e6bb-4126-be32-138b1cca7b8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"
Jul 29 09:44:01.865778 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:01.865688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"
Jul 29 09:44:02.002214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:02.002185    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"]
Jul 29 09:44:02.004671 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:44:02.004646    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02f9e6c_e6bb_4126_be32_138b1cca7b8d.slice/crio-8e8a17837312e98d449f1b6d214e91d296e9208ecc248443fb32af3dacd21d58 WatchSource:0}: Error finding container 8e8a17837312e98d449f1b6d214e91d296e9208ecc248443fb32af3dacd21d58: Status 404 returned error can't find the container with id 8e8a17837312e98d449f1b6d214e91d296e9208ecc248443fb32af3dacd21d58
Jul 29 09:44:02.926754 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:02.926707    2564 generic.go:356] "Generic (PLEG): container finished" podID="c02f9e6c-e6bb-4126-be32-138b1cca7b8d" containerID="72ffc113894a6c6acbb0bfdb63152a45392642bd7458c5074ed02f999480b039" exitCode=0
Jul 29 09:44:02.926951 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:02.926756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc" event={"ID":"c02f9e6c-e6bb-4126-be32-138b1cca7b8d","Type":"ContainerDied","Data":"72ffc113894a6c6acbb0bfdb63152a45392642bd7458c5074ed02f999480b039"}
Jul 29 09:44:02.926951 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:02.926820    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc" event={"ID":"c02f9e6c-e6bb-4126-be32-138b1cca7b8d","Type":"ContainerStarted","Data":"8e8a17837312e98d449f1b6d214e91d296e9208ecc248443fb32af3dacd21d58"}
Jul 29 09:44:04.067806 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:04.067774    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"
Jul 29 09:44:04.081348 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:04.081316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c02f9e6c-e6bb-4126-be32-138b1cca7b8d-maas-api-service-ca\") pod \"c02f9e6c-e6bb-4126-be32-138b1cca7b8d\" (UID: \"c02f9e6c-e6bb-4126-be32-138b1cca7b8d\") "
Jul 29 09:44:04.081675 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:04.081652    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c02f9e6c-e6bb-4126-be32-138b1cca7b8d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c02f9e6c-e6bb-4126-be32-138b1cca7b8d" (UID: "c02f9e6c-e6bb-4126-be32-138b1cca7b8d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:44:04.182687 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:04.182594    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c02f9e6c-e6bb-4126-be32-138b1cca7b8d-maas-api-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:04.938425 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:04.938390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc" event={"ID":"c02f9e6c-e6bb-4126-be32-138b1cca7b8d","Type":"ContainerDied","Data":"8e8a17837312e98d449f1b6d214e91d296e9208ecc248443fb32af3dacd21d58"}
Jul 29 09:44:04.938607 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:04.938440    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e8a17837312e98d449f1b6d214e91d296e9208ecc248443fb32af3dacd21d58"
Jul 29 09:44:04.938607 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:04.938435    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"
Jul 29 09:44:06.432394 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.432370    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:44:06.502321 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502236    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mjjn\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-kube-api-access-8mjjn\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.502321 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502278    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-envoy\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.502321 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502305    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-socket\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.502567 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502353    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/031c76d8-c909-4fb1-976a-350b62d604d6-istiod-ca-cert\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.502567 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502399    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-data\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.502567 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502426    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/031c76d8-c909-4fb1-976a-350b62d604d6-istio-podinfo\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.502567 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502461    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-credential-socket\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.502567 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-istio-token\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.502833 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502677    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:06.502833 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502763    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-certs\") pod \"031c76d8-c909-4fb1-976a-350b62d604d6\" (UID: \"031c76d8-c909-4fb1-976a-350b62d604d6\") "
Jul 29 09:44:06.503011 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.502868    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:06.503120 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.503099    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/031c76d8-c909-4fb1-976a-350b62d604d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:44:06.503182 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.503121    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.503182 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.503146    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.503414 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.503393    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:06.503531 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.503503    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:06.504645 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.504619    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:06.504831 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.504803    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/031c76d8-c909-4fb1-976a-350b62d604d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:44:06.504978 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.504956    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-kube-api-access-8mjjn" (OuterVolumeSpecName: "kube-api-access-8mjjn") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "kube-api-access-8mjjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:44:06.505026 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.505003    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "031c76d8-c909-4fb1-976a-350b62d604d6" (UID: "031c76d8-c909-4fb1-976a-350b62d604d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:44:06.604227 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.604189    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.604227 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.604220    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mjjn\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-kube-api-access-8mjjn\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.604227 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.604231    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.604227 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.604240    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/031c76d8-c909-4fb1-976a-350b62d604d6-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.604497 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.604248    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/031c76d8-c909-4fb1-976a-350b62d604d6-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.604497 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.604256    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/031c76d8-c909-4fb1-976a-350b62d604d6-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.604497 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.604264    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/031c76d8-c909-4fb1-976a-350b62d604d6-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:06.949443 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.949406    2564 generic.go:356] "Generic (PLEG): container finished" podID="031c76d8-c909-4fb1-976a-350b62d604d6" containerID="11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b" exitCode=0
Jul 29 09:44:06.949689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.949440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" event={"ID":"031c76d8-c909-4fb1-976a-350b62d604d6","Type":"ContainerDied","Data":"11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b"}
Jul 29 09:44:06.949689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.949495    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g" event={"ID":"031c76d8-c909-4fb1-976a-350b62d604d6","Type":"ContainerDied","Data":"9d49ab5fcceef4d21916de594613149ca580c2c6e7462ed959a923c59ad7dab1"}
Jul 29 09:44:06.949689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.949517    2564 scope.go:117] "RemoveContainer" containerID="11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b"
Jul 29 09:44:06.949689 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.949457    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"
Jul 29 09:44:06.958521 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.958506    2564 scope.go:117] "RemoveContainer" containerID="2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5"
Jul 29 09:44:06.966072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.966055    2564 scope.go:117] "RemoveContainer" containerID="11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b"
Jul 29 09:44:06.966321 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:44:06.966299    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b\": container with ID starting with 11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b not found: ID does not exist" containerID="11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b"
Jul 29 09:44:06.966377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.966327    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b"} err="failed to get container status \"11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b\": rpc error: code = NotFound desc = could not find container \"11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b\": container with ID starting with 11cad4e044e00ed51e6ba859ac2f27bdbc2791286492507200451c57d149d75b not found: ID does not exist"
Jul 29 09:44:06.966377 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.966344    2564 scope.go:117] "RemoveContainer" containerID="2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5"
Jul 29 09:44:06.966586 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:44:06.966568    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5\": container with ID starting with 2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5 not found: ID does not exist" containerID="2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5"
Jul 29 09:44:06.966627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.966591    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5"} err="failed to get container status \"2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5\": rpc error: code = NotFound desc = could not find container \"2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5\": container with ID starting with 2faf10c4504ba84e32b586b20f4de6cee2efe77bb0d38d4bb9b2df3f7990e7e5 not found: ID does not exist"
Jul 29 09:44:06.969363 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.969343    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"]
Jul 29 09:44:06.971965 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:06.971945    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0abb48-openshift-default-5f945bb56d-qjj6g"]
Jul 29 09:44:07.761960 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:07.761918    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" path="/var/lib/kubelet/pods/031c76d8-c909-4fb1-976a-350b62d604d6/volumes"
Jul 29 09:44:11.296396 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:11.296350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:11.979790 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:11.979757    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"]
Jul 29 09:44:11.980018 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:11.979991    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p" podUID="e2d4a631-79ae-47b0-9b03-2e20371b61ba" containerName="maas-api" containerID="cri-o://59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d" gracePeriod=30
Jul 29 09:44:12.024214 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.024181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:12.072543 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.072507    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"]
Jul 29 09:44:12.072766 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.072728    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj" podUID="a467c79c-89fb-4ee9-b4d7-d69a2f373588" containerName="payload-pre-processing" containerID="cri-o://8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc" gracePeriod=30
Jul 29 09:44:12.109516 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.109482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:12.210002 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.209965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:12.214654 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.214627    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"]
Jul 29 09:44:12.217618 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.217559    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-27430b-xhrxc"]
Jul 29 09:44:12.240034 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.239948    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:44:12.283035 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.283006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:12.341004 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.340981    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:44:12.352472 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.352434    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d4a631-79ae-47b0-9b03-2e20371b61ba-openshift-service-ca\") pod \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") "
Jul 29 09:44:12.352603 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.352564    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgjxf\" (UniqueName: \"kubernetes.io/projected/e2d4a631-79ae-47b0-9b03-2e20371b61ba-kube-api-access-mgjxf\") pod \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") "
Jul 29 09:44:12.352603 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.352597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls\") pod \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\" (UID: \"e2d4a631-79ae-47b0-9b03-2e20371b61ba\") "
Jul 29 09:44:12.352785 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.352764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d4a631-79ae-47b0-9b03-2e20371b61ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e2d4a631-79ae-47b0-9b03-2e20371b61ba" (UID: "e2d4a631-79ae-47b0-9b03-2e20371b61ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:44:12.352878 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.352863    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d4a631-79ae-47b0-9b03-2e20371b61ba-openshift-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:12.354839 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.354813    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e2d4a631-79ae-47b0-9b03-2e20371b61ba" (UID: "e2d4a631-79ae-47b0-9b03-2e20371b61ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 09:44:12.354955 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.354879    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d4a631-79ae-47b0-9b03-2e20371b61ba-kube-api-access-mgjxf" (OuterVolumeSpecName: "kube-api-access-mgjxf") pod "e2d4a631-79ae-47b0-9b03-2e20371b61ba" (UID: "e2d4a631-79ae-47b0-9b03-2e20371b61ba"). InnerVolumeSpecName "kube-api-access-mgjxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:44:12.454035 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.454001    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d27g2\" (UniqueName: \"kubernetes.io/projected/a467c79c-89fb-4ee9-b4d7-d69a2f373588-kube-api-access-d27g2\") pod \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\" (UID: \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\") "
Jul 29 09:44:12.454035 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.454038    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a467c79c-89fb-4ee9-b4d7-d69a2f373588-plugins-config-volume\") pod \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\" (UID: \"a467c79c-89fb-4ee9-b4d7-d69a2f373588\") "
Jul 29 09:44:12.454266 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.454194    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgjxf\" (UniqueName: \"kubernetes.io/projected/e2d4a631-79ae-47b0-9b03-2e20371b61ba-kube-api-access-mgjxf\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:12.454266 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.454206    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2d4a631-79ae-47b0-9b03-2e20371b61ba-maas-api-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:12.454474 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.454443    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a467c79c-89fb-4ee9-b4d7-d69a2f373588-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a467c79c-89fb-4ee9-b4d7-d69a2f373588" (UID: "a467c79c-89fb-4ee9-b4d7-d69a2f373588"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:44:12.456132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.456109    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a467c79c-89fb-4ee9-b4d7-d69a2f373588-kube-api-access-d27g2" (OuterVolumeSpecName: "kube-api-access-d27g2") pod "a467c79c-89fb-4ee9-b4d7-d69a2f373588" (UID: "a467c79c-89fb-4ee9-b4d7-d69a2f373588"). InnerVolumeSpecName "kube-api-access-d27g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:44:12.555166 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.555078    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d27g2\" (UniqueName: \"kubernetes.io/projected/a467c79c-89fb-4ee9-b4d7-d69a2f373588-kube-api-access-d27g2\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:12.555166 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.555110    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a467c79c-89fb-4ee9-b4d7-d69a2f373588-plugins-config-volume\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:12.596334 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.596303    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:12.981425 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.981391    2564 generic.go:356] "Generic (PLEG): container finished" podID="a467c79c-89fb-4ee9-b4d7-d69a2f373588" containerID="8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc" exitCode=0
Jul 29 09:44:12.981620 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.981436    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"
Jul 29 09:44:12.981620 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.981486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj" event={"ID":"a467c79c-89fb-4ee9-b4d7-d69a2f373588","Type":"ContainerDied","Data":"8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc"}
Jul 29 09:44:12.981620 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.981538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj" event={"ID":"a467c79c-89fb-4ee9-b4d7-d69a2f373588","Type":"ContainerDied","Data":"defb73c178cd9c8b593234325fcf43f63c28362316711d617d30f96b21106d21"}
Jul 29 09:44:12.981620 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.981568    2564 scope.go:117] "RemoveContainer" containerID="8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc"
Jul 29 09:44:12.982801 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.982771    2564 generic.go:356] "Generic (PLEG): container finished" podID="e2d4a631-79ae-47b0-9b03-2e20371b61ba" containerID="59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d" exitCode=0
Jul 29 09:44:12.982861 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.982807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p" event={"ID":"e2d4a631-79ae-47b0-9b03-2e20371b61ba","Type":"ContainerDied","Data":"59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d"}
Jul 29 09:44:12.982861 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.982821    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"
Jul 29 09:44:12.982861 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.982836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p" event={"ID":"e2d4a631-79ae-47b0-9b03-2e20371b61ba","Type":"ContainerDied","Data":"63fb541e7d9a254638f26c470b763b19208b23f4e05cdd4a8de56e543f23fef7"}
Jul 29 09:44:12.991571 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.991554    2564 scope.go:117] "RemoveContainer" containerID="8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc"
Jul 29 09:44:12.991820 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:44:12.991802    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc\": container with ID starting with 8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc not found: ID does not exist" containerID="8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc"
Jul 29 09:44:12.991882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.991829    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc"} err="failed to get container status \"8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc\": rpc error: code = NotFound desc = could not find container \"8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc\": container with ID starting with 8949b554f1c781ee58b7fe900eea35845f3854835a9279f50bcb4b2d5ce519dc not found: ID does not exist"
Jul 29 09:44:12.991882 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:12.991854    2564 scope.go:117] "RemoveContainer" containerID="59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d"
Jul 29 09:44:13.002872 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.002854    2564 scope.go:117] "RemoveContainer" containerID="59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d"
Jul 29 09:44:13.003138 ip-10-0-131-230 kubenswrapper[2564]: E0729 09:44:13.003117    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d\": container with ID starting with 59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d not found: ID does not exist" containerID="59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d"
Jul 29 09:44:13.003202 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.003146    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d"} err="failed to get container status \"59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d\": rpc error: code = NotFound desc = could not find container \"59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d\": container with ID starting with 59e2a004a8ca6266e7ffb5a3f291368d48491526455317ff358c9a91562e1b9d not found: ID does not exist"
Jul 29 09:44:13.009765 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.009745    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"]
Jul 29 09:44:13.014158 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.014137    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-27430b-656494ff6-xscpj"]
Jul 29 09:44:13.023213 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.023194    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"]
Jul 29 09:44:13.030366 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.026426    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-27430b-79f8d6999f-qt26p"]
Jul 29 09:44:13.760687 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.760653    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a467c79c-89fb-4ee9-b4d7-d69a2f373588" path="/var/lib/kubelet/pods/a467c79c-89fb-4ee9-b4d7-d69a2f373588/volumes"
Jul 29 09:44:13.761075 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.760999    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c02f9e6c-e6bb-4126-be32-138b1cca7b8d" path="/var/lib/kubelet/pods/c02f9e6c-e6bb-4126-be32-138b1cca7b8d/volumes"
Jul 29 09:44:13.761341 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:13.761327    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2d4a631-79ae-47b0-9b03-2e20371b61ba" path="/var/lib/kubelet/pods/e2d4a631-79ae-47b0-9b03-2e20371b61ba/volumes"
Jul 29 09:44:18.572664 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:18.572627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:18.674528 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:18.674467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:18.823480 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:18.823394    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"]
Jul 29 09:44:18.823648 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:18.823590    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy" containerID="cri-o://19f100f76e4c8e768dd6f85c2dc9457d3195fd1bf0bb9cde982511976d0023b4" gracePeriod=30
Jul 29 09:44:18.851546 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:18.851506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:19.122385 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:19.122293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:20.394954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:20.394914    2564 patch_prober.go:28] interesting pod/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 09:44:20.395323 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:20.394983    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 09:44:24.038483 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.038454    2564 generic.go:356] "Generic (PLEG): container finished" podID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerID="19f100f76e4c8e768dd6f85c2dc9457d3195fd1bf0bb9cde982511976d0023b4" exitCode=0
Jul 29 09:44:24.038888 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.038496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" event={"ID":"a23ef7f4-9ab1-4eb9-be10-bc514103acd8","Type":"ContainerDied","Data":"19f100f76e4c8e768dd6f85c2dc9457d3195fd1bf0bb9cde982511976d0023b4"}
Jul 29 09:44:24.038888 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.038542    2564 scope.go:117] "RemoveContainer" containerID="5f61ab37a3b7ad6c869590e5ea09e9ac0583eaed86c9c79743e808de3395387f"
Jul 29 09:44:24.069914 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.069893    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:44:24.159776 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.159743    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istiod-ca-cert\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.159942 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.159806    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-token\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.159942 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.159830    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgb58\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-kube-api-access-kgb58\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.160072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.159988    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-envoy\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.160072 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160039    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-certs\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.160177 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160083    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-credential-socket\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.160177 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160151    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-podinfo\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.160293 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-socket\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.160293 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160214    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-data\") pod \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\" (UID: \"a23ef7f4-9ab1-4eb9-be10-bc514103acd8\") "
Jul 29 09:44:24.160293 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 09:44:24.160457 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:24.160517 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160493    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:24.160574 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160515    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-certs\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:24.160574 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160535    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istiod-ca-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:24.160756 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.160701    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:24.161071 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.161051    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-data" (OuterVolumeSpecName: "istio-data") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:24.162159 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.162127    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-kube-api-access-kgb58" (OuterVolumeSpecName: "kube-api-access-kgb58") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "kube-api-access-kgb58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:44:24.162159 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.162142    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-token" (OuterVolumeSpecName: "istio-token") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 09:44:24.162461 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.162439    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 09:44:24.162461 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.162448    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a23ef7f4-9ab1-4eb9-be10-bc514103acd8" (UID: "a23ef7f4-9ab1-4eb9-be10-bc514103acd8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 09:44:24.261146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.261069    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:24.261146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.261103    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgb58\" (UniqueName: \"kubernetes.io/projected/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-kube-api-access-kgb58\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:24.261146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.261115    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-envoy\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:24.261146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.261123    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-credential-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:24.261146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.261132    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-podinfo\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:24.261146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.261140    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-workload-socket\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:24.261146 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:24.261148    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a23ef7f4-9ab1-4eb9-be10-bc514103acd8-istio-data\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\""
Jul 29 09:44:25.044050 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.044019    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"
Jul 29 09:44:25.044460 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.044064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh" event={"ID":"a23ef7f4-9ab1-4eb9-be10-bc514103acd8","Type":"ContainerDied","Data":"049e4132c3ac43548533ab8e7738cf54f07a57d61eb52e2c307833187acc3a9f"}
Jul 29 09:44:25.044460 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.044125    2564 scope.go:117] "RemoveContainer" containerID="19f100f76e4c8e768dd6f85c2dc9457d3195fd1bf0bb9cde982511976d0023b4"
Jul 29 09:44:25.065379 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.065357    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"]
Jul 29 09:44:25.069943 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.069921    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-27430b-openshift-default-fbb5f548d-tsdlh"]
Jul 29 09:44:25.424157 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.424134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67764bc7cd-cgz4k_5c8bfac3-3f75-42e3-8b2e-10abf743c665/copy-manifests/0.log"
Jul 29 09:44:25.430176 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.430147    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67764bc7cd-cgz4k_5c8bfac3-3f75-42e3-8b2e-10abf743c665/manager/0.log"
Jul 29 09:44:25.760414 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.760331    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" path="/var/lib/kubelet/pods/a23ef7f4-9ab1-4eb9-be10-bc514103acd8/volumes"
Jul 29 09:44:25.982813 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:25.982779    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755275-l4rhm_d3059c1b-df0a-48a7-8c2a-5fe083088ec5/cleanup/0.log"
Jul 29 09:44:28.532727 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:28.532688    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cldhpm_2a0e09b1-6914-42f8-8981-594d0b5d52ac/istio-proxy/0.log"
Jul 29 09:44:28.651403 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:28.651368    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sxkck_cff40a0d-a0a8-48d5-a297-6102f94e26af/discovery/0.log"
Jul 29 09:44:29.815063 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:29.815034    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gm4dq_9eef80f9-809e-42a0-92ed-1d592bc9cb17/main/0.log"
Jul 29 09:44:30.143249 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:30.143219    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lrxfr_76a3b818-5ebc-4a17-994b-3d5e6ccfa35e/main/0.log"
Jul 29 09:44:32.202852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:32.202821    2564 scope.go:117] "RemoveContainer" containerID="ced244c4ef93dc8798e64edae5b6e10b682d81c2c1bbf2db740caf0e6a1a214b"
Jul 29 09:44:35.875463 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:35.875409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:35.976852 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:35.976808    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log" limit=1024
Jul 29 09:44:38.796658 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:38.796620    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cj752_e7a62fa0-75b7-4ca9-b3fe-0d05bf1e8a43/global-pull-secret-syncer/0.log"
Jul 29 09:44:38.897894 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:38.897851    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cz9pq_50e40ff2-c7cb-4a2f-bd59-0e14f5167ad9/konnectivity-agent/0.log"
Jul 29 09:44:39.006393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:39.006343    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-230.ec2.internal_3a7c0b67d46e1779681af76760bb73d6/haproxy/0.log"
Jul 29 09:44:46.776546 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:46.776516    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-cmpl2_c17aa2ca-4f62-4eb2-bdc6-52d61af9b6f8/cluster-monitoring-operator/0.log"
Jul 29 09:44:47.006257 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.006172    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grh47_26b979b7-97cf-4079-a233-2d13a2205ad4/node-exporter/0.log"
Jul 29 09:44:47.031646 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.031614    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grh47_26b979b7-97cf-4079-a233-2d13a2205ad4/kube-rbac-proxy/0.log"
Jul 29 09:44:47.054865 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.054845    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grh47_26b979b7-97cf-4079-a233-2d13a2205ad4/init-textfile/0.log"
Jul 29 09:44:47.249690 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.249655    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fdc7545-53dc-4a42-b222-be862a67cef0/prometheus/0.log"
Jul 29 09:44:47.269217 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.269143    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fdc7545-53dc-4a42-b222-be862a67cef0/config-reloader/0.log"
Jul 29 09:44:47.290704 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.290667    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fdc7545-53dc-4a42-b222-be862a67cef0/thanos-sidecar/0.log"
Jul 29 09:44:47.310983 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.310958    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fdc7545-53dc-4a42-b222-be862a67cef0/kube-rbac-proxy-web/0.log"
Jul 29 09:44:47.331279 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.331251    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fdc7545-53dc-4a42-b222-be862a67cef0/kube-rbac-proxy/0.log"
Jul 29 09:44:47.353144 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.353118    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fdc7545-53dc-4a42-b222-be862a67cef0/kube-rbac-proxy-thanos/0.log"
Jul 29 09:44:47.372481 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:47.372457    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fdc7545-53dc-4a42-b222-be862a67cef0/init-config-reloader/0.log"
Jul 29 09:44:48.984793 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.984762    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"]
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985035    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985045    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985055    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985061    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985069    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a467c79c-89fb-4ee9-b4d7-d69a2f373588" containerName="payload-pre-processing"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985075    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a467c79c-89fb-4ee9-b4d7-d69a2f373588" containerName="payload-pre-processing"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985087    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02f9e6c-e6bb-4126-be32-138b1cca7b8d" containerName="revoke-keys"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985092    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02f9e6c-e6bb-4126-be32-138b1cca7b8d" containerName="revoke-keys"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985106    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d4a631-79ae-47b0-9b03-2e20371b61ba" containerName="maas-api"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985112    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d4a631-79ae-47b0-9b03-2e20371b61ba" containerName="maas-api"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985160    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d4a631-79ae-47b0-9b03-2e20371b61ba" containerName="maas-api"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985167    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985173    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy"
Jul 29 09:44:48.985172 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985180    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c02f9e6c-e6bb-4126-be32-138b1cca7b8d" containerName="revoke-keys"
Jul 29 09:44:48.985657 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985188    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy"
Jul 29 09:44:48.985657 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.985194    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a467c79c-89fb-4ee9-b4d7-d69a2f373588" containerName="payload-pre-processing"
Jul 29 09:44:48.988061 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.988042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:48.990171 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.990152    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dcgtc\"/\"kube-root-ca.crt\""
Jul 29 09:44:48.990739 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.990709    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dcgtc\"/\"openshift-service-ca.crt\""
Jul 29 09:44:48.990817 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.990743    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dcgtc\"/\"default-dockercfg-lkspl\""
Jul 29 09:44:48.998530 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:48.998508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"]
Jul 29 09:44:49.077792 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.077757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-lib-modules\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.077970 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.077800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-podres\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.077970 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.077823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7gs9\" (UniqueName: \"kubernetes.io/projected/23ff6a56-ce23-4a1c-8061-641933a561de-kube-api-access-q7gs9\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.077970 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.077913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-sys\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.077970 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.077950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-proc\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.178758 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.178695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-lib-modules\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.178939 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.178861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-podres\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.178939 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.178892    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-lib-modules\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.178939 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.178918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7gs9\" (UniqueName: \"kubernetes.io/projected/23ff6a56-ce23-4a1c-8061-641933a561de-kube-api-access-q7gs9\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.179057 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.178961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-sys\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.179057 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.178986    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-podres\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.179057 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.178990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-proc\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.179057 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.179027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-proc\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.179057 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.179027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23ff6a56-ce23-4a1c-8061-641933a561de-sys\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.187010 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.186980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7gs9\" (UniqueName: \"kubernetes.io/projected/23ff6a56-ce23-4a1c-8061-641933a561de-kube-api-access-q7gs9\") pod \"perf-node-gather-daemonset-pcgmp\" (UID: \"23ff6a56-ce23-4a1c-8061-641933a561de\") " pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.297844 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.297767    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:49.422161 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:49.422135    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"]
Jul 29 09:44:49.424353 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:44:49.424320    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod23ff6a56_ce23_4a1c_8061_641933a561de.slice/crio-4620855541c4bf92d23a8f48533cca01ad753272e95387fedccdf9363a9c084d WatchSource:0}: Error finding container 4620855541c4bf92d23a8f48533cca01ad753272e95387fedccdf9363a9c084d: Status 404 returned error can't find the container with id 4620855541c4bf92d23a8f48533cca01ad753272e95387fedccdf9363a9c084d
Jul 29 09:44:50.151215 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:50.151179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp" event={"ID":"23ff6a56-ce23-4a1c-8061-641933a561de","Type":"ContainerStarted","Data":"50f40894285415da931566b5333da4f985dccd2011d89132b373f96bce9e9ff2"}
Jul 29 09:44:50.151585 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:50.151240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp" event={"ID":"23ff6a56-ce23-4a1c-8061-641933a561de","Type":"ContainerStarted","Data":"4620855541c4bf92d23a8f48533cca01ad753272e95387fedccdf9363a9c084d"}
Jul 29 09:44:50.151585 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:50.151307    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:50.169090 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:50.169042    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp" podStartSLOduration=2.169027426 podStartE2EDuration="2.169027426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 09:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:44:50.166699886 +0000 UTC m=+3438.937969950" watchObservedRunningTime="2026-07-29 09:44:50.169027426 +0000 UTC m=+3438.940297490"
Jul 29 09:44:51.939619 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:51.939589    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pb44v_535222c0-a409-4022-99bc-dc2512cdfc07/dns/0.log"
Jul 29 09:44:51.963755 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:51.963707    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pb44v_535222c0-a409-4022-99bc-dc2512cdfc07/kube-rbac-proxy/0.log"
Jul 29 09:44:52.089234 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:52.089206    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8f5l_1fb8c2ee-ea91-4d57-b2dc-9653bb23c901/dns-node-resolver/0.log"
Jul 29 09:44:52.732453 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:52.732419    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rt4j6_b6185707-adc6-43fa-8a8b-a95116106b5a/node-ca/0.log"
Jul 29 09:44:53.674687 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:53.674660    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cldhpm_2a0e09b1-6914-42f8-8981-594d0b5d52ac/istio-proxy/0.log"
Jul 29 09:44:53.942627 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:53.942539    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sxkck_cff40a0d-a0a8-48d5-a297-6102f94e26af/discovery/0.log"
Jul 29 09:44:55.051175 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:55.051141    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5hmg8_902e3875-27f9-4c3e-8e9c-937846e72c03/serve-healthcheck-canary/0.log"
Jul 29 09:44:55.596616 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:55.596583    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mklw_67f00192-0f63-4341-9316-083842b4b685/kube-rbac-proxy/0.log"
Jul 29 09:44:55.616334 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:55.616305    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mklw_67f00192-0f63-4341-9316-083842b4b685/exporter/0.log"
Jul 29 09:44:55.637481 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:55.637454    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mklw_67f00192-0f63-4341-9316-083842b4b685/extractor/0.log"
Jul 29 09:44:56.165113 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:56.165088    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dcgtc/perf-node-gather-daemonset-pcgmp"
Jul 29 09:44:59.173052 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:59.173015    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67764bc7cd-cgz4k_5c8bfac3-3f75-42e3-8b2e-10abf743c665/manager/0.log"
Jul 29 09:44:59.196393 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:59.196362    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67764bc7cd-cgz4k_5c8bfac3-3f75-42e3-8b2e-10abf743c665/copy-manifests/0.log"
Jul 29 09:44:59.665895 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:59.665866    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cldhpm_2a0e09b1-6914-42f8-8981-594d0b5d52ac/istio-proxy/0.log"
Jul 29 09:44:59.925358 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:44:59.925277    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sxkck_cff40a0d-a0a8-48d5-a297-6102f94e26af/discovery/0.log"
Jul 29 09:45:00.138587 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.138555    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm"]
Jul 29 09:45:00.138954 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.138936    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy"
Jul 29 09:45:00.139044 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.138955    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy"
Jul 29 09:45:00.139044 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.138968    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy"
Jul 29 09:45:00.139044 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.138977    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a23ef7f4-9ab1-4eb9-be10-bc514103acd8" containerName="istio-proxy"
Jul 29 09:45:00.139196 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.139053    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="031c76d8-c909-4fb1-976a-350b62d604d6" containerName="istio-proxy"
Jul 29 09:45:00.142269 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.142250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm"
Jul 29 09:45:00.144456 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.144438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkm62\""
Jul 29 09:45:00.151619 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.151600    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm"
Jul 29 09:45:00.151923 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.151904    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm"]
Jul 29 09:45:00.284493 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.284469    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm"]
Jul 29 09:45:00.286583 ip-10-0-131-230 kubenswrapper[2564]: W0729 09:45:00.286556    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3230e2a_b1d8_4472_8a0b_669020f10c05.slice/crio-8cc9878e8c15fa6b7f09fcc590e4894eb361de7516d3ed6888d5073d4cb1ae3b WatchSource:0}: Error finding container 8cc9878e8c15fa6b7f09fcc590e4894eb361de7516d3ed6888d5073d4cb1ae3b: Status 404 returned error can't find the container with id 8cc9878e8c15fa6b7f09fcc590e4894eb361de7516d3ed6888d5073d4cb1ae3b
Jul 29 09:45:00.447148 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:00.447110    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-848779956-f8l6b_8d58e11c-cfef-48d8-b4f9-e3b3f057e0ec/manager/0.log"
Jul 29 09:45:01.200599 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:01.200505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm" event={"ID":"d3230e2a-b1d8-4472-8a0b-669020f10c05","Type":"ContainerStarted","Data":"e8ff0486589b1ff6ee6d8c7fcfa622c66a87bca679fc290ef69d03d0c23bde7a"}
Jul 29 09:45:01.200599 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:01.200560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm" event={"ID":"d3230e2a-b1d8-4472-8a0b-669020f10c05","Type":"ContainerStarted","Data":"8cc9878e8c15fa6b7f09fcc590e4894eb361de7516d3ed6888d5073d4cb1ae3b"}
Jul 29 09:45:01.217169 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:01.217121    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm" podStartSLOduration=1.217106526 podStartE2EDuration="1.217106526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 09:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 09:45:01.215514985 +0000 UTC m=+3449.986785080" watchObservedRunningTime="2026-07-29 09:45:01.217106526 +0000 UTC m=+3449.988376589"
Jul 29 09:45:01.563170 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:01.563083    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cldhpm_2a0e09b1-6914-42f8-8981-594d0b5d52ac/istio-proxy/0.log"
Jul 29 09:45:01.860245 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:01.860165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sxkck_cff40a0d-a0a8-48d5-a297-6102f94e26af/discovery/0.log"
Jul 29 09:45:02.209132 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:02.209098    2564 generic.go:356] "Generic (PLEG): container finished" podID="d3230e2a-b1d8-4472-8a0b-669020f10c05" containerID="e8ff0486589b1ff6ee6d8c7fcfa622c66a87bca679fc290ef69d03d0c23bde7a" exitCode=0
Jul 29 09:45:02.209294 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:02.209179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm" event={"ID":"d3230e2a-b1d8-4472-8a0b-669020f10c05","Type":"ContainerDied","Data":"e8ff0486589b1ff6ee6d8c7fcfa622c66a87bca679fc290ef69d03d0c23bde7a"}
Jul 29 09:45:03.352456 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:03.352429    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm"
Jul 29 09:45:04.219298 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:04.219266    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm"
Jul 29 09:45:04.219475 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:04.219303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755305-tr6nm" event={"ID":"d3230e2a-b1d8-4472-8a0b-669020f10c05","Type":"ContainerDied","Data":"8cc9878e8c15fa6b7f09fcc590e4894eb361de7516d3ed6888d5073d4cb1ae3b"}
Jul 29 09:45:04.219475 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:04.219345    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cc9878e8c15fa6b7f09fcc590e4894eb361de7516d3ed6888d5073d4cb1ae3b"
Jul 29 09:45:05.911389 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:05.911357    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v_04cb4ce0-cf14-419e-b296-088f0d42ab0a/kube-storage-version-migrator-operator/1.log"
Jul 29 09:45:05.913082 ip-10-0-131-230 kubenswrapper[2564]: I0729 09:45:05.913055    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-nfs6v_04cb4ce0-cf14-419e-b296-088f0d42ab0a/kube-storage-version-migrator-operator/0.log"