Aug 04 15:59:49.331755 ip-10-0-131-60 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 15:59:49.331771 ip-10-0-131-60 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 15:59:49.331782 ip-10-0-131-60 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 15:59:49.332121 ip-10-0-131-60 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 15:59:59.499867 ip-10-0-131-60 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 15:59:59.499888 ip-10-0-131-60 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 43d62d0da8fc46a0be1684019de64a63 --
Aug 04 16:01:59.045186 ip-10-0-131-60 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 16:01:59.463016 ip-10-0-131-60 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 16:01:59.463587 ip-10-0-131-60 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 16:01:59.463587 ip-10-0-131-60 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 16:01:59.463587 ip-10-0-131-60 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 16:01:59.463587 ip-10-0-131-60 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 16:01:59.464207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.464041    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 16:01:59.468523 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468509    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:59.468523 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468524    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468529    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468532    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468535    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468538    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468540    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468543    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468545    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468548    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468550    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468553    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468555    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468558    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468560    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468563    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468565    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468568    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468570    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468573    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468575    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:59.468586 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468578    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468580    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468592    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468595    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468598    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468600    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468603    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468606    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468608    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468612    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468616    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468619    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468622    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468625    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468627    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468629    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468632    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468635    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468639    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468642    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:59.469129 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468645    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468648    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468650    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468653    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468655    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468657    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468660    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468663    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468665    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468667    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468670    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468673    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468675    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468679    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468681    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468684    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468686    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468689    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468691    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468694    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:59.469622 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468696    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468698    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468702    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468706    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468709    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468711    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468715    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468717    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468720    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468722    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468725    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468727    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468729    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468732    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468735    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468737    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468740    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468742    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468745    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:59.470128 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468748    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468751    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468753    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468756    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468758    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468761    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468764    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468766    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468769    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468772    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468774    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468777    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468779    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468782    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468784    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468787    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468789    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468791    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.468793    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469491    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:59.470584 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469497    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469500    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469502    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469505    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469508    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469510    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469513    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469515    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469518    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469520    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469524    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469526    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469529    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469532    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469535    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469538    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469540    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469543    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469547    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469550    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:59.471085 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469552    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469555    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469557    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469560    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469562    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469565    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469567    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469569    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469572    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469574    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469576    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469581    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469584    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469587    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469590    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469593    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469596    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469600    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469604    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:59.471617 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469607    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469609    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469612    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469615    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469618    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469620    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469623    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469626    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469630    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469633    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469636    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469638    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469641    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469643    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469646    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469648    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469651    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469653    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469655    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469658    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:59.472120 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469661    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469664    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469666    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469669    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469673    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469675    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469678    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469680    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469683    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469685    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469687    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469690    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469692    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469694    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469697    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469700    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469702    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469704    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469707    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469709    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:59.472616 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469712    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469715    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469718    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469721    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469723    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469725    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469728    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469730    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469733    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469736    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469738    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469740    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469743    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469745    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469747    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469750    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469752    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469754    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.469757    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470129    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:59.473131 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470133    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470136    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470140    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470144    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470148    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470151    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470153    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470156    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470159    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470161    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470164    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470166    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470169    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470172    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470175    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470177    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470180    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470184    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470187    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:59.473615 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470190    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470193    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470195    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470197    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470200    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470202    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470205    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470207    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470209    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470212    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470214    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470217    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470219    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470222    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470224    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470226    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470229    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470231    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470234    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470237    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:59.474105 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470239    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470242    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470244    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470247    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470249    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470252    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470255    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470257    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470260    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470262    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470265    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470267    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470270    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470272    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470274    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470277    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470279    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470283    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470285    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470287    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:59.474591 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470290    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470292    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470295    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470297    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470300    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470302    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470304    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470307    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470309    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470314    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470318    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470324    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470327    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470329    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470332    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470334    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470337    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470339    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470342    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:59.475095 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470345    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470348    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470350    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470353    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470355    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470357    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470360    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470363    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470365    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470368    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470370    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470372    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470375    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470377    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470380    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470383    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470385    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470388    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470390    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.470392    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:59.475563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470462    2563 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470469    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470475    2563 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470479    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470484    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470487    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470491    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470495    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470498    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470501    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470504    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470507    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470511    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470515    2563 flags.go:64] FLAG: --cgroup-root=""
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470518    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470520    2563 flags.go:64] FLAG: --client-ca-file=""
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470523    2563 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470526    2563 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470531    2563 flags.go:64] FLAG: --cluster-domain=""
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470533    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470536    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470539    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470543    2563 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470546    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 16:01:59.476077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470549    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470552    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470555    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470558    2563 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470560    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470563    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470566    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470569    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470575    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470578    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470581    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470584    2563 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470588    2563 flags.go:64] FLAG: --enable-server="true"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470591    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470595    2563 flags.go:64] FLAG: --event-burst="100"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470598    2563 flags.go:64] FLAG: --event-qps="50"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470601    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470604    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470607    2563 flags.go:64] FLAG: --eviction-hard=""
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470611    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470614    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470617    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470620    2563 flags.go:64] FLAG: --eviction-soft=""
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470623    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470626    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 16:01:59.476662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470629    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470632    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470634    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470637    2563 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470640    2563 flags.go:64] FLAG: --feature-gates=""
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470643    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470646    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470649    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470652    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470655    2563 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470657    2563 flags.go:64] FLAG: --help="false"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470660    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470663    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470666    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470668    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470671    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470675    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470677    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470680    2563 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470684    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470686    2563 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470689    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470692    2563 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470694    2563 flags.go:64] FLAG: --kube-reserved=""
Aug 04 16:01:59.477372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470697    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470700    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470703    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470706    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470708    2563 flags.go:64] FLAG: --lock-file=""
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470711    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470715    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470718    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470723    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470725    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470728    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470731    2563 flags.go:64] FLAG: --logging-format="text"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470733    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470737    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470739    2563 flags.go:64] FLAG: --manifest-url=""
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470742    2563 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470746    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470749    2563 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470752    2563 flags.go:64] FLAG: --max-pods="110"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470755    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470758    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470760    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470763    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470766    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470769    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 16:01:59.477987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470772    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470778    2563 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470782    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470785    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470788    2563 flags.go:64] FLAG: --pod-cidr=""
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470791    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470797    2563 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470799    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470803    2563 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470805    2563 flags.go:64] FLAG: --port="10250"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470808    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470811    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bdba5a24f05fd080"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470814    2563 flags.go:64] FLAG: --qos-reserved=""
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470817    2563 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470821    2563 flags.go:64] FLAG: --register-node="true"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470823    2563 flags.go:64] FLAG: --register-with-taints=""
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470827    2563 flags.go:64] FLAG: --registry-burst="10"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470830    2563 flags.go:64] FLAG: --registry-qps="5"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470832    2563 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470835    2563 flags.go:64] FLAG: --reserved-memory=""
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470838    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470841    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470844    2563 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470847    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470849    2563 flags.go:64] FLAG: --runonce="false"
Aug 04 16:01:59.478585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470852    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470855    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470858    2563 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470860    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470863    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470866    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470869    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470872    2563 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470874    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470878    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470881    2563 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470884    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470887    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470889    2563 flags.go:64] FLAG: --system-cgroups=""
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470892    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470897    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470899    2563 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470915    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470920    2563 flags.go:64] FLAG: --tls-min-version=""
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470923    2563 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470926    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470928    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470931    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470934    2563 flags.go:64] FLAG: --v="2"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470938    2563 flags.go:64] FLAG: --version="false"
Aug 04 16:01:59.479205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470942    2563 flags.go:64] FLAG: --vmodule=""
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470945    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.470948    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471065    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471070    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471074    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471077    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471080    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471083    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471085    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471088    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471091    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471093    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471096    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471099    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471101    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471105    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471109    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471112    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471114    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:59.479817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471117    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471119    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471122    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471124    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471127    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471130    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471132    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471134    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471137    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471139    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471143    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471145    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471148    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471150    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471154    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471157    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471160    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471162    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471165    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:59.480327 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471168    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471171    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471173    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471175    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471178    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471180    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471182    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471185    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471187    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471191    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471194    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471197    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471199    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471202    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471204    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471207    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471210    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471212    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471214    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471217    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:59.480817 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471219    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471222    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471225    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471228    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471231    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471233    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471236    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471238    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471240    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471243    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471245    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471248    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471250    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471253    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471255    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471257    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471260    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471262    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471265    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471267    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:59.481391 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471270    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471277    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471281    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471284    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471287    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471291    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471293    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471296    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471299    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471301    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471304    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471306    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471308    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471311    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471313    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471316    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471318    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471321    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471324    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471326    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:59.481920 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471329    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471331    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.471333    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.471878    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.478172    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.478186    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.478976    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.478986    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479044    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479049    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479053    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479055    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479058    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479061    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479064    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:59.482438 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479066    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479069    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479071    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479074    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479077    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479079    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479081    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479084    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479087    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479089    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479091    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479094    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479096    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479099    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479103    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479105    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479108    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479110    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479112    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479115    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:59.482826 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479117    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479120    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479123    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479126    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479129    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479131    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479134    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479136    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479139    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479141    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479144    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479147    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479149    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479152    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479154    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479156    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479159    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479161    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479164    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:59.483430 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479166    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479169    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479171    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479173    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479176    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479178    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479181    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479184    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479187    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479189    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479192    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479194    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479197    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479199    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479202    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479205    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479208    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479212    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479216    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:59.483894 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479219    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479222    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479225    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479228    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479232    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479235    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479238    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479241    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479243    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479246    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479249    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479252    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479254    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479257    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479259    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479262    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479264    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479267    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479269    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:59.484420 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479272    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479275    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479277    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479280    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479283    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479287    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479291    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479293    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479296    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479300    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479302    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479305    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479307    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479310    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479312    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:59.484872 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.479317    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479445    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479450    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479454    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479456    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479459    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479462    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479464    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479467    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479470    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479472    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479475    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479479    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479482    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479485    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479487    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479490    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479493    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479495    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:59.485331 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479498    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479501    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479504    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479520    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479524    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479527    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479530    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479533    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479536    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479539    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479541    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479544    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479546    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479549    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479551    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479553    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479556    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479558    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479561    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479563    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:59.485796 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479565    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479568    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479571    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479573    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479575    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479578    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479580    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479582    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479585    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479588    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479591    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479594    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479596    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479599    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479601    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479605    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479607    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479609    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479612    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479614    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:59.486288 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479617    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479619    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479622    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479625    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479627    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479629    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479632    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479634    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479637    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479639    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479642    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479644    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479647    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479649    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479652    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479654    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479658    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479661    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479664    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:59.486811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479667    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479669    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479671    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479674    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479676    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479679    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479681    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479684    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479686    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479689    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479692    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479694    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479697    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479699    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479702    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479704    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479706    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479709    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479711    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479713    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:59.487299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479716    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:59.487837 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:01:59.479718    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:59.487837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.479723    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 16:01:59.487837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.479814    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 16:01:59.487837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.481761    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 16:01:59.487837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.483113    2563 server.go:1019] "Starting client certificate rotation"
Aug 04 16:01:59.487837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.483216    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 16:01:59.487837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.483243    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 16:01:59.487837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.486434    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 16:01:59.489958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.489933    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 16:01:59.501088 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.501066    2563 log.go:25] "Validated CRI v1 runtime API"
Aug 04 16:01:59.502938 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.502901    2563 log.go:25] "Validated CRI v1 image API"
Aug 04 16:01:59.504671 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.504654    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 16:01:59.507439 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.507420    2563 fs.go:135] Filesystem UUIDs: map[1c7fc78f-7323-4c5f-abc2-09418a143276:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 de3a2ff8-5693-4ba6-88c1-1ee979c0799a:/dev/nvme0n1p3]
Aug 04 16:01:59.507522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.507438    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 16:01:59.509212 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.509191    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 16:01:59.512447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.512340    2563 manager.go:216] Machine: {Timestamp:2026-08-04 16:01:59.511135566 +0000 UTC m=+0.337833029 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097865 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec225f861e1e8cf1a36031534d7cad50 SystemUUID:ec225f86-1e1e-8cf1-a360-31534d7cad50 BootID:43d62d0d-a8fc-46a0-be16-84019de64a63 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:06:cf:30:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:06:cf:30:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:ec:58:60:0a:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 16:01:59.512447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.512441    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 16:01:59.512588 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.512540    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 16:01:59.515848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.515826    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 16:01:59.515997 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.515852    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-60.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 16:01:59.516674 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.516664    2563 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 16:01:59.516703 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.516677    2563 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 16:01:59.516703 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.516684    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 16:01:59.517343 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.517333    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 16:01:59.518109 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.518099    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 16:01:59.521306 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521295    2563 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 16:01:59.521420 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521410    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 16:01:59.521456 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521438    2563 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 16:01:59.521456 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521454    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 16:01:59.521533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521466    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 16:01:59.521533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521475    2563 kubelet.go:398] "Adding apiserver pod source"
Aug 04 16:01:59.521533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521483    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 16:01:59.521819 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521806    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 16:01:59.521861 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.521831    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 16:01:59.524495 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.524479    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 16:01:59.525710 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.525697    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 16:01:59.525761 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.525726    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 16:01:59.526739 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526727    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526744    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526751    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526757    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526767    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526772    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526780    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526786    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526795    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526803    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 16:01:59.526816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526816    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 16:01:59.527108 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.526823    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 16:01:59.528623 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.528609    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 16:01:59.528623 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.528620    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 16:01:59.529992 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.529965    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hckq"
Aug 04 16:01:59.531216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.531196    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-60.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 16:01:59.531298 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.531249    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 16:01:59.531298 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.531252    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 16:01:59.532528 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.532511    2563 server.go:1268] "Started kubelet"
Aug 04 16:01:59.532653 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.532598    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 16:01:59.532746 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.532662    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 16:01:59.532810 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.532754    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 16:01:59.533371 ip-10-0-131-60 systemd[1]: Started Kubernetes Kubelet.
Aug 04 16:01:59.533798 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.533783    2563 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 16:01:59.533985 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.533840    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 16:01:59.537946 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.537926    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 16:01:59.538218 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.537195    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-60.ec2.internal.18c8a596d78dd5dd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-60.ec2.internal,UID:ip-10-0-131-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-60.ec2.internal,},FirstTimestamp:2026-08-04 16:01:59.532475869 +0000 UTC m=+0.359173331,LastTimestamp:2026-08-04 16:01:59.532475869 +0000 UTC m=+0.359173331,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-60.ec2.internal,}"
Aug 04 16:01:59.538682 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.538669    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 16:01:59.538682 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.538675    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 16:01:59.538780 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.538706    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hckq"
Aug 04 16:01:59.538780 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.538741    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:01:59.539255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.539238    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 16:01:59.539341 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.539258    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 16:01:59.539341 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.539243    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 16:01:59.539444 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.539419    2563 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 16:01:59.539444 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.539440    2563 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 16:01:59.539791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.539771    2563 factory.go:55] Registering systemd factory
Aug 04 16:01:59.539791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.539793    2563 factory.go:223] Registration of the systemd container factory successfully
Aug 04 16:01:59.540115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.540102    2563 factory.go:153] Registering CRI-O factory
Aug 04 16:01:59.540170 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.540119    2563 factory.go:223] Registration of the crio container factory successfully
Aug 04 16:01:59.540170 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.540160    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 16:01:59.540240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.540177    2563 factory.go:103] Registering Raw factory
Aug 04 16:01:59.540240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.540189    2563 manager.go:1196] Started watching for new ooms in manager
Aug 04 16:01:59.540504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.540494    2563 manager.go:349] Starting recovery of all containers
Aug 04 16:01:59.547998 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.547955    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 16:01:59.550794 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.550771    2563 manager.go:354] Recovery completed
Aug 04 16:01:59.551447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.551388    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:01:59.555473 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.555454    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-60.ec2.internal\" not found" node="ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.557327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.557310    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:59.559185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.559172    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:59.559255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.559201    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:59.559255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.559215    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:59.559697 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.559680    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 16:01:59.559697 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.559695    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 16:01:59.559811 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.559711    2563 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 16:01:59.559811 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.559697    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:59.560430 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.560415    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:59.560512 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.560446    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:59.560512 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.560459    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:59.560698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.560686    2563 policy_none.go:49] "None policy: Start"
Aug 04 16:01:59.560739 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.560702    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 16:01:59.560739 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.560712    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 16:01:59.561653 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.561643    2563 policy_none.go:47] "Start"
Aug 04 16:01:59.608459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.608444    2563 manager.go:337] "Starting Device Plugin manager"
Aug 04 16:01:59.608535 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.608481    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 16:01:59.608535 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.608491    2563 server.go:87] "Starting device plugin registration server"
Aug 04 16:01:59.608844 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.608718    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 16:01:59.608880 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.608852    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 16:01:59.608973 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.608960    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 16:01:59.609068 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.609041    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 16:01:59.609068 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.609055    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 16:01:59.609557 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.609541    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 16:01:59.609633 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.609590    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:01:59.708973 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.708949    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:59.710418 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.710398    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 16:01:59.710480 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.710443    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 16:01:59.710480 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.710468    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 16:01:59.710568 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.710505    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 16:01:59.711025 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.711008    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:59.711122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.711040    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:59.711122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.711053    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:59.711122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.711087    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.713422 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.713371    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:01:59.718017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.718003    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.718074 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.718024    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-60.ec2.internal\": node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:01:59.742340 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.742324    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:01:59.811454 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.811413    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal"]
Aug 04 16:01:59.811531 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.811493    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:59.813017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.813002    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:59.813108 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.813033    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:59.813108 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.813048    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:59.814338 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.814324    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:59.814443 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.814430    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.814488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.814464    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:59.816073 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.816056    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:59.816174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.816084    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:59.816174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.816094    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:59.816174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.816058    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:59.816306 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.816180    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:59.816306 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.816197    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:59.817309 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.817294    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.817363 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.817324    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:59.817956 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.817940    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:59.818014 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.817971    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:59.818014 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.817988    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:59.832420 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.832403    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-60.ec2.internal\" not found" node="ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.836163 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.836146    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-60.ec2.internal\" not found" node="ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.841372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.841357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6718bd51b27ca92571804b6ccc53294d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"6718bd51b27ca92571804b6ccc53294d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.841419 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.841380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6718bd51b27ca92571804b6ccc53294d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"6718bd51b27ca92571804b6ccc53294d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.841419 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.841405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39a7c3613bf8e5e7fd5e0d2f670dcc7b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-60.ec2.internal\" (UID: \"39a7c3613bf8e5e7fd5e0d2f670dcc7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.842402 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.842383    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:01:59.942242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.942222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6718bd51b27ca92571804b6ccc53294d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"6718bd51b27ca92571804b6ccc53294d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.942242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.942246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6718bd51b27ca92571804b6ccc53294d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"6718bd51b27ca92571804b6ccc53294d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.942395 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.942269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39a7c3613bf8e5e7fd5e0d2f670dcc7b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-60.ec2.internal\" (UID: \"39a7c3613bf8e5e7fd5e0d2f670dcc7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.942395 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.942300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6718bd51b27ca92571804b6ccc53294d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"6718bd51b27ca92571804b6ccc53294d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.942395 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.942310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6718bd51b27ca92571804b6ccc53294d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"6718bd51b27ca92571804b6ccc53294d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.942395 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:01:59.942344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39a7c3613bf8e5e7fd5e0d2f670dcc7b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-60.ec2.internal\" (UID: \"39a7c3613bf8e5e7fd5e0d2f670dcc7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal"
Aug 04 16:01:59.943239 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:01:59.943222    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.043915 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:00.043873    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.135116 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.135090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:02:00.139167 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.139050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal"
Aug 04 16:02:00.144666 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:00.144644    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.245084 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:00.245054    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.345359 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:00.345288    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.446051 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:00.446025    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.484075 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.484048    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 16:02:00.484458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.484226    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 16:02:00.484458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.484230    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 16:02:00.542693 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.542662    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 15:56:59 +0000 UTC" deadline="2028-02-25 14:19:34.116838508 +0000 UTC"
Aug 04 16:02:00.542693 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.542690    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13678h17m33.574151397s"
Aug 04 16:02:00.546431 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:00.546411    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.639116 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.639096    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:02:00.647133 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:00.647112    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.729416 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:00.729386    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6718bd51b27ca92571804b6ccc53294d.slice/crio-e11e74431690ba903f60a3b56641d317fcfc78d02320ad266b93b5ce352db9e1 WatchSource:0}: Error finding container e11e74431690ba903f60a3b56641d317fcfc78d02320ad266b93b5ce352db9e1: Status 404 returned error can't find the container with id e11e74431690ba903f60a3b56641d317fcfc78d02320ad266b93b5ce352db9e1
Aug 04 16:02:00.733602 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.733583    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:02:00.748187 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:00.748165    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found"
Aug 04 16:02:00.797690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.797670    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:02:00.839955 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.839901    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal"
Aug 04 16:02:00.852507 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.852487    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 16:02:00.853447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.853434    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal"
Aug 04 16:02:00.860017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:00.859999    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 16:02:01.321788 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.321761    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:02:01.453434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.453408    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:02:01.525089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.525071    2563 apiserver.go:52] "Watching apiserver"
Aug 04 16:02:01.530227 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.530211    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 16:02:01.530598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.530577    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zrvwr","kube-system/konnectivity-agent-ffvfl","kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal","openshift-dns/node-resolver-lp2j4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal","openshift-multus/network-metrics-daemon-d2m5z","openshift-network-operator/iptables-alerter-hrxqs","openshift-ovn-kubernetes/ovnkube-node-9tjhw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7","openshift-cluster-node-tuning-operator/tuned-t6fwl","openshift-image-registry/node-ca-r9jf7","openshift-multus/multus-additional-cni-plugins-f8n59","openshift-multus/multus-jksg4","openshift-network-diagnostics/network-check-target-sp42h"]
Aug 04 16:02:01.532595 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.532576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.533706 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.533685    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.534634 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.534602    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tflwv\""
Aug 04 16:02:01.534761 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.534744    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 16:02:01.534838 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.534804    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 16:02:01.534897 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.534847    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 16:02:01.535009 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.534989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:01.535095 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.535071    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:01.535502 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.535479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sbjbh\""
Aug 04 16:02:01.535648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.535632    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 16:02:01.535718 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.535703    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 16:02:01.535781 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.535726    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 16:02:01.536115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.536099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.537416 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.537395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.537860 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.537835    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 16:02:01.538099 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.538082    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-422bp\""
Aug 04 16:02:01.538385 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.538369    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 16:02:01.538754 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.538734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:01.538832 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.538813    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:01.539104 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.539085    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 16:02:01.539349 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.539332    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 16:02:01.539435 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.539394    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m9xcv\""
Aug 04 16:02:01.540236 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.540142    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.540367 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.540349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 16:02:01.540606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.540585    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 16:02:01.540606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.540601    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 16:02:01.540822 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.540806    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 16:02:01.541465 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.541451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.542765 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.542750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:01.543198 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.543177    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 16:02:01.543273 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.543212    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zt7ql\""
Aug 04 16:02:01.543273 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.543234    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 16:02:01.543273 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.543244    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 16:02:01.543486 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.543464    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 16:02:01.543632 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.543583    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 16:02:01.543632 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.543583    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 16:02:01.544403 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.544024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 16:02:01.544403 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.544204    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 16:02:01.544403 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.544321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fbpww\""
Aug 04 16:02:01.546844 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.544822    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 16:02:01.546844 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.545469    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 16:02:01.547318 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.547295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.547410 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.547341    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6z985\""
Aug 04 16:02:01.548727 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.548710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.548806 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.548787    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:01.550076 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550058    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.550329 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.550378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-cni-bin\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.550378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.550445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovn-node-metrics-cert\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.550445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:01.550445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eab8ef53-e32f-47d5-adac-9e05e28b3026-host\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.550445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26f3738f-0609-49c7-bb0d-28275c0b4631-tmp-dir\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.550583 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-socket-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.550583 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfswr\" (UniqueName: \"kubernetes.io/projected/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-kube-api-access-xfswr\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.550583 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7575\" (UniqueName: \"kubernetes.io/projected/40831a24-9c15-4af4-a92f-f4d132ddd4fd-kube-api-access-j7575\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.550583 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8kq5\" (UniqueName: \"kubernetes.io/projected/42464805-3fb9-40f2-9568-3915547e0083-kube-api-access-t8kq5\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:01.550583 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eab8ef53-e32f-47d5-adac-9e05e28b3026-serviceca\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.550744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-ovn\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.550744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6x6w\" (UniqueName: \"kubernetes.io/projected/26f3738f-0609-49c7-bb0d-28275c0b4631-kube-api-access-s6x6w\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.550744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.550744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-sys-fs\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.550928 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-systemd-units\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.550928 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-systemd\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.550928 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovnkube-script-lib\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.550928 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26f3738f-0609-49c7-bb0d-28275c0b4631-hosts-file\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.550928 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-device-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.551126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-var-lib-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.550984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-node-log\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-cni-netd\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpvlf\" (UniqueName: \"kubernetes.io/projected/eab8ef53-e32f-47d5-adac-9e05e28b3026-kube-api-access-kpvlf\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.551126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.551126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-env-overrides\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmml8\" (UniqueName: \"kubernetes.io/projected/e26e6d03-7a0b-41dc-87df-227f9696ff3c-kube-api-access-dmml8\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40831a24-9c15-4af4-a92f-f4d132ddd4fd-iptables-alerter-script\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-run-netns\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-registration-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-slash\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-log-socket\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40831a24-9c15-4af4-a92f-f4d132ddd4fd-host-slash\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-kubelet\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-etc-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.551458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.551411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovnkube-config\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.552738 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.552569    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 16:02:01.552738 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.552580    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-snrc2\""
Aug 04 16:02:01.552738 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.552587    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 16:02:01.552738 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.552605    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 16:02:01.552738 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.552608    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 16:02:01.553052 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.552918    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b58vm\""
Aug 04 16:02:01.559171 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.559149    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 16:02:01.579935 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.579920    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r5llh"
Aug 04 16:02:01.589075 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.589058    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r5llh"
Aug 04 16:02:01.640531 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.640507    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 16:02:01.652053 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-run\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.652116 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-ovn\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652116 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6x6w\" (UniqueName: \"kubernetes.io/projected/26f3738f-0609-49c7-bb0d-28275c0b4631-kube-api-access-s6x6w\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.652116 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovnkube-script-lib\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-multus-certs\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.652248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-ovn\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.652248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.652248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-device-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.652248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-var-lib-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-cni-netd\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-kubernetes\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-cnibin\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-device-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-var-lib-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-cni-netd\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lxvq\" (UniqueName: \"kubernetes.io/projected/293dd9e7-ba6f-4143-867b-190afd3ab76e-kube-api-access-2lxvq\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40831a24-9c15-4af4-a92f-f4d132ddd4fd-iptables-alerter-script\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.652491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-run-netns\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysctl-conf\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65e9a309-c1b2-41ea-a4dd-9eb493765007-cni-binary-copy\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-netns\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-kubelet\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s68v7\" (UniqueName: \"kubernetes.io/projected/65e9a309-c1b2-41ea-a4dd-9eb493765007-kube-api-access-s68v7\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-run-netns\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-slash\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08cde35f-1da6-4574-8865-5bec253c3075-dbus\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-slash\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.652836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovnkube-script-lib\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-etc-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-os-release\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-cni-bin\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-etc-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.652982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-cni-bin\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovn-node-metrics-cert\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85981edc-7f69-4fff-a6cb-c4be69bcfa38-agent-certs\") pod \"konnectivity-agent-ffvfl\" (UID: \"85981edc-7f69-4fff-a6cb-c4be69bcfa38\") " pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-systemd\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40831a24-9c15-4af4-a92f-f4d132ddd4fd-iptables-alerter-script\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-etc-kubernetes\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqlwm\" (UniqueName: \"kubernetes.io/projected/f630238c-046c-4a5c-8859-8213f8dcbb80-kube-api-access-xqlwm\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.653217    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:01.653383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26f3738f-0609-49c7-bb0d-28275c0b4631-tmp-dir\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653401    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfswr\" (UniqueName: \"kubernetes.io/projected/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-kube-api-access-xfswr\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysconfig\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-sys\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26f3738f-0609-49c7-bb0d-28275c0b4631-tmp-dir\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-host\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.653569    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs podName:42464805-3fb9-40f2-9568-3915547e0083 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:02.153538404 +0000 UTC m=+2.980235862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs") pod "network-metrics-daemon-d2m5z" (UID: "42464805-3fb9-40f2-9568-3915547e0083") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-k8s-cni-cncf-io\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-lib-modules\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-tuned\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-sys-fs\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-systemd-units\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-systemd\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-daemon-config\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.654094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-systemd-units\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-sys-fs\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-systemd\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26f3738f-0609-49c7-bb0d-28275c0b4631-hosts-file\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-node-log\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26f3738f-0609-49c7-bb0d-28275c0b4631-hosts-file\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpvlf\" (UniqueName: \"kubernetes.io/projected/eab8ef53-e32f-47d5-adac-9e05e28b3026-kube-api-access-kpvlf\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-system-cni-dir\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.653981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-node-log\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-run-openvswitch\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-env-overrides\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmml8\" (UniqueName: \"kubernetes.io/projected/e26e6d03-7a0b-41dc-87df-227f9696ff3c-kube-api-access-dmml8\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85981edc-7f69-4fff-a6cb-c4be69bcfa38-konnectivity-ca\") pod \"konnectivity-agent-ffvfl\" (UID: \"85981edc-7f69-4fff-a6cb-c4be69bcfa38\") " pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-modprobe-d\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-os-release\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.654847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-registration-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-log-socket\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-var-lib-kubelet\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/293dd9e7-ba6f-4143-867b-190afd3ab76e-tmp\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-registration-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-cni-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-log-socket\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-cni-multus\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-env-overrides\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40831a24-9c15-4af4-a92f-f4d132ddd4fd-host-slash\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-kubelet\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40831a24-9c15-4af4-a92f-f4d132ddd4fd-host-slash\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovnkube-config\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-kubelet\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-socket-dir-parent\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.655508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-conf-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.654982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-cnibin\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eab8ef53-e32f-47d5-adac-9e05e28b3026-host\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e26e6d03-7a0b-41dc-87df-227f9696ff3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eab8ef53-e32f-47d5-adac-9e05e28b3026-host\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovnkube-config\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08cde35f-1da6-4574-8865-5bec253c3075-kubelet-config\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-system-cni-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-cni-bin\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-hostroot\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-socket-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7575\" (UniqueName: \"kubernetes.io/projected/40831a24-9c15-4af4-a92f-f4d132ddd4fd-kube-api-access-j7575\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8kq5\" (UniqueName: \"kubernetes.io/projected/42464805-3fb9-40f2-9568-3915547e0083-kube-api-access-t8kq5\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eab8ef53-e32f-47d5-adac-9e05e28b3026-serviceca\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysctl-d\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655757    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.656086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.655843    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-socket-dir\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.656902 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.656842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eab8ef53-e32f-47d5-adac-9e05e28b3026-serviceca\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.657362 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.657326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e26e6d03-7a0b-41dc-87df-227f9696ff3c-ovn-node-metrics-cert\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.660581 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.660559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6x6w\" (UniqueName: \"kubernetes.io/projected/26f3738f-0609-49c7-bb0d-28275c0b4631-kube-api-access-s6x6w\") pod \"node-resolver-lp2j4\" (UID: \"26f3738f-0609-49c7-bb0d-28275c0b4631\") " pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.662497 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.662477    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:01.662604 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.662502    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:01.662604 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.662516    2563 projected.go:196] Error preparing data for projected volume kube-api-access-j678d for pod openshift-network-diagnostics/network-check-target-sp42h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:01.662721 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.662608    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d podName:06a505d0-327f-4fef-9006-dc9304d85af9 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:02.162589735 +0000 UTC m=+2.989287224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j678d" (UniqueName: "kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d") pod "network-check-target-sp42h" (UID: "06a505d0-327f-4fef-9006-dc9304d85af9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:01.664319 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.664223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfswr\" (UniqueName: \"kubernetes.io/projected/9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d-kube-api-access-xfswr\") pod \"aws-ebs-csi-driver-node-q54v7\" (UID: \"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.664618 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.664599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpvlf\" (UniqueName: \"kubernetes.io/projected/eab8ef53-e32f-47d5-adac-9e05e28b3026-kube-api-access-kpvlf\") pod \"node-ca-r9jf7\" (UID: \"eab8ef53-e32f-47d5-adac-9e05e28b3026\") " pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.665160 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.665137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmml8\" (UniqueName: \"kubernetes.io/projected/e26e6d03-7a0b-41dc-87df-227f9696ff3c-kube-api-access-dmml8\") pod \"ovnkube-node-9tjhw\" (UID: \"e26e6d03-7a0b-41dc-87df-227f9696ff3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.665701 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.665679    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7575\" (UniqueName: \"kubernetes.io/projected/40831a24-9c15-4af4-a92f-f4d132ddd4fd-kube-api-access-j7575\") pod \"iptables-alerter-hrxqs\" (UID: \"40831a24-9c15-4af4-a92f-f4d132ddd4fd\") " pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.665910 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.665893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8kq5\" (UniqueName: \"kubernetes.io/projected/42464805-3fb9-40f2-9568-3915547e0083-kube-api-access-t8kq5\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:01.715770 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.715732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" event={"ID":"6718bd51b27ca92571804b6ccc53294d","Type":"ContainerStarted","Data":"e11e74431690ba903f60a3b56641d317fcfc78d02320ad266b93b5ce352db9e1"}
Aug 04 16:02:01.756830 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-multus-certs\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.756899 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.756899 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.757001 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-kubernetes\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757001 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-multus-certs\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757001 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-cnibin\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757001 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lxvq\" (UniqueName: \"kubernetes.io/projected/293dd9e7-ba6f-4143-867b-190afd3ab76e-kube-api-access-2lxvq\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757001 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-cnibin\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757001 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.756982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-kubernetes\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysctl-conf\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65e9a309-c1b2-41ea-a4dd-9eb493765007-cni-binary-copy\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-netns\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-kubelet\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68v7\" (UniqueName: \"kubernetes.io/projected/65e9a309-c1b2-41ea-a4dd-9eb493765007-kube-api-access-s68v7\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08cde35f-1da6-4574-8865-5bec253c3075-dbus\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-os-release\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85981edc-7f69-4fff-a6cb-c4be69bcfa38-agent-certs\") pod \"konnectivity-agent-ffvfl\" (UID: \"85981edc-7f69-4fff-a6cb-c4be69bcfa38\") " pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-netns\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysctl-conf\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-kubelet\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-systemd\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-etc-kubernetes\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-os-release\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqlwm\" (UniqueName: \"kubernetes.io/projected/f630238c-046c-4a5c-8859-8213f8dcbb80-kube-api-access-xqlwm\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysconfig\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-systemd\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-sys\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-etc-kubernetes\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08cde35f-1da6-4574-8865-5bec253c3075-dbus\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757444    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-sys\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysconfig\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-host\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-k8s-cni-cncf-io\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-lib-modules\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-host\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65e9a309-c1b2-41ea-a4dd-9eb493765007-cni-binary-copy\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.757847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-run-k8s-cni-cncf-io\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-tuned\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-lib-modules\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-daemon-config\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-system-cni-dir\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85981edc-7f69-4fff-a6cb-c4be69bcfa38-konnectivity-ca\") pod \"konnectivity-agent-ffvfl\" (UID: \"85981edc-7f69-4fff-a6cb-c4be69bcfa38\") " pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-system-cni-dir\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-modprobe-d\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-os-release\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-var-lib-kubelet\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/293dd9e7-ba6f-4143-867b-190afd3ab76e-tmp\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-cni-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-modprobe-d\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-cni-multus\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.757896    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-os-release\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.758962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758069    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-socket-dir-parent\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-socket-dir-parent\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-conf-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-cnibin\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-daemon-config\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08cde35f-1da6-4574-8865-5bec253c3075-kubelet-config\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-system-cni-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758320    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-conf-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-cni-bin\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-hostroot\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-var-lib-kubelet\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysctl-d\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08cde35f-1da6-4574-8865-5bec253c3075-kubelet-config\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f630238c-046c-4a5c-8859-8213f8dcbb80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-multus-cni-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f630238c-046c-4a5c-8859-8213f8dcbb80-cnibin\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.759856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-cni-multus\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-sysctl-d\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-run\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-host-var-lib-cni-bin\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.758501    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/293dd9e7-ba6f-4143-867b-190afd3ab76e-run\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-system-cni-dir\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:01.758636    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret podName:08cde35f-1da6-4574-8865-5bec253c3075 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:02.258615318 +0000 UTC m=+3.085312768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret") pod "global-pull-secret-syncer-zrvwr" (UID: "08cde35f-1da6-4574-8865-5bec253c3075") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.758668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65e9a309-c1b2-41ea-a4dd-9eb493765007-hostroot\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.759082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85981edc-7f69-4fff-a6cb-c4be69bcfa38-konnectivity-ca\") pod \"konnectivity-agent-ffvfl\" (UID: \"85981edc-7f69-4fff-a6cb-c4be69bcfa38\") " pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.759978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85981edc-7f69-4fff-a6cb-c4be69bcfa38-agent-certs\") pod \"konnectivity-agent-ffvfl\" (UID: \"85981edc-7f69-4fff-a6cb-c4be69bcfa38\") " pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.760208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/293dd9e7-ba6f-4143-867b-190afd3ab76e-etc-tuned\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.760660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.760601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/293dd9e7-ba6f-4143-867b-190afd3ab76e-tmp\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.767449 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.767429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lxvq\" (UniqueName: \"kubernetes.io/projected/293dd9e7-ba6f-4143-867b-190afd3ab76e-kube-api-access-2lxvq\") pod \"tuned-t6fwl\" (UID: \"293dd9e7-ba6f-4143-867b-190afd3ab76e\") " pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.768282 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.768256    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s68v7\" (UniqueName: \"kubernetes.io/projected/65e9a309-c1b2-41ea-a4dd-9eb493765007-kube-api-access-s68v7\") pod \"multus-jksg4\" (UID: \"65e9a309-c1b2-41ea-a4dd-9eb493765007\") " pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.768394 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.768380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqlwm\" (UniqueName: \"kubernetes.io/projected/f630238c-046c-4a5c-8859-8213f8dcbb80-kube-api-access-xqlwm\") pod \"multus-additional-cni-plugins-f8n59\" (UID: \"f630238c-046c-4a5c-8859-8213f8dcbb80\") " pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.845710 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.845659    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrxqs"
Aug 04 16:02:01.852255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.852230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r9jf7"
Aug 04 16:02:01.854209 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:01.854101    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40831a24_9c15_4af4_a92f_f4d132ddd4fd.slice/crio-fcdc1360180082f8c578e185f300c2d7f1e27d31415a22ce04003429e29e9ac4 WatchSource:0}: Error finding container fcdc1360180082f8c578e185f300c2d7f1e27d31415a22ce04003429e29e9ac4: Status 404 returned error can't find the container with id fcdc1360180082f8c578e185f300c2d7f1e27d31415a22ce04003429e29e9ac4
Aug 04 16:02:01.859068 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.859053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lp2j4"
Aug 04 16:02:01.861694 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:01.861671    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab8ef53_e32f_47d5_adac_9e05e28b3026.slice/crio-130680cdd257f42b4e7e54b0a71158a75a84458b28317b611913b1fd2984331e WatchSource:0}: Error finding container 130680cdd257f42b4e7e54b0a71158a75a84458b28317b611913b1fd2984331e: Status 404 returned error can't find the container with id 130680cdd257f42b4e7e54b0a71158a75a84458b28317b611913b1fd2984331e
Aug 04 16:02:01.863693 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.863676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:01.867556 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:01.867538    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f3738f_0609_49c7_bb0d_28275c0b4631.slice/crio-041d4aa4540b22f60c871a4d9cec5df7b400fc679e977c8ca5f2f8245d7e70f4 WatchSource:0}: Error finding container 041d4aa4540b22f60c871a4d9cec5df7b400fc679e977c8ca5f2f8245d7e70f4: Status 404 returned error can't find the container with id 041d4aa4540b22f60c871a4d9cec5df7b400fc679e977c8ca5f2f8245d7e70f4
Aug 04 16:02:01.869283 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.869266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7"
Aug 04 16:02:01.872355 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:01.872333    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26e6d03_7a0b_41dc_87df_227f9696ff3c.slice/crio-5b2dc4752533777a50d8470e6297d85821e524f6c8f99757cde7be07a887aa0e WatchSource:0}: Error finding container 5b2dc4752533777a50d8470e6297d85821e524f6c8f99757cde7be07a887aa0e: Status 404 returned error can't find the container with id 5b2dc4752533777a50d8470e6297d85821e524f6c8f99757cde7be07a887aa0e
Aug 04 16:02:01.875854 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.875839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jksg4"
Aug 04 16:02:01.880828 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.880807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:01.881749 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:01.881723    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9647486b_ba6f_4bf6_a6af_b2e1e51f2f0d.slice/crio-3f69d63889cac514ecff2016fdd052047d9f132459fd2ef68f199db6324e00e4 WatchSource:0}: Error finding container 3f69d63889cac514ecff2016fdd052047d9f132459fd2ef68f199db6324e00e4: Status 404 returned error can't find the container with id 3f69d63889cac514ecff2016fdd052047d9f132459fd2ef68f199db6324e00e4
Aug 04 16:02:01.887583 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.887438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t6fwl"
Aug 04 16:02:01.891519 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:01.891500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f8n59"
Aug 04 16:02:01.894704 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:01.894686    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85981edc_7f69_4fff_a6cb_c4be69bcfa38.slice/crio-e1b51c6c2b1fdc282201f8c48c92411cafae97ca6b52a5d924e5f5a7719fede3 WatchSource:0}: Error finding container e1b51c6c2b1fdc282201f8c48c92411cafae97ca6b52a5d924e5f5a7719fede3: Status 404 returned error can't find the container with id e1b51c6c2b1fdc282201f8c48c92411cafae97ca6b52a5d924e5f5a7719fede3
Aug 04 16:02:01.895834 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:01.895815    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293dd9e7_ba6f_4143_867b_190afd3ab76e.slice/crio-6274e43faeba25911a1901e6a32a8dcb0537a3b52ea46a438b1e8fa6083c37d8 WatchSource:0}: Error finding container 6274e43faeba25911a1901e6a32a8dcb0537a3b52ea46a438b1e8fa6083c37d8: Status 404 returned error can't find the container with id 6274e43faeba25911a1901e6a32a8dcb0537a3b52ea46a438b1e8fa6083c37d8
Aug 04 16:02:01.900171 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:01.900149    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf630238c_046c_4a5c_8859_8213f8dcbb80.slice/crio-fefdec1422de299bdf532480fa71ae329522013308eade8cd6b691c84ec464c4 WatchSource:0}: Error finding container fefdec1422de299bdf532480fa71ae329522013308eade8cd6b691c84ec464c4: Status 404 returned error can't find the container with id fefdec1422de299bdf532480fa71ae329522013308eade8cd6b691c84ec464c4
Aug 04 16:02:02.161876 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.161795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:02.162085 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.161910    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:02.162085 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.161986    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs podName:42464805-3fb9-40f2-9568-3915547e0083 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:03.161971557 +0000 UTC m=+3.988669008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs") pod "network-metrics-daemon-d2m5z" (UID: "42464805-3fb9-40f2-9568-3915547e0083") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:02.262726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.262691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:02.262944 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.262757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:02.262944 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.262849    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:02.262944 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.262873    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:02.262944 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.262888    2563 projected.go:196] Error preparing data for projected volume kube-api-access-j678d for pod openshift-network-diagnostics/network-check-target-sp42h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:02.262944 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.262889    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:02.263181 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.262969    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret podName:08cde35f-1da6-4574-8865-5bec253c3075 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:03.262932909 +0000 UTC m=+4.089630368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret") pod "global-pull-secret-syncer-zrvwr" (UID: "08cde35f-1da6-4574-8865-5bec253c3075") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:02.263181 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.262990    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d podName:06a505d0-327f-4fef-9006-dc9304d85af9 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:03.262979364 +0000 UTC m=+4.089676818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j678d" (UniqueName: "kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d") pod "network-check-target-sp42h" (UID: "06a505d0-327f-4fef-9006-dc9304d85af9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:02.591003 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.590877    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:57:01 +0000 UTC" deadline="2028-01-26 01:25:40.79147563 +0000 UTC"
Aug 04 16:02:02.591003 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.590993    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12945h23m38.200487916s"
Aug 04 16:02:02.711527 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.711482    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:02.711714 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.711624    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:02.712235 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.712208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:02.712374 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:02.712334    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:02.723655 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.723622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8n59" event={"ID":"f630238c-046c-4a5c-8859-8213f8dcbb80","Type":"ContainerStarted","Data":"fefdec1422de299bdf532480fa71ae329522013308eade8cd6b691c84ec464c4"}
Aug 04 16:02:02.725687 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.725657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t6fwl" event={"ID":"293dd9e7-ba6f-4143-867b-190afd3ab76e","Type":"ContainerStarted","Data":"6274e43faeba25911a1901e6a32a8dcb0537a3b52ea46a438b1e8fa6083c37d8"}
Aug 04 16:02:02.729107 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.729079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ffvfl" event={"ID":"85981edc-7f69-4fff-a6cb-c4be69bcfa38","Type":"ContainerStarted","Data":"e1b51c6c2b1fdc282201f8c48c92411cafae97ca6b52a5d924e5f5a7719fede3"}
Aug 04 16:02:02.733025 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.732948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jksg4" event={"ID":"65e9a309-c1b2-41ea-a4dd-9eb493765007","Type":"ContainerStarted","Data":"83cdfa036aa60a4abf17c345026e0163cd72340871613633f3d6c96837ac60dc"}
Aug 04 16:02:02.735453 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.735389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7" event={"ID":"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d","Type":"ContainerStarted","Data":"3f69d63889cac514ecff2016fdd052047d9f132459fd2ef68f199db6324e00e4"}
Aug 04 16:02:02.736954 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.736931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"5b2dc4752533777a50d8470e6297d85821e524f6c8f99757cde7be07a887aa0e"}
Aug 04 16:02:02.739466 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.739438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lp2j4" event={"ID":"26f3738f-0609-49c7-bb0d-28275c0b4631","Type":"ContainerStarted","Data":"041d4aa4540b22f60c871a4d9cec5df7b400fc679e977c8ca5f2f8245d7e70f4"}
Aug 04 16:02:02.742035 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.742009    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r9jf7" event={"ID":"eab8ef53-e32f-47d5-adac-9e05e28b3026","Type":"ContainerStarted","Data":"130680cdd257f42b4e7e54b0a71158a75a84458b28317b611913b1fd2984331e"}
Aug 04 16:02:02.745628 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:02.745577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrxqs" event={"ID":"40831a24-9c15-4af4-a92f-f4d132ddd4fd","Type":"ContainerStarted","Data":"fcdc1360180082f8c578e185f300c2d7f1e27d31415a22ce04003429e29e9ac4"}
Aug 04 16:02:02.845642 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:02:02.845603    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a7c3613bf8e5e7fd5e0d2f670dcc7b.slice/crio-b2cb6b1c5eb061a104a7e86e1a4df7f335b02a947919cdb8bc5a0c23db986808 WatchSource:0}: Error finding container b2cb6b1c5eb061a104a7e86e1a4df7f335b02a947919cdb8bc5a0c23db986808: Status 404 returned error can't find the container with id b2cb6b1c5eb061a104a7e86e1a4df7f335b02a947919cdb8bc5a0c23db986808
Aug 04 16:02:03.169870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:03.169826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:03.170074 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.170054    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:03.170159 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.170136    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs podName:42464805-3fb9-40f2-9568-3915547e0083 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:05.170112616 +0000 UTC m=+5.996810076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs") pod "network-metrics-daemon-d2m5z" (UID: "42464805-3fb9-40f2-9568-3915547e0083") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:03.271075 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:03.271021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:03.271242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:03.271103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:03.271242 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.271225    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:03.271336 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.271246    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:03.271336 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.271295    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:03.271336 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.271310    2563 projected.go:196] Error preparing data for projected volume kube-api-access-j678d for pod openshift-network-diagnostics/network-check-target-sp42h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:03.271336 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.271319    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret podName:08cde35f-1da6-4574-8865-5bec253c3075 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:05.271297081 +0000 UTC m=+6.097994548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret") pod "global-pull-secret-syncer-zrvwr" (UID: "08cde35f-1da6-4574-8865-5bec253c3075") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:03.271480 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.271363    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d podName:06a505d0-327f-4fef-9006-dc9304d85af9 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:05.271346584 +0000 UTC m=+6.098044051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j678d" (UniqueName: "kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d") pod "network-check-target-sp42h" (UID: "06a505d0-327f-4fef-9006-dc9304d85af9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:03.591735 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:03.591683    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:57:01 +0000 UTC" deadline="2028-04-09 02:54:47.037194785 +0000 UTC"
Aug 04 16:02:03.591735 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:03.591734    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14722h52m43.445466705s"
Aug 04 16:02:03.711536 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:03.711033    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:03.711536 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:03.711173    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:03.748643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:03.748605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" event={"ID":"39a7c3613bf8e5e7fd5e0d2f670dcc7b","Type":"ContainerStarted","Data":"b2cb6b1c5eb061a104a7e86e1a4df7f335b02a947919cdb8bc5a0c23db986808"}
Aug 04 16:02:04.711152 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:04.711116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:04.711566 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:04.711234    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:04.711639 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:04.711613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:04.711741 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:04.711710    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:05.188213 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:05.188176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:05.188397 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.188321    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:05.188397 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.188392    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs podName:42464805-3fb9-40f2-9568-3915547e0083 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:09.188375279 +0000 UTC m=+10.015072741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs") pod "network-metrics-daemon-d2m5z" (UID: "42464805-3fb9-40f2-9568-3915547e0083") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:05.289205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:05.289167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:05.289380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:05.289225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:05.289380 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.289338    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:05.289492 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.289404    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret podName:08cde35f-1da6-4574-8865-5bec253c3075 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:09.289379482 +0000 UTC m=+10.116076946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret") pod "global-pull-secret-syncer-zrvwr" (UID: "08cde35f-1da6-4574-8865-5bec253c3075") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:05.289828 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.289806    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:05.289828 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.289828    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:05.290050 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.289840    2563 projected.go:196] Error preparing data for projected volume kube-api-access-j678d for pod openshift-network-diagnostics/network-check-target-sp42h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:05.290050 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.289924    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d podName:06a505d0-327f-4fef-9006-dc9304d85af9 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:09.289867913 +0000 UTC m=+10.116565381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j678d" (UniqueName: "kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d") pod "network-check-target-sp42h" (UID: "06a505d0-327f-4fef-9006-dc9304d85af9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:05.712046 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:05.712015    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:05.712446 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:05.712167    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:06.711757 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:06.711723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:06.711948 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:06.711736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:06.711948 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:06.711855    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:06.712070 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:06.711959    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:07.711133 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:07.711099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:07.711275 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:07.711222    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:08.711346 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:08.711309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:08.711346 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:08.711342    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:08.711847 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:08.711438    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:08.711847 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:08.711558    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:09.216375 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:09.216341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:09.216559 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.216503    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:09.216622 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.216561    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs podName:42464805-3fb9-40f2-9568-3915547e0083 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:17.216543717 +0000 UTC m=+18.043241184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs") pod "network-metrics-daemon-d2m5z" (UID: "42464805-3fb9-40f2-9568-3915547e0083") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:09.317508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:09.317404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:09.317508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:09.317460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:09.317684 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.317563    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:09.317684 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.317622    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret podName:08cde35f-1da6-4574-8865-5bec253c3075 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:17.317604704 +0000 UTC m=+18.144302159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret") pod "global-pull-secret-syncer-zrvwr" (UID: "08cde35f-1da6-4574-8865-5bec253c3075") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:09.318086 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.318064    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:09.318086 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.318085    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:09.318220 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.318097    2563 projected.go:196] Error preparing data for projected volume kube-api-access-j678d for pod openshift-network-diagnostics/network-check-target-sp42h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:09.318220 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.318150    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d podName:06a505d0-327f-4fef-9006-dc9304d85af9 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:17.318132706 +0000 UTC m=+18.144830159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j678d" (UniqueName: "kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d") pod "network-check-target-sp42h" (UID: "06a505d0-327f-4fef-9006-dc9304d85af9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:09.711422 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:09.711388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:09.711927 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:09.711515    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:10.711253 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:10.711224    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:10.711390 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:10.711325    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:10.711611 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:10.711597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:10.711935 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:10.711661    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:11.710803 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:11.710625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:11.710803 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:11.710764    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:12.711676 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.711489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:12.712104 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.711518    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:12.712104 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:12.711771    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:12.712104 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:12.711874    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:12.774774 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.774740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7" event={"ID":"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d","Type":"ContainerStarted","Data":"78022aa8cf0bacba09007bd29df5d8cae57fe4218ad0f614a7fcff243c5741a8"}
Aug 04 16:02:12.777355 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.777318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lp2j4" event={"ID":"26f3738f-0609-49c7-bb0d-28275c0b4631","Type":"ContainerStarted","Data":"e1ed955b7bc9c5666545b6f948ceaad340075bedcd2f7c449a85586b728fa6d3"}
Aug 04 16:02:12.780960 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.780932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r9jf7" event={"ID":"eab8ef53-e32f-47d5-adac-9e05e28b3026","Type":"ContainerStarted","Data":"90d30e9a741037392ac957d98c926c7ab7261b26913fdd01491b2d27459cb535"}
Aug 04 16:02:12.784058 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.784033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" event={"ID":"39a7c3613bf8e5e7fd5e0d2f670dcc7b","Type":"ContainerStarted","Data":"562139764b8792e994ef4904abd029fcd4e19551f580b50c31f989a3915b404e"}
Aug 04 16:02:12.794012 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.793973    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lp2j4" podStartSLOduration=2.961313408 podStartE2EDuration="12.793959491s" totalImagesPullingTime="9.832646083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:12.793421146 +0000 UTC m=+13.620118617" watchObservedRunningTime="2026-08-04 16:02:12.793959491 +0000 UTC m=+13.620656960"
Aug 04 16:02:12.795560 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.795534    2563 generic.go:356] "Generic (PLEG): container finished" podID="6718bd51b27ca92571804b6ccc53294d" containerID="e3c26ba36078a9fc3d2cc1a7d7ee034c52abccad91e18457d24cd39dfb954987" exitCode=0
Aug 04 16:02:12.795655 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.795621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" event={"ID":"6718bd51b27ca92571804b6ccc53294d","Type":"ContainerDied","Data":"e3c26ba36078a9fc3d2cc1a7d7ee034c52abccad91e18457d24cd39dfb954987"}
Aug 04 16:02:12.798049 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.797998    2563 generic.go:356] "Generic (PLEG): container finished" podID="f630238c-046c-4a5c-8859-8213f8dcbb80" containerID="874dccecc31060849d5d1be6e2f5141989111059421973b75f92ed5ff1c7c943" exitCode=0
Aug 04 16:02:12.798705 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.798673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8n59" event={"ID":"f630238c-046c-4a5c-8859-8213f8dcbb80","Type":"ContainerDied","Data":"874dccecc31060849d5d1be6e2f5141989111059421973b75f92ed5ff1c7c943"}
Aug 04 16:02:12.801406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.801380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t6fwl" event={"ID":"293dd9e7-ba6f-4143-867b-190afd3ab76e","Type":"ContainerStarted","Data":"6f771af4530619d0be444b12553cfffab9839b9b78827282d17d542803eff0f3"}
Aug 04 16:02:12.804019 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.803997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ffvfl" event={"ID":"85981edc-7f69-4fff-a6cb-c4be69bcfa38","Type":"ContainerStarted","Data":"b5dba4fcf557256e0aa999375258dc11c939916df444cc839b79b673c10107a4"}
Aug 04 16:02:12.808242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.808204    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r9jf7" podStartSLOduration=3.972362686 podStartE2EDuration="12.80818751s" totalImagesPullingTime="8.835824824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:12.807717604 +0000 UTC m=+13.634415079" watchObservedRunningTime="2026-08-04 16:02:12.80818751 +0000 UTC m=+13.634885007"
Aug 04 16:02:12.826993 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.826948    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" podStartSLOduration=11.826931451 podStartE2EDuration="11.826931451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:12.826864768 +0000 UTC m=+13.653562241" watchObservedRunningTime="2026-08-04 16:02:12.826931451 +0000 UTC m=+13.653628924"
Aug 04 16:02:12.841155 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:12.840340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ffvfl" podStartSLOduration=5.479970238 podStartE2EDuration="12.840328328s" totalImagesPullingTime="7.36035809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:12.840257176 +0000 UTC m=+13.666954629" watchObservedRunningTime="2026-08-04 16:02:12.840328328 +0000 UTC m=+13.667025794"
Aug 04 16:02:13.018191 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.017958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:13.136306 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.136217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:13.171445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.171419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:13.172134 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.172115    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:13.186241 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.186197    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t6fwl" podStartSLOduration=3.388502159 podStartE2EDuration="13.186177858s" totalImagesPullingTime="9.797675699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:12.897427834 +0000 UTC m=+13.724125307" watchObservedRunningTime="2026-08-04 16:02:13.186177858 +0000 UTC m=+14.012875329"
Aug 04 16:02:13.710843 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.710816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:13.711007 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:13.710971    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:13.734838 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.734817    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 16:02:13.809802 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.809722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" event={"ID":"6718bd51b27ca92571804b6ccc53294d","Type":"ContainerStarted","Data":"631b9e97ef553a85f84fce30ea8af9a2719cd3c8eda4a6773b2604e869967adf"}
Aug 04 16:02:13.814253 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.814203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7" event={"ID":"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d","Type":"ContainerStarted","Data":"be3b953954159ef3a1f32d3a9c1934174be9908afd994180e62592da859c6dbe"}
Aug 04 16:02:13.817848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.817825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrxqs" event={"ID":"40831a24-9c15-4af4-a92f-f4d132ddd4fd","Type":"ContainerStarted","Data":"8853250aaf665531ceb7d1d24d2b5e449104b6727c5c6799a65ac71e56320c21"}
Aug 04 16:02:13.817979 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.817877    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:13.819667 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.819646    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ffvfl"
Aug 04 16:02:13.826404 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.826362    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" podStartSLOduration=12.826345419999999 podStartE2EDuration="12.82634542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:13.825297908 +0000 UTC m=+14.651995381" watchObservedRunningTime="2026-08-04 16:02:13.82634542 +0000 UTC m=+14.653042895"
Aug 04 16:02:13.840410 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.840340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hrxqs" podStartSLOduration=3.999735813 podStartE2EDuration="13.840323762s" totalImagesPullingTime="9.840587949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:13.839802711 +0000 UTC m=+14.666500185" watchObservedRunningTime="2026-08-04 16:02:13.840323762 +0000 UTC m=+14.667021237"
Aug 04 16:02:13.920058 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.919987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:13.991246 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:13.991177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:14.092991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:14.092833    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:14.616942 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:14.616593    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T16:02:13.734832153Z","UUID":"8bc2b793-ac1d-4af6-9fa4-5f24aa8be8d3","Handler":null,"Name":"","Endpoint":""}
Aug 04 16:02:14.618447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:14.618429    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 16:02:14.618555 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:14.618463    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 16:02:14.711162 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:14.711127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:14.711366 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:14.711263    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:14.711669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:14.711637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:14.711753 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:14.711737    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:15.711091 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:15.711061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:15.711734 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:15.711197    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:15.825652 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:15.825610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7" event={"ID":"9647486b-ba6f-4bf6-a6af-b2e1e51f2f0d","Type":"ContainerStarted","Data":"827d38cd073763778ee15bf2b6b07ab4d736830c416888f93f9f0e8e637b6570"}
Aug 04 16:02:15.845030 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:15.844968    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q54v7" podStartSLOduration=3.618786953 podStartE2EDuration="15.844947707s" totalImagesPullingTime="12.226160754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:15.844133621 +0000 UTC m=+16.670831094" watchObservedRunningTime="2026-08-04 16:02:15.844947707 +0000 UTC m=+16.671645180"
Aug 04 16:02:16.711637 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:16.711600    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:16.712163 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:16.711735    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:16.712163 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:16.712109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:16.712228 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:16.712197    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:16.791654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:16.791600    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:16.958589 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:16.958550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:17.289613 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:17.289572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:17.289790 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.289728    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:17.289852 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.289804    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs podName:42464805-3fb9-40f2-9568-3915547e0083 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:33.289783151 +0000 UTC m=+34.116480617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs") pod "network-metrics-daemon-d2m5z" (UID: "42464805-3fb9-40f2-9568-3915547e0083") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:17.390775 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:17.390741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:17.390962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:17.390802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:17.390962 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.390875    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:17.390962 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.390898    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:17.390962 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.390925    2563 projected.go:196] Error preparing data for projected volume kube-api-access-j678d for pod openshift-network-diagnostics/network-check-target-sp42h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:17.390962 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.390933    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:17.391166 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.390970    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d podName:06a505d0-327f-4fef-9006-dc9304d85af9 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:33.390956382 +0000 UTC m=+34.217653856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j678d" (UniqueName: "kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d") pod "network-check-target-sp42h" (UID: "06a505d0-327f-4fef-9006-dc9304d85af9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:17.391166 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.390986    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret podName:08cde35f-1da6-4574-8865-5bec253c3075 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:33.390979229 +0000 UTC m=+34.217676678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret") pod "global-pull-secret-syncer-zrvwr" (UID: "08cde35f-1da6-4574-8865-5bec253c3075") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:17.540817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:17.540736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:17.631273 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:17.631241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:17.711749 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:17.711720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:17.712166 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:17.711896    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:17.799986 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:17.799899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:18.711255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:18.711231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:18.711454 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:18.711232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:18.711454 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:18.711338    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:18.711454 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:18.711408    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:19.302262 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:19.302221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:19.402224 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:19.402189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:19.711704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:19.711627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:19.711846 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:19.711739    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:19.874413 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:19.874365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:20.710972 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:20.710922    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:20.711408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:20.710937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:20.711408 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:20.711056    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:20.711408 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:20.711147    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:21.061476 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:21.061440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:21.711255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:21.711221    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:21.711877 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:21.711346    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:22.711497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:22.711462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:22.711925 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:22.711469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:22.711925 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:22.711593    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:22.711925 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:22.711692    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:23.299143 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:23.299109    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:23.406620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:23.406586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:23.531660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:23.531625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:23.629996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:23.629928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:23.711672 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:23.711632    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:23.712137 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:23.711788    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:23.729573 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:23.729533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:23.831015 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:23.830979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:24.002433 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:24.002382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:24.095877 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:24.095841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:24.591428 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:24.591392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:24.711222 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:24.711190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:24.711389 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:24.711190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:24.711389 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:24.711324    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:24.711509 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:24.711463    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:25.000356 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:25.000315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:25.605794 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:25.605753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:25.711192 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:25.711163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:25.711340 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:25.711296    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:25.802530 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:25.802501    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lp2j4_26f3738f-0609-49c7-bb0d-28275c0b4631/dns-node-resolver/0.log"
Aug 04 16:02:25.996919 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:25.996881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:26.099425 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.099399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:26.395055 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.394860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:26.607507 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.607483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:26.711336 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.711314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:26.711469 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.711315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:26.711469 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:26.711407    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:26.711562 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:26.711480    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:26.802440 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.802419    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r9jf7_eab8ef53-e32f-47d5-adac-9e05e28b3026/node-ca/0.log"
Aug 04 16:02:26.851588 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.851559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"830105e7b0a836df75e4c5ced6c5a2d0f2f8864c754e96d1c0a36361c81e1752"}
Aug 04 16:02:26.851703 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.851628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"a5c167ab9aed39e5aa0eac61e685843b6939b98b5903cc97a8f3c8435e882953"}
Aug 04 16:02:26.851703 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.851677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"dfcbe75517c177a86179d2299bdc00e4352a344465568fee9d8abebbbaf846bc"}
Aug 04 16:02:26.851803 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.851714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"0173b4a4f65b83dddc89f81b6d743a6f493380095969628bb0e7db5e896039a6"}
Aug 04 16:02:26.851803 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.851759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"1203f2536a95a7f38c55f151c415f86d49775fa2e944bc737a9eb925a29f3496"}
Aug 04 16:02:26.851898 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.851808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"f85938d5a5a68ea7c1bf3759f1faee96d77768ee54946c973616476907d1d13e"}
Aug 04 16:02:26.853203 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.853178    2563 generic.go:356] "Generic (PLEG): container finished" podID="f630238c-046c-4a5c-8859-8213f8dcbb80" containerID="c242310e324a8e2eb10751b3dff71f5c31a22dd1a5cfc503e1f37819a0bc3c0c" exitCode=0
Aug 04 16:02:26.853294 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.853262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8n59" event={"ID":"f630238c-046c-4a5c-8859-8213f8dcbb80","Type":"ContainerDied","Data":"c242310e324a8e2eb10751b3dff71f5c31a22dd1a5cfc503e1f37819a0bc3c0c"}
Aug 04 16:02:26.854666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.854580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jksg4" event={"ID":"65e9a309-c1b2-41ea-a4dd-9eb493765007","Type":"ContainerStarted","Data":"8e19b6a149528875b36120b04ca2bf73b308d45cd97d045559a2ec2c3d34ed2d"}
Aug 04 16:02:26.914824 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.914631    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jksg4" podStartSLOduration=2.599681498 podStartE2EDuration="26.914612139s" totalImagesPullingTime="24.314930641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:26.913557507 +0000 UTC m=+27.740254978" watchObservedRunningTime="2026-08-04 16:02:26.914612139 +0000 UTC m=+27.741309611"
Aug 04 16:02:26.998414 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:26.998392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:27.200537 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:27.200507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:27.302004 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:27.301969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:27.711162 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:27.711135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:27.711279 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:27.711239    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:27.796203 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:27.796173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:27.858304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:27.858244    2563 generic.go:356] "Generic (PLEG): container finished" podID="f630238c-046c-4a5c-8859-8213f8dcbb80" containerID="9ba7f1f7d34237d81760160a10cce761267086b9f939f911f6733bef8566c3bb" exitCode=0
Aug 04 16:02:27.858424 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:27.858335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8n59" event={"ID":"f630238c-046c-4a5c-8859-8213f8dcbb80","Type":"ContainerDied","Data":"9ba7f1f7d34237d81760160a10cce761267086b9f939f911f6733bef8566c3bb"}
Aug 04 16:02:27.997668 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:27.997640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:28.098595 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.098569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:28.397151 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.397122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:28.603789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.603765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:28.711312 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.711289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:28.711401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.711319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:28.711443 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:28.711420    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:28.711531 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:28.711515    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:28.862551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.862513    2563 generic.go:356] "Generic (PLEG): container finished" podID="f630238c-046c-4a5c-8859-8213f8dcbb80" containerID="81dc6f13614ed34b4ca90541a0bfc96d62a4f36f75ec8bd8ec417797e7810920" exitCode=0
Aug 04 16:02:28.862713 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.862601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8n59" event={"ID":"f630238c-046c-4a5c-8859-8213f8dcbb80","Type":"ContainerDied","Data":"81dc6f13614ed34b4ca90541a0bfc96d62a4f36f75ec8bd8ec417797e7810920"}
Aug 04 16:02:28.869211 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.869189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"f04686214823794de982a526d2bd48dd0acbc7004e1c96179f035b38f53709d7"}
Aug 04 16:02:28.994630 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:28.994601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:29.134528 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:29.134500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:29.401808 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:29.401721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:29.579727 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:29.579698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:29.712052 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:29.711964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:29.712191 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:29.712074    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:30.198389 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.198356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:30.397519 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.397487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:30.711515 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.711485    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:30.711977 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.711486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:30.711977 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:30.711587    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:30.711977 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:30.711657    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:30.879526 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.878153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" event={"ID":"e26e6d03-7a0b-41dc-87df-227f9696ff3c","Type":"ContainerStarted","Data":"b0db1d36c7e98220cb160713ce05d1e0c6e80467c1801923d948cce63f123ca1"}
Aug 04 16:02:30.879526 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.879357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:30.879526 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.879478    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:30.879691 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.879575    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:30.898046 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.898023    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:30.898394 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.898377    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:02:30.911281 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:30.909677    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" podStartSLOduration=6.5981569 podStartE2EDuration="30.909652141s" totalImagesPullingTime="24.311495241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:30.906445976 +0000 UTC m=+31.733143459" watchObservedRunningTime="2026-08-04 16:02:30.909652141 +0000 UTC m=+31.736349614"
Aug 04 16:02:31.711509 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:31.711311    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:31.711665 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:31.711623    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:32.711591 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:32.711560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:32.711768 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:32.711569    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:32.711768 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:32.711659    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:32.711768 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:32.711750    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:33.309993 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:33.309964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:33.310250 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.310132    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:33.310250 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.310208    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs podName:42464805-3fb9-40f2-9568-3915547e0083 nodeName:}" failed. No retries permitted until 2026-08-04 16:03:05.31018823 +0000 UTC m=+66.136885683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs") pod "network-metrics-daemon-d2m5z" (UID: "42464805-3fb9-40f2-9568-3915547e0083") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:33.410694 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:33.410663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:33.410883 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:33.410718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:33.410883 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.410836    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:33.410883 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.410842    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:33.410883 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.410868    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:33.410883 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.410881    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret podName:08cde35f-1da6-4574-8865-5bec253c3075 nodeName:}" failed. No retries permitted until 2026-08-04 16:03:05.410866344 +0000 UTC m=+66.237563794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret") pod "global-pull-secret-syncer-zrvwr" (UID: "08cde35f-1da6-4574-8865-5bec253c3075") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:33.410883 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.410882    2563 projected.go:196] Error preparing data for projected volume kube-api-access-j678d for pod openshift-network-diagnostics/network-check-target-sp42h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:33.411245 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.410955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d podName:06a505d0-327f-4fef-9006-dc9304d85af9 nodeName:}" failed. No retries permitted until 2026-08-04 16:03:05.410937426 +0000 UTC m=+66.237634898 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j678d" (UniqueName: "kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d") pod "network-check-target-sp42h" (UID: "06a505d0-327f-4fef-9006-dc9304d85af9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:33.711320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:33.711244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:33.711482 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:33.711377    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:33.858690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:33.858661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:33.925972 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:33.925946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:34.000563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:34.000539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:34.711008 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:34.710925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:34.711167 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:34.710926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:34.711167 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:34.711050    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:34.711167 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:34.711093    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:34.889850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:34.889806    2563 generic.go:356] "Generic (PLEG): container finished" podID="f630238c-046c-4a5c-8859-8213f8dcbb80" containerID="c576d23e25dc28783e97e833815a647419417b37498f4da96df15721ded729c5" exitCode=0
Aug 04 16:02:34.890227 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:34.889855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8n59" event={"ID":"f630238c-046c-4a5c-8859-8213f8dcbb80","Type":"ContainerDied","Data":"c576d23e25dc28783e97e833815a647419417b37498f4da96df15721ded729c5"}
Aug 04 16:02:35.711381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:35.711349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:35.711538 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:35.711492    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:35.895133 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:35.895098    2563 generic.go:356] "Generic (PLEG): container finished" podID="f630238c-046c-4a5c-8859-8213f8dcbb80" containerID="49f604b8b4dbf813e343aceab847f53955c6271eed13bd051dbdf1686f9bcd79" exitCode=0
Aug 04 16:02:35.895503 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:35.895153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8n59" event={"ID":"f630238c-046c-4a5c-8859-8213f8dcbb80","Type":"ContainerDied","Data":"49f604b8b4dbf813e343aceab847f53955c6271eed13bd051dbdf1686f9bcd79"}
Aug 04 16:02:36.711577 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:36.711542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:36.711766 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:36.711643    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:36.711766 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:36.711694    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:36.711846 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:36.711786    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:36.900405 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:36.900373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8n59" event={"ID":"f630238c-046c-4a5c-8859-8213f8dcbb80","Type":"ContainerStarted","Data":"da447d209c8a52d022a52bef3e8ccca335c350309337d2ac9cb689970dd0eec0"}
Aug 04 16:02:36.926520 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:36.926474    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f8n59" podStartSLOduration=7.05559652 podStartE2EDuration="36.926460677s" totalImagesPullingTime="29.870864157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:36.92625528 +0000 UTC m=+37.752952752" watchObservedRunningTime="2026-08-04 16:02:36.926460677 +0000 UTC m=+37.753158149"
Aug 04 16:02:37.710952 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:37.710923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:37.711114 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:37.711025    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:38.711271 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:38.711246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:38.711622 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:38.711246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:38.711622 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:38.711340    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:38.711622 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:38.711423    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:39.711628 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:39.711600    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:39.711992 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:39.711681    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:40.711415 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:40.711387    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:40.711566 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:40.711387    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:40.711566 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:40.711475    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:40.711566 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:40.711550    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:41.602341 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:41.602309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:41.711666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:41.711623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:41.711804 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:41.711749    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:42.711431 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:42.711403    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:42.711776 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:42.711409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:42.711776 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:42.711491    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:42.711776 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:42.711564    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:43.711308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:43.711273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:43.711504 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:43.711376    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:44.710641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:44.710611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:44.710800 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:44.710611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:44.710800 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:44.710703    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:44.710800 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:44.710785    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:45.711622 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:45.711588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:45.712016 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:45.711726    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:46.711313 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:46.711286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:46.711486 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:46.711291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:46.711486 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:46.711374    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:46.711486 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:46.711449    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:47.711342 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:47.711316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:47.711718 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:47.711416    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:48.711586 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:48.711555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:48.711941 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:48.711642    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:48.711941 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:48.711694    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:48.711941 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:48.711772    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:49.714137 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:49.714110    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:49.714490 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:49.714197    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:50.297218 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:50.297184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:50.391330 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:50.391301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:50.488722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:50.488695    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:50.602291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:50.602227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:50.663078 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:50.663050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:50.710844 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:50.710822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:50.710960 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:50.710937    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:50.711020 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:50.710993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:50.711136 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:50.711118    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:51.016255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:51.016226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:51.116918 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:51.116889    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:51.413774 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:51.413712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:51.475498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:51.475474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:51.713648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:51.713590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:51.713830 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:51.713685    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:52.710974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:52.710942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:52.711387 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:52.710950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:52.711387 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:52.711031    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:52.711387 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:52.711148    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:53.711620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:53.711588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:53.712087 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:53.711720    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:54.710734 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:54.710705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:54.710994 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:54.710704    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:54.710994 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:54.710805    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:54.710994 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:54.710862    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:54.802578 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:54.802550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:55.614213 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:55.614178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:02:55.711544 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:55.711515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:55.711686 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:55.711638    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:56.711514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:56.711487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:56.711891 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:56.711492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:56.711891 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:56.711576    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:56.711891 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:56.711661    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:57.711506 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:57.711466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:57.711696 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:57.711574    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:02:58.710840 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:58.710810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:02:58.711028 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:58.710895    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:02:58.711028 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:58.710811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:02:58.711028 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:58.710971    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:02:59.712347 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:02:59.712201    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:02:59.712782 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:02:59.712403    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:00.711594 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:00.711569    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:00.711770 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:00.711569    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:00.711770 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:00.711661    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:00.711770 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:00.711745    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:01.041634 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:01.041603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:01.145791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:01.145767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:01.711636 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:01.711609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:01.711781 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:01.711706    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:02.710641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:02.710610    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:02.711012 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:02.710673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:02.711012 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:02.710729    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:02.711012 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:02.710838    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:02.893586 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:02.893543    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" podUID="e26e6d03-7a0b-41dc-87df-227f9696ff3c" containerName="ovnkube-controller" probeResult="failure" output=""
Aug 04 16:03:03.649491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:03.649458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:03.711584 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:03.711561    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:03.711935 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:03.711671    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:04.711344 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:04.711321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:04.711517 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:04.711407    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:04.711517 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:04.711459    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:04.711598 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:04.711538    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:05.350364 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:05.350333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:05.350523 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.350424    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:03:05.350523 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.350474    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs podName:42464805-3fb9-40f2-9568-3915547e0083 nodeName:}" failed. No retries permitted until 2026-08-04 16:04:09.350459798 +0000 UTC m=+130.177157248 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs") pod "network-metrics-daemon-d2m5z" (UID: "42464805-3fb9-40f2-9568-3915547e0083") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:03:05.450611 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:05.450569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:05.450611 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:05.450617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:05.450808 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.450720    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:03:05.450808 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.450722    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:03:05.450808 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.450741    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:03:05.450808 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.450750    2563 projected.go:196] Error preparing data for projected volume kube-api-access-j678d for pod openshift-network-diagnostics/network-check-target-sp42h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:03:05.450808 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.450768    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret podName:08cde35f-1da6-4574-8865-5bec253c3075 nodeName:}" failed. No retries permitted until 2026-08-04 16:04:09.450756139 +0000 UTC m=+130.277453588 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret") pod "global-pull-secret-syncer-zrvwr" (UID: "08cde35f-1da6-4574-8865-5bec253c3075") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:03:05.450808 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.450789    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d podName:06a505d0-327f-4fef-9006-dc9304d85af9 nodeName:}" failed. No retries permitted until 2026-08-04 16:04:09.450776485 +0000 UTC m=+130.277473935 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j678d" (UniqueName: "kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d") pod "network-check-target-sp42h" (UID: "06a505d0-327f-4fef-9006-dc9304d85af9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:03:05.711327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:05.711243    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:05.711457 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:05.711359    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:06.710824 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:06.710778    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:06.711223 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:06.710782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:06.711223 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:06.710892    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:06.711223 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:06.710980    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:07.713817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:07.713792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:07.714181 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:07.713886    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:08.326622 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:08.326586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:08.711101 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:08.711019    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:08.711101 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:08.711052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:08.711282 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:08.711137    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:08.711282 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:08.711215    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:09.711928 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:09.711874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:09.712431 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:09.712015    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:10.710888 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:10.710856    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:10.711074 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:10.710957    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:10.711074 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:10.711012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:10.711153 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:10.711092    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:11.098330 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:11.098297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:11.711206 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:11.711176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:11.711385 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:11.711279    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:11.974392 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:11.974315    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:03:11.974392 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:11.974351    2563 generic.go:356] "Generic (PLEG): container finished" podID="65e9a309-c1b2-41ea-a4dd-9eb493765007" containerID="8e19b6a149528875b36120b04ca2bf73b308d45cd97d045559a2ec2c3d34ed2d" exitCode=1
Aug 04 16:03:11.974573 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:11.974393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jksg4" event={"ID":"65e9a309-c1b2-41ea-a4dd-9eb493765007","Type":"ContainerDied","Data":"8e19b6a149528875b36120b04ca2bf73b308d45cd97d045559a2ec2c3d34ed2d"}
Aug 04 16:03:11.974711 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:11.974699    2563 scope.go:117] "RemoveContainer" containerID="8e19b6a149528875b36120b04ca2bf73b308d45cd97d045559a2ec2c3d34ed2d"
Aug 04 16:03:12.711098 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:12.711063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:12.711716 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:12.711154    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:12.711716 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:12.711073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:12.711716 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:12.711212    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:12.725034 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:12.724997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:12.978501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:12.978435    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:03:12.978634 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:12.978510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jksg4" event={"ID":"65e9a309-c1b2-41ea-a4dd-9eb493765007","Type":"ContainerStarted","Data":"3fec4b67b35746c0fa3d3ce4238ad724aaec5bb5bf5fd19726941bfd755b306d"}
Aug 04 16:03:13.711726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:13.711697    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:13.712212 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:13.711810    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:14.710937 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:14.710887    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:14.711102 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:14.710920    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:14.711102 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:14.711011    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:14.711102 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:14.711056    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:15.711709 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:15.711683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:15.712112 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:15.711787    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:16.710636 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:16.710608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:16.710636 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:16.710626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:16.710848 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:16.710771    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:16.710848 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:16.710812    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:17.710996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:17.710968    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:17.711356 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:17.711063    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:18.711579 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:18.711532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:18.712049 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:18.711536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:18.712049 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:18.711744    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:18.712049 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:18.711640    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:19.712151 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:19.712121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:19.712515 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:19.712245    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:20.711270 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:20.711241    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:20.711270 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:20.711278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:20.711469 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:20.711353    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:20.711469 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:20.711388    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:21.711346 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:21.711315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:21.711798 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:21.711445    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:22.710765 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:22.710735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:22.711051 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:22.710840    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:22.711051 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:22.710889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:22.711051 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:22.710986    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:23.711357 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:23.711331    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:23.711719 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:23.711426    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:24.711014 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:24.710984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:24.711014 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:24.710984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:24.711222 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:24.711197    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:24.711340 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:24.711318    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:25.711026 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:25.710999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:25.711477 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:25.711096    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:26.081629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:26.081601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:26.710793 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:26.710765    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:26.710973 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:26.710765    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:26.710973 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:26.710854    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:26.710973 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:26.710959    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:27.529865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:27.529837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:27.607690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:27.607668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:27.711076 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:27.711051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:27.711393 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:27.711153    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:28.711124 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:28.711092    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:28.711124 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:28.711122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:28.711535 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:28.711210    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:28.711535 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:28.711369    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:29.717603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:29.712474    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:29.717603 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:29.712567    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:30.711234 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:30.711201    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:30.711430 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:30.711200    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:30.711430 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:30.711296    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:30.711430 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:30.711364    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:31.710967 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:31.710937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:31.711425 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:31.711059    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:32.710919 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:32.710890    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:32.711101 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:32.710893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:32.711101 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:32.710999    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:32.711493 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:32.711224    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:32.893243 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:32.893212    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw" podUID="e26e6d03-7a0b-41dc-87df-227f9696ff3c" containerName="ovnkube-controller" probeResult="failure" output=""
Aug 04 16:03:33.711556 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:33.711524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:33.712033 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:33.711660    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:34.711239 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:34.711191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:34.711239 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:34.711225    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:34.711451 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:34.711316    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:34.711451 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:34.711428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:35.713583 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:35.713555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:35.713954 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:35.713651    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:36.711518 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:36.711484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:36.711518 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:36.711484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:36.711759 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:36.711732    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:36.711841 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:36.711825    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:37.133703 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:37.133658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:37.203801 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:37.203770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:37.713832 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:37.713808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:37.714033 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:37.713922    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:38.711278 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:38.711250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:38.711278 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:38.711264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:38.711693 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:38.711483    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:38.711693 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:38.711591    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:39.715552 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:39.715526    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:39.715948 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:39.715613    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:40.711244 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:40.711212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:40.711442 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:40.711298    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:40.711442 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:40.711299    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:40.711442 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:40.711394    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:41.711270 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:41.711235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:41.711659 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:41.711355    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:41.970294 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:41.970214    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:42.048653 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.048622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:42.185336 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.185290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:42.281535 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.281509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:42.343062 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.343036    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:42.711858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.711669    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:42.712259 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.711667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:42.712259 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:42.711980    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:42.712259 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:42.712080    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:42.927935 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.927597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d2m5z"]
Aug 04 16:03:42.927935 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.927720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:42.927935 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:42.927839    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:42.928569 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.928501    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sp42h"]
Aug 04 16:03:42.929399 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:42.929380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrvwr"]
Aug 04 16:03:43.047753 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:43.047721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:43.047753 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:43.047754    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:43.048001 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:43.047838    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:43.048001 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:43.047936    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:44.711156 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:44.711126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:44.711502 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:44.711136    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:44.711502 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:44.711226    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:44.711502 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:44.711237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:44.711502 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:44.711297    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:44.711502 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:44.711351    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:44.934304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:44.934274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:45.034219 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:45.034192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:45.492035 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:45.491997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:45.559014 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:45.558986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:45.740495 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:45.740467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:46.710892 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:46.710862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:46.710892 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:46.710895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:46.711112 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:46.710930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:46.711112 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:46.711009    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrvwr" podUID="08cde35f-1da6-4574-8865-5bec253c3075"
Aug 04 16:03:46.711112 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:46.711051    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sp42h" podUID="06a505d0-327f-4fef-9006-dc9304d85af9"
Aug 04 16:03:46.711210 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:03:46.711147    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2m5z" podUID="42464805-3fb9-40f2-9568-3915547e0083"
Aug 04 16:03:46.957937 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:46.957889    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:47.028749 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.028714    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:47.314633 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.314557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r9jf7_eab8ef53-e32f-47d5-adac-9e05e28b3026/node-ca/0.log"
Aug 04 16:03:47.498328 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.498303    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeReady"
Aug 04 16:03:47.498488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.498433    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 16:03:47.550424 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.550399    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dhktx"]
Aug 04 16:03:47.552810 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.552796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.555723 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.555702    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 16:03:47.555855 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.555754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d2pjg\""
Aug 04 16:03:47.556050 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.556036    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 16:03:47.558783 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.558762    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2dlw2"]
Aug 04 16:03:47.563367 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.563348    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2dlw2"
Aug 04 16:03:47.566878 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.566816    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 16:03:47.566878 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.566840    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 16:03:47.566878 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.566821    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 16:03:47.567078 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.566988    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-svsf8\""
Aug 04 16:03:47.568680 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.568595    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dhktx"]
Aug 04 16:03:47.573053 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.573035    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2dlw2"]
Aug 04 16:03:47.576194 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.576176    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xf4q5"]
Aug 04 16:03:47.579034 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.579019    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.581028 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.580993    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 16:03:47.581112 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.581028    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 16:03:47.581184 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.581130    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 16:03:47.581243 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.581209    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 16:03:47.581355 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.581341    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-svpvj\""
Aug 04 16:03:47.591273 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.591216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xf4q5"]
Aug 04 16:03:47.651595 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.651567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c47be4d2-196c-493b-86f3-819c7e6ea17c-tmp-dir\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.651722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.651604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c47be4d2-196c-493b-86f3-819c7e6ea17c-config-volume\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.651722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.651626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c47be4d2-196c-493b-86f3-819c7e6ea17c-metrics-tls\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.651722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.651663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpnkv\" (UniqueName: \"kubernetes.io/projected/c47be4d2-196c-493b-86f3-819c7e6ea17c-kube-api-access-xpnkv\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.752782 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.752756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzlv\" (UniqueName: \"kubernetes.io/projected/470e83d0-1df7-499f-9dd6-09945419b418-kube-api-access-ptzlv\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.752920 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.752791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c47be4d2-196c-493b-86f3-819c7e6ea17c-tmp-dir\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.752920 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.752819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c47be4d2-196c-493b-86f3-819c7e6ea17c-config-volume\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.752920 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.752883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4db545ec-a482-42cf-a717-17bcee6c145a-cert\") pod \"ingress-canary-2dlw2\" (UID: \"4db545ec-a482-42cf-a717-17bcee6c145a\") " pod="openshift-ingress-canary/ingress-canary-2dlw2"
Aug 04 16:03:47.753027 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.752936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c47be4d2-196c-493b-86f3-819c7e6ea17c-metrics-tls\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.753068 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.753050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpnkv\" (UniqueName: \"kubernetes.io/projected/c47be4d2-196c-493b-86f3-819c7e6ea17c-kube-api-access-xpnkv\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.753098 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.753080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/470e83d0-1df7-499f-9dd6-09945419b418-crio-socket\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.753151 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.753137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/470e83d0-1df7-499f-9dd6-09945419b418-data-volume\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.753185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.753176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdn7\" (UniqueName: \"kubernetes.io/projected/4db545ec-a482-42cf-a717-17bcee6c145a-kube-api-access-rfdn7\") pod \"ingress-canary-2dlw2\" (UID: \"4db545ec-a482-42cf-a717-17bcee6c145a\") " pod="openshift-ingress-canary/ingress-canary-2dlw2"
Aug 04 16:03:47.753228 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.753200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/470e83d0-1df7-499f-9dd6-09945419b418-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.753228 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.753218    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c47be4d2-196c-493b-86f3-819c7e6ea17c-tmp-dir\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.753313 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.753246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/470e83d0-1df7-499f-9dd6-09945419b418-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.753396 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.753382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c47be4d2-196c-493b-86f3-819c7e6ea17c-config-volume\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.757100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.757077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c47be4d2-196c-493b-86f3-819c7e6ea17c-metrics-tls\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.760768 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.760747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpnkv\" (UniqueName: \"kubernetes.io/projected/c47be4d2-196c-493b-86f3-819c7e6ea17c-kube-api-access-xpnkv\") pod \"dns-default-dhktx\" (UID: \"c47be4d2-196c-493b-86f3-819c7e6ea17c\") " pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.854380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/470e83d0-1df7-499f-9dd6-09945419b418-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.854380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzlv\" (UniqueName: \"kubernetes.io/projected/470e83d0-1df7-499f-9dd6-09945419b418-kube-api-access-ptzlv\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.854553 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4db545ec-a482-42cf-a717-17bcee6c145a-cert\") pod \"ingress-canary-2dlw2\" (UID: \"4db545ec-a482-42cf-a717-17bcee6c145a\") " pod="openshift-ingress-canary/ingress-canary-2dlw2"
Aug 04 16:03:47.854553 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/470e83d0-1df7-499f-9dd6-09945419b418-crio-socket\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.854553 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/470e83d0-1df7-499f-9dd6-09945419b418-data-volume\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.854695 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdn7\" (UniqueName: \"kubernetes.io/projected/4db545ec-a482-42cf-a717-17bcee6c145a-kube-api-access-rfdn7\") pod \"ingress-canary-2dlw2\" (UID: \"4db545ec-a482-42cf-a717-17bcee6c145a\") " pod="openshift-ingress-canary/ingress-canary-2dlw2"
Aug 04 16:03:47.854695 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/470e83d0-1df7-499f-9dd6-09945419b418-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.854695 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/470e83d0-1df7-499f-9dd6-09945419b418-crio-socket\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.854853 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/470e83d0-1df7-499f-9dd6-09945419b418-data-volume\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.854968 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.854949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/470e83d0-1df7-499f-9dd6-09945419b418-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.856836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.856809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/470e83d0-1df7-499f-9dd6-09945419b418-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.856970 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.856869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4db545ec-a482-42cf-a717-17bcee6c145a-cert\") pod \"ingress-canary-2dlw2\" (UID: \"4db545ec-a482-42cf-a717-17bcee6c145a\") " pod="openshift-ingress-canary/ingress-canary-2dlw2"
Aug 04 16:03:47.862384 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.862361    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzlv\" (UniqueName: \"kubernetes.io/projected/470e83d0-1df7-499f-9dd6-09945419b418-kube-api-access-ptzlv\") pod \"insights-runtime-extractor-xf4q5\" (UID: \"470e83d0-1df7-499f-9dd6-09945419b418\") " pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:47.862755 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.862735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdn7\" (UniqueName: \"kubernetes.io/projected/4db545ec-a482-42cf-a717-17bcee6c145a-kube-api-access-rfdn7\") pod \"ingress-canary-2dlw2\" (UID: \"4db545ec-a482-42cf-a717-17bcee6c145a\") " pod="openshift-ingress-canary/ingress-canary-2dlw2"
Aug 04 16:03:47.865519 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.865504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:47.872705 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.872692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2dlw2"
Aug 04 16:03:47.886598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:47.886577    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xf4q5"
Aug 04 16:03:48.028152 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.027883    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dhktx"]
Aug 04 16:03:48.029122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.029099    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2dlw2"]
Aug 04 16:03:48.035164 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.035085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xf4q5"]
Aug 04 16:03:48.038224 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:03:48.038204    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470e83d0_1df7_499f_9dd6_09945419b418.slice/crio-fe74493982f621df09eaf38f98267d3c40e38eba0c68f0be19bd992b6becb017 WatchSource:0}: Error finding container fe74493982f621df09eaf38f98267d3c40e38eba0c68f0be19bd992b6becb017: Status 404 returned error can't find the container with id fe74493982f621df09eaf38f98267d3c40e38eba0c68f0be19bd992b6becb017
Aug 04 16:03:48.060456 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.060433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xf4q5" event={"ID":"470e83d0-1df7-499f-9dd6-09945419b418","Type":"ContainerStarted","Data":"fe74493982f621df09eaf38f98267d3c40e38eba0c68f0be19bd992b6becb017"}
Aug 04 16:03:48.061440 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.061421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2dlw2" event={"ID":"4db545ec-a482-42cf-a717-17bcee6c145a","Type":"ContainerStarted","Data":"4a5e49e16d5baaca8669b0be764121c38c70cbca9fe275f874cb8b9561ff765e"}
Aug 04 16:03:48.062420 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.062400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dhktx" event={"ID":"c47be4d2-196c-493b-86f3-819c7e6ea17c","Type":"ContainerStarted","Data":"95e515e1750702ff2b8d3c9f680c5e4a7ed55f84b99668972c0a9415ab9bd42c"}
Aug 04 16:03:48.710852 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.710813    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:03:48.711035 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.710821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:03:48.711035 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.711027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:03:48.714017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.713991    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv4gp\""
Aug 04 16:03:48.714017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.714012    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 16:03:48.714208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.714016    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 16:03:48.714208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.714056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 16:03:48.714208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.713992    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb5nq\""
Aug 04 16:03:48.714208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:48.714017    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 16:03:49.067519 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:49.067490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xf4q5" event={"ID":"470e83d0-1df7-499f-9dd6-09945419b418","Type":"ContainerStarted","Data":"113a940b73525d6265e961c5f298c5cca625df5984548febdad419ebd6166063"}
Aug 04 16:03:49.778381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:49.778347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:49.920067 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:49.920037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:50.072417 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:50.072334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xf4q5" event={"ID":"470e83d0-1df7-499f-9dd6-09945419b418","Type":"ContainerStarted","Data":"46e627de8143eaeffd97117d62fbc87fe87c4cb107bdf1ca271373f814148ba4"}
Aug 04 16:03:51.076674 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:51.076630    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2dlw2" event={"ID":"4db545ec-a482-42cf-a717-17bcee6c145a","Type":"ContainerStarted","Data":"c9d2cfed71da5d42269316a93527efdaf30eb7e045a9878be53d17029e585220"}
Aug 04 16:03:51.095627 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:51.095574    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2dlw2" podStartSLOduration=1.736573335 podStartE2EDuration="4.095551218s" totalImagesPullingTime="2.358977883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:03:51.094931655 +0000 UTC m=+111.921629142" watchObservedRunningTime="2026-08-04 16:03:51.095551218 +0000 UTC m=+111.922248691"
Aug 04 16:03:52.080494 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:52.080463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dhktx" event={"ID":"c47be4d2-196c-493b-86f3-819c7e6ea17c","Type":"ContainerStarted","Data":"5a7e6318b54101439f409758583d6b7ff6598bf98cb7bec91e636e31fdda912f"}
Aug 04 16:03:52.085383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:52.085349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xf4q5" event={"ID":"470e83d0-1df7-499f-9dd6-09945419b418","Type":"ContainerStarted","Data":"bcf5136122b270a375cef534e9fea088a08be16fba7527aacbfebcf480456f4d"}
Aug 04 16:03:52.111868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:52.111814    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xf4q5" podStartSLOduration=1.373761719 podStartE2EDuration="5.111797544s" totalImagesPullingTime="3.738035825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:03:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:03:52.111480188 +0000 UTC m=+112.938177685" watchObservedRunningTime="2026-08-04 16:03:52.111797544 +0000 UTC m=+112.938495018"
Aug 04 16:03:53.089980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:53.089945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dhktx" event={"ID":"c47be4d2-196c-493b-86f3-819c7e6ea17c","Type":"ContainerStarted","Data":"14d35c4fb792afe6060ff2a9a846566af5c344cfa0b77ac38f443342ac307249"}
Aug 04 16:03:53.090393 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:53.090060    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dhktx"
Aug 04 16:03:53.110807 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:53.110761    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dhktx" podStartSLOduration=2.22113935 podStartE2EDuration="6.110748326s" totalImagesPullingTime="3.889608976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:03:53.110193688 +0000 UTC m=+113.936891161" watchObservedRunningTime="2026-08-04 16:03:53.110748326 +0000 UTC m=+113.937445795"
Aug 04 16:03:54.971199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:54.971159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:55.071712 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:55.071672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:55.170803 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:55.170775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:56.278174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:56.278140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:56.346150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:56.346123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:56.695742 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:56.695669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:56.796812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:56.796781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:56.896889 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:56.896857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:57.721703 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:57.721671    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tjhw"
Aug 04 16:03:57.881517 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:57.881479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:57.950335 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:03:57.950302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:01.326828 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:01.326796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:01.876718 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:01.876685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:01.975873 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:01.975846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:02.807015 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:02.806977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:02.922738 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:02.922707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:03.094109 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:03.094034    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dhktx"
Aug 04 16:04:03.203170 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:03.203147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:03.302090 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:03.302063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:03.460820 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:03.460739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:03.767864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:03.767833    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:04.071188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:04.071057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:04.175876 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:04.175843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:05.626073 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.626038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:05.850508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.850474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:05.880936 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.880857    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"]
Aug 04 16:04:05.886408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.886391    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:05.888597 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.888578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pgtv4\""
Aug 04 16:04:05.888788 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.888776    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 04 16:04:05.889173 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.889156    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 16:04:05.889173 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.889168    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 04 16:04:05.889318 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.889190    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 16:04:05.889318 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.889269    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 16:04:05.899950 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.896643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"]
Aug 04 16:04:05.907376 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.907350    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"]
Aug 04 16:04:05.911126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.911107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:05.913379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.913362    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 04 16:04:05.913475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.913397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bgg2j\""
Aug 04 16:04:05.913644 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.913628    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 04 16:04:05.914461 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.914447    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 04 16:04:05.928743 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.928721    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"]
Aug 04 16:04:05.943453 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.943431    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bm6fk"]
Aug 04 16:04:05.947002 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.946986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.947308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.947273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:05.949292 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.949277    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 16:04:05.949292 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.949284    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 16:04:05.949612 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.949597    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j6txb\""
Aug 04 16:04:05.949669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.949614    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 16:04:05.984155 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:05.984287 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:05.984287 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-tls\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.984287 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:05.984287 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-metrics-client-ca\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.984287 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848c5969-bbc8-403f-b791-1bf4c66b8b98-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:05.984483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klkbl\" (UniqueName: \"kubernetes.io/projected/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-kube-api-access-klkbl\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.984483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-accelerators-collector-config\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.984483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/511e2d45-4eee-4bda-a97f-646fdbe71609-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:05.984483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:05.984483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-textfile\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.984483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.984683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-wtmp\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.984683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hndth\" (UniqueName: \"kubernetes.io/projected/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-api-access-hndth\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:05.984683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:05.984683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-sys\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:05.984683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/848c5969-bbc8-403f-b791-1bf4c66b8b98-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:05.984683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5hb5\" (UniqueName: \"kubernetes.io/projected/511e2d45-4eee-4bda-a97f-646fdbe71609-kube-api-access-t5hb5\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:05.984683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:05.984632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-root\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085167 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-tls\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085167 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.085365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-metrics-client-ca\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848c5969-bbc8-403f-b791-1bf4c66b8b98-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.085365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klkbl\" (UniqueName: \"kubernetes.io/projected/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-kube-api-access-klkbl\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-accelerators-collector-config\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/511e2d45-4eee-4bda-a97f-646fdbe71609-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.085365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.085365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-textfile\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-wtmp\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hndth\" (UniqueName: \"kubernetes.io/projected/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-api-access-hndth\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-sys\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/848c5969-bbc8-403f-b791-1bf4c66b8b98-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5hb5\" (UniqueName: \"kubernetes.io/projected/511e2d45-4eee-4bda-a97f-646fdbe71609-kube-api-access-t5hb5\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-root\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.085708 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.085993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-accelerators-collector-config\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.086003    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848c5969-bbc8-403f-b791-1bf4c66b8b98-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.086040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-metrics-client-ca\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.086051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/848c5969-bbc8-403f-b791-1bf4c66b8b98-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.086072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-root\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:04:06.086101    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.086113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-sys\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:04:06.086154    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-tls podName:511e2d45-4eee-4bda-a97f-646fdbe71609 nodeName:}" failed. No retries permitted until 2026-08-04 16:04:06.586136866 +0000 UTC m=+127.412834333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-pfhxv" (UID: "511e2d45-4eee-4bda-a97f-646fdbe71609") : secret "openshift-state-metrics-tls" not found
Aug 04 16:04:06.086242 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:04:06.086225    2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Aug 04 16:04:06.086684 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:04:06.086297    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-tls podName:848c5969-bbc8-403f-b791-1bf4c66b8b98 nodeName:}" failed. No retries permitted until 2026-08-04 16:04:06.586281714 +0000 UTC m=+127.412979179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-6qhq6" (UID: "848c5969-bbc8-403f-b791-1bf4c66b8b98") : secret "kube-state-metrics-tls" not found
Aug 04 16:04:06.086684 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.086492    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-textfile\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.086684 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.086524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/511e2d45-4eee-4bda-a97f-646fdbe71609-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.086814 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.086628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-wtmp\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.087070 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.087046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.088771 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.088746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.088889 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.088841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.088979 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.088894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-tls\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.088979 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.088955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.099655 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.099632    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klkbl\" (UniqueName: \"kubernetes.io/projected/6f770f5a-b792-4b2c-8379-0a518b4f4fa4-kube-api-access-klkbl\") pod \"node-exporter-bm6fk\" (UID: \"6f770f5a-b792-4b2c-8379-0a518b4f4fa4\") " pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.102817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.102789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5hb5\" (UniqueName: \"kubernetes.io/projected/511e2d45-4eee-4bda-a97f-646fdbe71609-kube-api-access-t5hb5\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.103236 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.103219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hndth\" (UniqueName: \"kubernetes.io/projected/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-api-access-hndth\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.173605 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.173525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:06.254956 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.254928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bm6fk"
Aug 04 16:04:06.267302 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:04:06.267279    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f770f5a_b792_4b2c_8379_0a518b4f4fa4.slice/crio-3adb7946660f6c0c07a6ef7a0deac6912aed650559f05e027f9efaac42a4b61c WatchSource:0}: Error finding container 3adb7946660f6c0c07a6ef7a0deac6912aed650559f05e027f9efaac42a4b61c: Status 404 returned error can't find the container with id 3adb7946660f6c0c07a6ef7a0deac6912aed650559f05e027f9efaac42a4b61c
Aug 04 16:04:06.590823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.590781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.590823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.590832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.593286 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.593256    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/848c5969-bbc8-403f-b791-1bf4c66b8b98-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-6qhq6\" (UID: \"848c5969-bbc8-403f-b791-1bf4c66b8b98\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.593408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.593310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/511e2d45-4eee-4bda-a97f-646fdbe71609-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-pfhxv\" (UID: \"511e2d45-4eee-4bda-a97f-646fdbe71609\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.794980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.794936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"
Aug 04 16:04:06.819825 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.819795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"
Aug 04 16:04:06.936087 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.936057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv"]
Aug 04 16:04:06.939008 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:04:06.938977    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511e2d45_4eee_4bda_a97f_646fdbe71609.slice/crio-3052bf3c11dbf01ddbd4d0cc0a86371cbef645df51c90379c9aa8b680f2404da WatchSource:0}: Error finding container 3052bf3c11dbf01ddbd4d0cc0a86371cbef645df51c90379c9aa8b680f2404da: Status 404 returned error can't find the container with id 3052bf3c11dbf01ddbd4d0cc0a86371cbef645df51c90379c9aa8b680f2404da
Aug 04 16:04:06.958415 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.958393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6"]
Aug 04 16:04:06.965951 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:04:06.965893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848c5969_bbc8_403f_b791_1bf4c66b8b98.slice/crio-f2ddfa82ea52cbff9c39c293053b2ad59a981fdde75dfe4c3d6babcbcbedc68d WatchSource:0}: Error finding container f2ddfa82ea52cbff9c39c293053b2ad59a981fdde75dfe4c3d6babcbcbedc68d: Status 404 returned error can't find the container with id f2ddfa82ea52cbff9c39c293053b2ad59a981fdde75dfe4c3d6babcbcbedc68d
Aug 04 16:04:06.988450 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.988423    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:04:06.997408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:06.997390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.000858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.000610    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 16:04:07.000858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.000634    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 16:04:07.000858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.000678    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 16:04:07.000858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.000611    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 16:04:07.000858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.000612    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 16:04:07.000858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.000845    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 16:04:07.001230 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.000889    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 16:04:07.001286 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.001228    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hghml\""
Aug 04 16:04:07.001346 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.001304    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 16:04:07.011863 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.011839    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 16:04:07.018279 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.018237    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:04:07.095207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-volume\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095441 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-out\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095441 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-web-config\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095441 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c8r6\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-kube-api-access-8c8r6\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095564 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095600 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095630 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095740 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095694    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.095740 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.095719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.133704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.133677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv" event={"ID":"511e2d45-4eee-4bda-a97f-646fdbe71609","Type":"ContainerStarted","Data":"1745eeed0929f16b3f844d84291b766c307f57bc35783b064432b626409bb944"}
Aug 04 16:04:07.133812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.133768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv" event={"ID":"511e2d45-4eee-4bda-a97f-646fdbe71609","Type":"ContainerStarted","Data":"17c646aa8e438242bc819f1d01a250056e6670fe65797cff648428de7eb1ab6e"}
Aug 04 16:04:07.133812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.133799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv" event={"ID":"511e2d45-4eee-4bda-a97f-646fdbe71609","Type":"ContainerStarted","Data":"3052bf3c11dbf01ddbd4d0cc0a86371cbef645df51c90379c9aa8b680f2404da"}
Aug 04 16:04:07.134607 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.134591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6" event={"ID":"848c5969-bbc8-403f-b791-1bf4c66b8b98","Type":"ContainerStarted","Data":"f2ddfa82ea52cbff9c39c293053b2ad59a981fdde75dfe4c3d6babcbcbedc68d"}
Aug 04 16:04:07.135629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.135607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bm6fk" event={"ID":"6f770f5a-b792-4b2c-8379-0a518b4f4fa4","Type":"ContainerStarted","Data":"3adb7946660f6c0c07a6ef7a0deac6912aed650559f05e027f9efaac42a4b61c"}
Aug 04 16:04:07.196032 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196303 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:04:07.196247    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Aug 04 16:04:07.196493 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:04:07.196315    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls podName:7de4baea-9835-4d7a-8a2d-12de24ea59be nodeName:}" failed. No retries permitted until 2026-08-04 16:04:07.69629658 +0000 UTC m=+128.522994031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be") : secret "alertmanager-main-tls" not found
Aug 04 16:04:07.196564 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-volume\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196627 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196627 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-out\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-web-config\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.196726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c8r6\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-kube-api-access-8c8r6\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.197040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.196568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.197552 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.197523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.197682 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.197560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.199497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.199430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-volume\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.199580 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.199515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.199647 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.199596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.199756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.199735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.199950 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.199899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.200175 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.200154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-out\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.200258 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.200172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.200310 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.200286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-web-config\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.219974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.219953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c8r6\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-kube-api-access-8c8r6\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.700812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.700782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.703372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.703342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.897812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.897781    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5df457cb99-cm26z"]
Aug 04 16:04:07.901554 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.901525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:07.903923 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.903882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 04 16:04:07.904098 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.903974    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3for65qso67rh\""
Aug 04 16:04:07.904098 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.904054    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 04 16:04:07.904098 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.903882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 04 16:04:07.904263 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.904232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 04 16:04:07.904263 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.904237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 04 16:04:07.904346 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.904311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xkfwb\""
Aug 04 16:04:07.909420 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.909353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:04:07.915037 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:07.914665    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5df457cb99-cm26z"]
Aug 04 16:04:08.002663 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.002629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.002807 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.002677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzkg\" (UniqueName: \"kubernetes.io/projected/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-kube-api-access-jlzkg\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.002807 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.002749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-tls\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.002807 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.002777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-metrics-client-ca\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.002991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.002806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.002991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.002831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-grpc-tls\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.002991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.002863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.002991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.002900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.066578 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.066549    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:04:08.104346 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.104314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.104346 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.104346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzkg\" (UniqueName: \"kubernetes.io/projected/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-kube-api-access-jlzkg\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.104533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.104381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-tls\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.104533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.104396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-metrics-client-ca\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.104533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.104507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.104690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.104534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-grpc-tls\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.104690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.104562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.104690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.104601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.105245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.105195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-metrics-client-ca\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.107626 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.107598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.108290 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.107835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-grpc-tls\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.108290 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.108055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.108290 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.108144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-tls\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.108519 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.108499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.108566 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.108503    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.112060 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.112041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzkg\" (UniqueName: \"kubernetes.io/projected/8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a-kube-api-access-jlzkg\") pod \"thanos-querier-5df457cb99-cm26z\" (UID: \"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a\") " pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.213355 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.213313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:08.254042 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:04:08.254010    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de4baea_9835_4d7a_8a2d_12de24ea59be.slice/crio-91cde706492760fb32b45c73adf73d7e877ba9ba1586b13a81ae551c5b0d76a2 WatchSource:0}: Error finding container 91cde706492760fb32b45c73adf73d7e877ba9ba1586b13a81ae551c5b0d76a2: Status 404 returned error can't find the container with id 91cde706492760fb32b45c73adf73d7e877ba9ba1586b13a81ae551c5b0d76a2
Aug 04 16:04:08.386551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.386517    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5df457cb99-cm26z"]
Aug 04 16:04:08.389772 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:04:08.389744    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab5d2cd_477a_4d6e_a56f_b57c4f633e9a.slice/crio-47fcced91149c8ca0b02299cb4ce5f9ee53b3015bcd4944a8e76d69e9ecaf4d6 WatchSource:0}: Error finding container 47fcced91149c8ca0b02299cb4ce5f9ee53b3015bcd4944a8e76d69e9ecaf4d6: Status 404 returned error can't find the container with id 47fcced91149c8ca0b02299cb4ce5f9ee53b3015bcd4944a8e76d69e9ecaf4d6
Aug 04 16:04:08.581064 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.581008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:08.682078 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.682048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:08.853685 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.853605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:08.939276 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:08.939246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:09.142668 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.142599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerStarted","Data":"91cde706492760fb32b45c73adf73d7e877ba9ba1586b13a81ae551c5b0d76a2"}
Aug 04 16:04:09.143629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.143603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z" event={"ID":"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a","Type":"ContainerStarted","Data":"47fcced91149c8ca0b02299cb4ce5f9ee53b3015bcd4944a8e76d69e9ecaf4d6"}
Aug 04 16:04:09.145413 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.145390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv" event={"ID":"511e2d45-4eee-4bda-a97f-646fdbe71609","Type":"ContainerStarted","Data":"9dae3b4af4fd07327b7a5fcb5ce8b6bf3d0ac63fa1615db7687bf1e0586f680a"}
Aug 04 16:04:09.167575 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.166338    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-pfhxv" podStartSLOduration=2.912474273 podStartE2EDuration="4.166320202s" totalImagesPullingTime="1.253845929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:09.164694926 +0000 UTC m=+129.991392401" watchObservedRunningTime="2026-08-04 16:04:09.166320202 +0000 UTC m=+129.993017676"
Aug 04 16:04:09.416043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.415960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:04:09.418433 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.418411    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 16:04:09.428655 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.428635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42464805-3fb9-40f2-9568-3915547e0083-metrics-certs\") pod \"network-metrics-daemon-d2m5z\" (UID: \"42464805-3fb9-40f2-9568-3915547e0083\") " pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:04:09.517269 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.517233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:04:09.517423 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.517302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:04:09.519532 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.519513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 16:04:09.519623 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.519581    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 16:04:09.530157 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.530132    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 16:04:09.530490 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.530468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08cde35f-1da6-4574-8865-5bec253c3075-original-pull-secret\") pod \"global-pull-secret-syncer-zrvwr\" (UID: \"08cde35f-1da6-4574-8865-5bec253c3075\") " pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:04:09.541161 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.541140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j678d\" (UniqueName: \"kubernetes.io/projected/06a505d0-327f-4fef-9006-dc9304d85af9-kube-api-access-j678d\") pod \"network-check-target-sp42h\" (UID: \"06a505d0-327f-4fef-9006-dc9304d85af9\") " pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:04:09.726607 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.726539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv4gp\""
Aug 04 16:04:09.732551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.732522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb5nq\""
Aug 04 16:04:09.734890 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.734874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2m5z"
Aug 04 16:04:09.737111 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.737092    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrvwr"
Aug 04 16:04:09.741988 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.741972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:04:09.886884 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:09.886861    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d2m5z"]
Aug 04 16:04:09.921317 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:04:09.921283    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42464805_3fb9_40f2_9568_3915547e0083.slice/crio-29e4f8ad88a7586ceba32232c616b86536e6fd2b4f53e1dc84ad0264f87c9be9 WatchSource:0}: Error finding container 29e4f8ad88a7586ceba32232c616b86536e6fd2b4f53e1dc84ad0264f87c9be9: Status 404 returned error can't find the container with id 29e4f8ad88a7586ceba32232c616b86536e6fd2b4f53e1dc84ad0264f87c9be9
Aug 04 16:04:10.104662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.104633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sp42h"]
Aug 04 16:04:10.111771 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.111746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrvwr"]
Aug 04 16:04:10.121811 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:04:10.121782    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a505d0_327f_4fef_9006_dc9304d85af9.slice/crio-64a8cec2f6e46f4d4c8f68965d7bf3ff1ed8f837768a6cffab6c48ec629cb72b WatchSource:0}: Error finding container 64a8cec2f6e46f4d4c8f68965d7bf3ff1ed8f837768a6cffab6c48ec629cb72b: Status 404 returned error can't find the container with id 64a8cec2f6e46f4d4c8f68965d7bf3ff1ed8f837768a6cffab6c48ec629cb72b
Aug 04 16:04:10.122447 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:04:10.122424    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cde35f_1da6_4574_8865_5bec253c3075.slice/crio-a05c27d4efd94bf824d8e38eb10dced87cb61c2111028081dbeb57c44a196bb1 WatchSource:0}: Error finding container a05c27d4efd94bf824d8e38eb10dced87cb61c2111028081dbeb57c44a196bb1: Status 404 returned error can't find the container with id a05c27d4efd94bf824d8e38eb10dced87cb61c2111028081dbeb57c44a196bb1
Aug 04 16:04:10.149679 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.149651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sp42h" event={"ID":"06a505d0-327f-4fef-9006-dc9304d85af9","Type":"ContainerStarted","Data":"64a8cec2f6e46f4d4c8f68965d7bf3ff1ed8f837768a6cffab6c48ec629cb72b"}
Aug 04 16:04:10.151166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.151142    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f770f5a-b792-4b2c-8379-0a518b4f4fa4" containerID="596bd5c308c19713c2da893c58c4e0c8907dbb44786e511527f97a2795d525ee" exitCode=0
Aug 04 16:04:10.151264 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.151222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bm6fk" event={"ID":"6f770f5a-b792-4b2c-8379-0a518b4f4fa4","Type":"ContainerDied","Data":"596bd5c308c19713c2da893c58c4e0c8907dbb44786e511527f97a2795d525ee"}
Aug 04 16:04:10.152483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.152464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d2m5z" event={"ID":"42464805-3fb9-40f2-9568-3915547e0083","Type":"ContainerStarted","Data":"29e4f8ad88a7586ceba32232c616b86536e6fd2b4f53e1dc84ad0264f87c9be9"}
Aug 04 16:04:10.153641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.153620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrvwr" event={"ID":"08cde35f-1da6-4574-8865-5bec253c3075","Type":"ContainerStarted","Data":"a05c27d4efd94bf824d8e38eb10dced87cb61c2111028081dbeb57c44a196bb1"}
Aug 04 16:04:10.366671 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.366634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:10.426157 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.426116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:10.672311 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.672277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:10.739378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.739300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:10.803979 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.803944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:10.906473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:10.906439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:11.162216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:11.162182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bm6fk" event={"ID":"6f770f5a-b792-4b2c-8379-0a518b4f4fa4","Type":"ContainerStarted","Data":"7337f785e9a438c6e9bd31a69fcba0ce5504778cb1323cef9fd70143548b6fba"}
Aug 04 16:04:11.162659 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:11.162238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bm6fk" event={"ID":"6f770f5a-b792-4b2c-8379-0a518b4f4fa4","Type":"ContainerStarted","Data":"7ee4e6225f913812e8c59be49852c65899690d2caa9545df72c143b77db0fd6d"}
Aug 04 16:04:11.191615 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:11.191567    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bm6fk" podStartSLOduration=2.46477048 podStartE2EDuration="6.191545652s" totalImagesPullingTime="3.655929432s" totalInitContainerRuntime="70.84574ms" isStatefulPod=true podCreationTimestamp="2026-08-04 16:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:11.190354801 +0000 UTC m=+132.017052267" watchObservedRunningTime="2026-08-04 16:04:11.191545652 +0000 UTC m=+132.018243126"
Aug 04 16:04:12.130129 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:12.130091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:12.176710 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:12.176681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6" event={"ID":"848c5969-bbc8-403f-b791-1bf4c66b8b98","Type":"ContainerStarted","Data":"4ab4d218b3902c26da58177f8ac9b101cb5c48f2c397a081fba53e5ae82e4cf6"}
Aug 04 16:04:12.177100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:12.176749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6" event={"ID":"848c5969-bbc8-403f-b791-1bf4c66b8b98","Type":"ContainerStarted","Data":"bae9cbd07772ce9342b7edcd7973c1b4047fc653bcf609db38c62dfd07da6096"}
Aug 04 16:04:12.177100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:12.176781    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6" event={"ID":"848c5969-bbc8-403f-b791-1bf4c66b8b98","Type":"ContainerStarted","Data":"80864d4cc221ae87a5008fd8f054e65d9a34b055584f66cf5e4a4db7b82d2c8f"}
Aug 04 16:04:12.183380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:12.182658    2563 generic.go:356] "Generic (PLEG): container finished" podID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerID="2873b15d042732ff2c1228df77878fe4a0472e3134001be099902a6fa930ee12" exitCode=0
Aug 04 16:04:12.183380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:12.182765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerDied","Data":"2873b15d042732ff2c1228df77878fe4a0472e3134001be099902a6fa930ee12"}
Aug 04 16:04:12.200421 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:12.199531    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-6qhq6" podStartSLOduration=2.979726459 podStartE2EDuration="7.199510293s" totalImagesPullingTime="4.219783834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:12.198289214 +0000 UTC m=+133.024986687" watchObservedRunningTime="2026-08-04 16:04:12.199510293 +0000 UTC m=+133.026207767"
Aug 04 16:04:13.189833 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:13.189798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d2m5z" event={"ID":"42464805-3fb9-40f2-9568-3915547e0083","Type":"ContainerStarted","Data":"ab12efc312e62faa1d792adbc0d551e050b02792a08626fb695bd4658ac5acfa"}
Aug 04 16:04:13.190369 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:13.189859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d2m5z" event={"ID":"42464805-3fb9-40f2-9568-3915547e0083","Type":"ContainerStarted","Data":"283c3ad49ca16838e345a04752f4111c80235e2142f21edf6c7344a2c4a0a16e"}
Aug 04 16:04:13.206041 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:13.205986    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d2m5z" podStartSLOduration=131.062682902 podStartE2EDuration="2m13.205965315s" totalImagesPullingTime="2.143282413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:13.204496675 +0000 UTC m=+134.031194148" watchObservedRunningTime="2026-08-04 16:04:13.205965315 +0000 UTC m=+134.032662788"
Aug 04 16:04:13.389818 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:13.389783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:13.468123 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:13.468046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:14.195687 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:14.195655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sp42h" event={"ID":"06a505d0-327f-4fef-9006-dc9304d85af9","Type":"ContainerStarted","Data":"616d20b8388655f0790c73855778cb26e167da2464bfed39206a8c4071b6c611"}
Aug 04 16:04:14.196095 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:14.195718    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:04:14.198560 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:14.198536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z" event={"ID":"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a","Type":"ContainerStarted","Data":"a8d8b03682323afeb10b39f15f3f11447cf698106a097d43e34d5ec08ff518b3"}
Aug 04 16:04:14.198671 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:14.198617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z" event={"ID":"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a","Type":"ContainerStarted","Data":"e3d7e9a5e53d1f39f422bf77f1a8b941706ebe3400b5628489e2a449084415df"}
Aug 04 16:04:14.215511 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:14.215450    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sp42h" podStartSLOduration=130.340428441 podStartE2EDuration="2m14.215410587s" totalImagesPullingTime="3.874982146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:14.214797923 +0000 UTC m=+135.041495397" watchObservedRunningTime="2026-08-04 16:04:14.215410587 +0000 UTC m=+135.042108059"
Aug 04 16:04:15.204271 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:15.204231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z" event={"ID":"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a","Type":"ContainerStarted","Data":"882ffc3a87b5c6340ea0caaf100e37ed4649ee18f792694dea7cc07b09059e9a"}
Aug 04 16:04:16.211755 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:16.211715    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z" event={"ID":"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a","Type":"ContainerStarted","Data":"ef13bc959743388e27455362548f97b100531d19cfd56ee32d0c30ebab8f5bea"}
Aug 04 16:04:16.212246 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:16.211795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z" event={"ID":"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a","Type":"ContainerStarted","Data":"4b4a3206e93e3e030aca8143ede40531ac7f5730bced427725e419dfe225eb3e"}
Aug 04 16:04:16.212246 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:16.211848    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:16.212246 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:16.211890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z" event={"ID":"8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a","Type":"ContainerStarted","Data":"8b9c52ca11a5bbe73434aa432146e8299a25c3976ffad3b6a5a86348fc1e7ef8"}
Aug 04 16:04:16.239961 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:16.239883    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z" podStartSLOduration=2.536616676 podStartE2EDuration="9.239866149s" totalImagesPullingTime="6.703249473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:04:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:16.239035175 +0000 UTC m=+137.065732647" watchObservedRunningTime="2026-08-04 16:04:16.239866149 +0000 UTC m=+137.066563621"
Aug 04 16:04:17.807895 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:17.807862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:17.881715 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:17.881689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:18.222231 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:18.222143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrvwr" event={"ID":"08cde35f-1da6-4574-8865-5bec253c3075","Type":"ContainerStarted","Data":"45209e1a9ffcd80fecc08f49096a79b9a317c5b0a190dde4c022c761af1174c2"}
Aug 04 16:04:19.229055 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:19.229023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerStarted","Data":"3fcfb4a50d8b3435fbdc147452de7d257023fd835c34667b241b67e5acaf9863"}
Aug 04 16:04:19.229396 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:19.229104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerStarted","Data":"440b99ff9e13f98386952842cf33b1540427b0972a5bc2379afd8338bebe73f6"}
Aug 04 16:04:19.229396 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:19.229153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerStarted","Data":"1295939cddd763a51f535959c9d1fff30cc6921e8f6773c032090110e545a06e"}
Aug 04 16:04:20.235899 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:20.235865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerStarted","Data":"8506840cc88ae52e9bd34f3e916bf391b0fc4c0bef4faa9d553259c69c35e49d"}
Aug 04 16:04:20.236353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:20.235961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerStarted","Data":"c1e53731cac74b28745f49a1b2b380d848534e27b4b47167812f0fd73633c28c"}
Aug 04 16:04:20.236353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:20.236014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerStarted","Data":"6c15fbab44626253bd799d043b72f6876bd4bdc27aeb89abc066a2788f6927eb"}
Aug 04 16:04:20.267026 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:20.266977    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zrvwr" podStartSLOduration=132.95586512 podStartE2EDuration="2m20.26696125s" totalImagesPullingTime="7.31109613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:18.241017306 +0000 UTC m=+139.067714786" watchObservedRunningTime="2026-08-04 16:04:20.26696125 +0000 UTC m=+141.093658716"
Aug 04 16:04:20.268253 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:20.268207    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.475610644 podStartE2EDuration="14.268194991s" totalImagesPullingTime="9.773103758s" totalInitContainerRuntime="19.480589ms" isStatefulPod=false podCreationTimestamp="2026-08-04 16:04:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:20.265690584 +0000 UTC m=+141.092388057" watchObservedRunningTime="2026-08-04 16:04:20.268194991 +0000 UTC m=+141.094892460"
Aug 04 16:04:21.410542 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:21.410508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:21.511286 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:21.511257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:21.580764 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:21.580741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:04:22.224114 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:22.224088    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5df457cb99-cm26z"
Aug 04 16:04:45.207160 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:04:45.207125    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sp42h"
Aug 04 16:05:14.762514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:14.762478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:14.865330 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:14.865252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:25.191232 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:25.191201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:25.688893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:25.688858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:26.259063 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.259029    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:05:26.259564 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.259510    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="alertmanager" containerID="cri-o://1295939cddd763a51f535959c9d1fff30cc6921e8f6773c032090110e545a06e" gracePeriod=120
Aug 04 16:05:26.259732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.259568    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy-metric" containerID="cri-o://c1e53731cac74b28745f49a1b2b380d848534e27b4b47167812f0fd73633c28c" gracePeriod=120
Aug 04 16:05:26.259732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.259602    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy" containerID="cri-o://6c15fbab44626253bd799d043b72f6876bd4bdc27aeb89abc066a2788f6927eb" gracePeriod=120
Aug 04 16:05:26.259732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.259616    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy-web" containerID="cri-o://3fcfb4a50d8b3435fbdc147452de7d257023fd835c34667b241b67e5acaf9863" gracePeriod=120
Aug 04 16:05:26.259732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.259571    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="prom-label-proxy" containerID="cri-o://8506840cc88ae52e9bd34f3e916bf391b0fc4c0bef4faa9d553259c69c35e49d" gracePeriod=120
Aug 04 16:05:26.259732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.259685    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="config-reloader" containerID="cri-o://440b99ff9e13f98386952842cf33b1540427b0972a5bc2379afd8338bebe73f6" gracePeriod=120
Aug 04 16:05:26.466643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466611    2563 generic.go:356] "Generic (PLEG): container finished" podID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerID="8506840cc88ae52e9bd34f3e916bf391b0fc4c0bef4faa9d553259c69c35e49d" exitCode=0
Aug 04 16:05:26.466643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466637    2563 generic.go:356] "Generic (PLEG): container finished" podID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerID="c1e53731cac74b28745f49a1b2b380d848534e27b4b47167812f0fd73633c28c" exitCode=0
Aug 04 16:05:26.466643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466643    2563 generic.go:356] "Generic (PLEG): container finished" podID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerID="6c15fbab44626253bd799d043b72f6876bd4bdc27aeb89abc066a2788f6927eb" exitCode=0
Aug 04 16:05:26.466643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466651    2563 generic.go:356] "Generic (PLEG): container finished" podID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerID="3fcfb4a50d8b3435fbdc147452de7d257023fd835c34667b241b67e5acaf9863" exitCode=0
Aug 04 16:05:26.466870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466657    2563 generic.go:356] "Generic (PLEG): container finished" podID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerID="440b99ff9e13f98386952842cf33b1540427b0972a5bc2379afd8338bebe73f6" exitCode=0
Aug 04 16:05:26.466870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466662    2563 generic.go:356] "Generic (PLEG): container finished" podID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerID="1295939cddd763a51f535959c9d1fff30cc6921e8f6773c032090110e545a06e" exitCode=0
Aug 04 16:05:26.466870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerDied","Data":"8506840cc88ae52e9bd34f3e916bf391b0fc4c0bef4faa9d553259c69c35e49d"}
Aug 04 16:05:26.466870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerDied","Data":"c1e53731cac74b28745f49a1b2b380d848534e27b4b47167812f0fd73633c28c"}
Aug 04 16:05:26.466870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerDied","Data":"6c15fbab44626253bd799d043b72f6876bd4bdc27aeb89abc066a2788f6927eb"}
Aug 04 16:05:26.466870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerDied","Data":"3fcfb4a50d8b3435fbdc147452de7d257023fd835c34667b241b67e5acaf9863"}
Aug 04 16:05:26.466870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerDied","Data":"440b99ff9e13f98386952842cf33b1540427b0972a5bc2379afd8338bebe73f6"}
Aug 04 16:05:26.467110 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.466886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerDied","Data":"1295939cddd763a51f535959c9d1fff30cc6921e8f6773c032090110e545a06e"}
Aug 04 16:05:26.504411 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.504387    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:26.592580 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-web\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.592580 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-web-config\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.592580 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592567    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-out\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.592848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592585    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-trusted-ca-bundle\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.592848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.592848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592639    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-main-db\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.592848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592793    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-tls-assets\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.592848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592839    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c8r6\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-kube-api-access-8c8r6\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592869    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-cluster-tls-config\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592928    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-metrics-client-ca\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592960    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.592957    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.593002    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-volume\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.593006    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.593029    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7de4baea-9835-4d7a-8a2d-12de24ea59be\" (UID: \"7de4baea-9835-4d7a-8a2d-12de24ea59be\") "
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.593258    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-main-db\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.593188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.593284    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.595793 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.595765    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:26.596604 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.596576    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:26.596604 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.596607    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-out" (OuterVolumeSpecName: "config-out") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:05:26.597027 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.597005    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:26.597126 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.597098    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:26.597339 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.597312    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:26.597461 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.597431    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:26.597642 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.597623    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-kube-api-access-8c8r6" (OuterVolumeSpecName: "kube-api-access-8c8r6") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "kube-api-access-8c8r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:26.597953 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.597933    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-volume" (OuterVolumeSpecName: "config-volume") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:26.600377 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.600275    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:26.606878 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.606857    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-web-config" (OuterVolumeSpecName: "web-config") pod "7de4baea-9835-4d7a-8a2d-12de24ea59be" (UID: "7de4baea-9835-4d7a-8a2d-12de24ea59be"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:26.694072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694046    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-tls-assets\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694069    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c8r6\" (UniqueName: \"kubernetes.io/projected/7de4baea-9835-4d7a-8a2d-12de24ea59be-kube-api-access-8c8r6\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694079    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-cluster-tls-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694088    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7de4baea-9835-4d7a-8a2d-12de24ea59be-metrics-client-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694097    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-main-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694105    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694115    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694123    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694133    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-web-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694140    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7de4baea-9835-4d7a-8a2d-12de24ea59be-config-out\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:26.694255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:26.694148    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7de4baea-9835-4d7a-8a2d-12de24ea59be-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:05:27.473603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.473566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7de4baea-9835-4d7a-8a2d-12de24ea59be","Type":"ContainerDied","Data":"91cde706492760fb32b45c73adf73d7e877ba9ba1586b13a81ae551c5b0d76a2"}
Aug 04 16:05:27.474000 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.473615    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.474000 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.473676    2563 scope.go:117] "RemoveContainer" containerID="8506840cc88ae52e9bd34f3e916bf391b0fc4c0bef4faa9d553259c69c35e49d"
Aug 04 16:05:27.482158 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.482137    2563 scope.go:117] "RemoveContainer" containerID="c1e53731cac74b28745f49a1b2b380d848534e27b4b47167812f0fd73633c28c"
Aug 04 16:05:27.488841 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.488823    2563 scope.go:117] "RemoveContainer" containerID="6c15fbab44626253bd799d043b72f6876bd4bdc27aeb89abc066a2788f6927eb"
Aug 04 16:05:27.495407 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.495387    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:05:27.495594 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.495577    2563 scope.go:117] "RemoveContainer" containerID="3fcfb4a50d8b3435fbdc147452de7d257023fd835c34667b241b67e5acaf9863"
Aug 04 16:05:27.501369 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.501337    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:05:27.502992 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.502974    2563 scope.go:117] "RemoveContainer" containerID="440b99ff9e13f98386952842cf33b1540427b0972a5bc2379afd8338bebe73f6"
Aug 04 16:05:27.509574 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.509557    2563 scope.go:117] "RemoveContainer" containerID="1295939cddd763a51f535959c9d1fff30cc6921e8f6773c032090110e545a06e"
Aug 04 16:05:27.516258 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.516241    2563 scope.go:117] "RemoveContainer" containerID="2873b15d042732ff2c1228df77878fe4a0472e3134001be099902a6fa930ee12"
Aug 04 16:05:27.531445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531425    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:05:27.531682 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531671    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy-metric"
Aug 04 16:05:27.531722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531684    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy-metric"
Aug 04 16:05:27.531722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531699    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy-web"
Aug 04 16:05:27.531722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531706    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy-web"
Aug 04 16:05:27.531722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531716    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="alertmanager"
Aug 04 16:05:27.531722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531721    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="alertmanager"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531731    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="config-reloader"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531736    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="config-reloader"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531743    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531749    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531755    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="init-config-reloader"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531760    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="init-config-reloader"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531768    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="prom-label-proxy"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531777    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="prom-label-proxy"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531821    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy-web"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531828    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531834    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="config-reloader"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531840    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="alertmanager"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531847    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="kube-rbac-proxy-metric"
Aug 04 16:05:27.531865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.531855    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" containerName="prom-label-proxy"
Aug 04 16:05:27.535124 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.535108    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.537379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537341    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 16:05:27.537379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537355    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 16:05:27.537379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537345    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 16:05:27.537620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537404    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 16:05:27.537620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537435    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 16:05:27.537620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537407    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hghml\""
Aug 04 16:05:27.537620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537469    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 16:05:27.537816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 16:05:27.537816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.537755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 16:05:27.543455 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.543433    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 16:05:27.551312 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.551292    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:05:27.601329 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb295ce-71cd-4259-8c16-66cd689ea14b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5887\" (UniqueName: \"kubernetes.io/projected/fdb295ce-71cd-4259-8c16-66cd689ea14b-kube-api-access-b5887\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb295ce-71cd-4259-8c16-66cd689ea14b-config-out\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdb295ce-71cd-4259-8c16-66cd689ea14b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdb295ce-71cd-4259-8c16-66cd689ea14b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-web-config\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.601902 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.601703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb295ce-71cd-4259-8c16-66cd689ea14b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.702662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-web-config\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.702662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb295ce-71cd-4259-8c16-66cd689ea14b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.702868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb295ce-71cd-4259-8c16-66cd689ea14b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.702868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.702868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5887\" (UniqueName: \"kubernetes.io/projected/fdb295ce-71cd-4259-8c16-66cd689ea14b-kube-api-access-b5887\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.702868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb295ce-71cd-4259-8c16-66cd689ea14b-config-out\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.702868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.702868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.703200 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.702883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.703200 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.703128    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb295ce-71cd-4259-8c16-66cd689ea14b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.703200 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.703179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdb295ce-71cd-4259-8c16-66cd689ea14b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.703340 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.703224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdb295ce-71cd-4259-8c16-66cd689ea14b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.703340 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.703267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.703340 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.703296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.706120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.706041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb295ce-71cd-4259-8c16-66cd689ea14b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.706120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.706049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdb295ce-71cd-4259-8c16-66cd689ea14b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.706461 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.706221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.706461 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.706239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdb295ce-71cd-4259-8c16-66cd689ea14b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.706461 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.706292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.706622 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.706572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb295ce-71cd-4259-8c16-66cd689ea14b-config-out\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.706744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.706694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.706981 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.706959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.707049 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.707038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.707155 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.707135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-web-config\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.708063 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.708041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdb295ce-71cd-4259-8c16-66cd689ea14b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.711740 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.711717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5887\" (UniqueName: \"kubernetes.io/projected/fdb295ce-71cd-4259-8c16-66cd689ea14b-kube-api-access-b5887\") pod \"alertmanager-main-0\" (UID: \"fdb295ce-71cd-4259-8c16-66cd689ea14b\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.716456 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.716435    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de4baea-9835-4d7a-8a2d-12de24ea59be" path="/var/lib/kubelet/pods/7de4baea-9835-4d7a-8a2d-12de24ea59be/volumes"
Aug 04 16:05:27.843647 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.843577    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 16:05:27.985562 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:27.985441    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 16:05:27.990207 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:05:27.990178    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb295ce_71cd_4259_8c16_66cd689ea14b.slice/crio-0cd684efd48bec838bca91384e6235fe896a5f2f5ee1f132f6ab50f6dc2d7494 WatchSource:0}: Error finding container 0cd684efd48bec838bca91384e6235fe896a5f2f5ee1f132f6ab50f6dc2d7494: Status 404 returned error can't find the container with id 0cd684efd48bec838bca91384e6235fe896a5f2f5ee1f132f6ab50f6dc2d7494
Aug 04 16:05:28.478321 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:28.478281    2563 generic.go:356] "Generic (PLEG): container finished" podID="fdb295ce-71cd-4259-8c16-66cd689ea14b" containerID="e77a6f4da3f55e3d886b1422666c4512dc2289d991aa2b03d5beca5cadecd216" exitCode=0
Aug 04 16:05:28.478702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:28.478369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb295ce-71cd-4259-8c16-66cd689ea14b","Type":"ContainerDied","Data":"e77a6f4da3f55e3d886b1422666c4512dc2289d991aa2b03d5beca5cadecd216"}
Aug 04 16:05:28.478702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:28.478490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb295ce-71cd-4259-8c16-66cd689ea14b","Type":"ContainerStarted","Data":"0cd684efd48bec838bca91384e6235fe896a5f2f5ee1f132f6ab50f6dc2d7494"}
Aug 04 16:05:29.486811 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:29.486781    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb295ce-71cd-4259-8c16-66cd689ea14b","Type":"ContainerStarted","Data":"a6a94d71c1b0517a2d0021ba3d2e0470156fbfb3e7eb15e0f16bee3f9605dff9"}
Aug 04 16:05:29.487207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:29.486841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb295ce-71cd-4259-8c16-66cd689ea14b","Type":"ContainerStarted","Data":"0f646fbbf85342300a6e0857f365fed5b8b5cc63e31571861d70cfa6a1fe8a9a"}
Aug 04 16:05:29.487207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:29.486877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb295ce-71cd-4259-8c16-66cd689ea14b","Type":"ContainerStarted","Data":"3ebaeb0b0fd4e1d5e3644051721d38515b023b80bf88e07e4bd0253c6c19178f"}
Aug 04 16:05:29.487207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:29.486923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb295ce-71cd-4259-8c16-66cd689ea14b","Type":"ContainerStarted","Data":"d0a1e8015f95a3482ca50174a5ceaa5a646c0d8bc56dccf7ba14dd2d418a5d65"}
Aug 04 16:05:29.487207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:29.486949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb295ce-71cd-4259-8c16-66cd689ea14b","Type":"ContainerStarted","Data":"1b5f044bb0ffe5448ff1ef16bd93a21820a5a738fa0d1c30abad9c1751c00ed8"}
Aug 04 16:05:29.487207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:29.486972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb295ce-71cd-4259-8c16-66cd689ea14b","Type":"ContainerStarted","Data":"191c044e651fd5319232185542861853fe005d7d9447af8cd784eac5e2d3fd41"}
Aug 04 16:05:29.516689 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:29.516643    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.500775322 podStartE2EDuration="2.516627792s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.85247ms" isStatefulPod=false podCreationTimestamp="2026-08-04 16:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:05:29.51561296 +0000 UTC m=+210.342310432" watchObservedRunningTime="2026-08-04 16:05:29.516627792 +0000 UTC m=+210.343325257"
Aug 04 16:05:30.326186 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.326152    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65b4f6984d-49pqc"]
Aug 04 16:05:30.328554 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.328533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.333802 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.333782    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 04 16:05:30.333939 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.333894    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 04 16:05:30.334438 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.334421    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 04 16:05:30.334657 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.334638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xzn65\""
Aug 04 16:05:30.334720 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.334701    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 04 16:05:30.337626 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.337607    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 04 16:05:30.341517 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.341501    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 04 16:05:30.348934 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.348899    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65b4f6984d-49pqc"]
Aug 04 16:05:30.420334 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.420303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-telemeter-client-tls\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.420492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.420349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-serving-certs-ca-bundle\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.420492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.420370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-metrics-client-ca\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.420492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.420430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-federate-client-tls\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.420492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.420458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.420492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.420480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-secret-telemeter-client\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.420674 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.420498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.420674 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.420520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc6xp\" (UniqueName: \"kubernetes.io/projected/4c53fb4f-7a32-44ed-8edd-0cd456b49050-kube-api-access-rc6xp\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.521442 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.521412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-serving-certs-ca-bundle\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.521866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.521448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-metrics-client-ca\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.521866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.521494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-federate-client-tls\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.521866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.521524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.521866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.521555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-secret-telemeter-client\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.521866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.521587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.521866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.521619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc6xp\" (UniqueName: \"kubernetes.io/projected/4c53fb4f-7a32-44ed-8edd-0cd456b49050-kube-api-access-rc6xp\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.521866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.521654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-telemeter-client-tls\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.522255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.522234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-serving-certs-ca-bundle\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.522569 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.522546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-metrics-client-ca\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.523309 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.523280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c53fb4f-7a32-44ed-8edd-0cd456b49050-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.524233 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.524209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.524323 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.524305    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-secret-telemeter-client\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.524448 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.524429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-telemeter-client-tls\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.524484 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.524429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c53fb4f-7a32-44ed-8edd-0cd456b49050-federate-client-tls\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.530872 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.530850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc6xp\" (UniqueName: \"kubernetes.io/projected/4c53fb4f-7a32-44ed-8edd-0cd456b49050-kube-api-access-rc6xp\") pod \"telemeter-client-65b4f6984d-49pqc\" (UID: \"4c53fb4f-7a32-44ed-8edd-0cd456b49050\") " pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.638077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.638009    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc"
Aug 04 16:05:30.774339 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:30.774278    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65b4f6984d-49pqc"]
Aug 04 16:05:30.776653 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:05:30.776629    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c53fb4f_7a32_44ed_8edd_0cd456b49050.slice/crio-24ccb6af180aeaeaa89abb76c3db52328bf7f42277a496251ee7345203e8e249 WatchSource:0}: Error finding container 24ccb6af180aeaeaa89abb76c3db52328bf7f42277a496251ee7345203e8e249: Status 404 returned error can't find the container with id 24ccb6af180aeaeaa89abb76c3db52328bf7f42277a496251ee7345203e8e249
Aug 04 16:05:31.495723 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:31.495680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc" event={"ID":"4c53fb4f-7a32-44ed-8edd-0cd456b49050","Type":"ContainerStarted","Data":"24ccb6af180aeaeaa89abb76c3db52328bf7f42277a496251ee7345203e8e249"}
Aug 04 16:05:33.511328 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:33.511288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc" event={"ID":"4c53fb4f-7a32-44ed-8edd-0cd456b49050","Type":"ContainerStarted","Data":"6a9602cf7bfde36d3cb9171df4e6cd853d8c452aa0b363a24b5b62f789518f68"}
Aug 04 16:05:33.511705 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:33.511384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc" event={"ID":"4c53fb4f-7a32-44ed-8edd-0cd456b49050","Type":"ContainerStarted","Data":"03fa390aaf8ea6e5f6495fe51d7eb809d7c95f8160e4626c99e42dd23ff92b1a"}
Aug 04 16:05:33.511705 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:33.511413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc" event={"ID":"4c53fb4f-7a32-44ed-8edd-0cd456b49050","Type":"ContainerStarted","Data":"5765c97c298b3b80295fdfed29432b39690ae6f4e07516aa87cb6fb0b0ac567f"}
Aug 04 16:05:33.534983 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:33.534935    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65b4f6984d-49pqc" podStartSLOduration=1.256749989 podStartE2EDuration="3.534919826s" totalImagesPullingTime="2.278169837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:05:33.534189253 +0000 UTC m=+214.360886728" watchObservedRunningTime="2026-08-04 16:05:33.534919826 +0000 UTC m=+214.361617289"
Aug 04 16:05:33.703145 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:33.703115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:33.790994 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:33.790871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:44.664272 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:44.664221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:44.766116 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:05:44.766086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:07.190080 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:07.190049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:07.293987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:07.293952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:39.980048 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:39.979973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:40.389818 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:40.389755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:40.487533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:40.487503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:40.575425 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:40.575396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:44.712128 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:44.712097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:44.774071 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:44.774039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:52.457977 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:52.457942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:58.314002 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:58.313963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:59.562174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:59.562147    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:06:59.565773 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:59.565754    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:06:59.570222 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:06:59.570199    2563 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 16:07:41.156319 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:41.156286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:07:41.253326 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:41.253295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:07:42.097410 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.097372    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"]
Aug 04 16:07:42.100560 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.100541    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.102676 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.102653    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 16:07:42.102768 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.102685    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 16:07:42.103046 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.103026    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qcfb5\""
Aug 04 16:07:42.110938 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.110919    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"]
Aug 04 16:07:42.294069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.294025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.294475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.294100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.294475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.294147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2wdg\" (UniqueName: \"kubernetes.io/projected/6a99a325-95df-433d-87b1-966c2750c328-kube-api-access-r2wdg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.395412 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.395319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.395412 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.395379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2wdg\" (UniqueName: \"kubernetes.io/projected/6a99a325-95df-433d-87b1-966c2750c328-kube-api-access-r2wdg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.395412 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.395419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.395701 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.395680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.395758 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.395707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.404330 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.404292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2wdg\" (UniqueName: \"kubernetes.io/projected/6a99a325-95df-433d-87b1-966c2750c328-kube-api-access-r2wdg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.409888 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.409867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:07:42.535776 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.535742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"]
Aug 04 16:07:42.538606 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:07:42.538582    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a99a325_95df_433d_87b1_966c2750c328.slice/crio-ad7763f11c895960335ef264abcbfe09370d80090763866a5a7f33d08ce2d15f WatchSource:0}: Error finding container ad7763f11c895960335ef264abcbfe09370d80090763866a5a7f33d08ce2d15f: Status 404 returned error can't find the container with id ad7763f11c895960335ef264abcbfe09370d80090763866a5a7f33d08ce2d15f
Aug 04 16:07:42.540482 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.540465    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:07:42.955751 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:42.955716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh" event={"ID":"6a99a325-95df-433d-87b1-966c2750c328","Type":"ContainerStarted","Data":"ad7763f11c895960335ef264abcbfe09370d80090763866a5a7f33d08ce2d15f"}
Aug 04 16:07:49.986261 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:49.986183    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a99a325-95df-433d-87b1-966c2750c328" containerID="3816e3dfd0e024c1e472f66f5380676f67fad4a9d5969fe39d9c1cd663e5a35d" exitCode=0
Aug 04 16:07:49.986261 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:49.986242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh" event={"ID":"6a99a325-95df-433d-87b1-966c2750c328","Type":"ContainerDied","Data":"3816e3dfd0e024c1e472f66f5380676f67fad4a9d5969fe39d9c1cd663e5a35d"}
Aug 04 16:07:52.999771 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:52.999730    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a99a325-95df-433d-87b1-966c2750c328" containerID="deb5f01aa55486c64763884bd14578c61ec99eee105ac00ad526aa0af3c31e22" exitCode=0
Aug 04 16:07:53.000179 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:07:52.999777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh" event={"ID":"6a99a325-95df-433d-87b1-966c2750c328","Type":"ContainerDied","Data":"deb5f01aa55486c64763884bd14578c61ec99eee105ac00ad526aa0af3c31e22"}
Aug 04 16:08:00.029495 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:00.029466    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a99a325-95df-433d-87b1-966c2750c328" containerID="ef7611f073dc86a4c660856b4a63781f796031b60bcf96503ec453c9379d9e39" exitCode=0
Aug 04 16:08:00.029837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:00.029515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh" event={"ID":"6a99a325-95df-433d-87b1-966c2750c328","Type":"ContainerDied","Data":"ef7611f073dc86a4c660856b4a63781f796031b60bcf96503ec453c9379d9e39"}
Aug 04 16:08:01.155277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.155250    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:08:01.227328 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.227298    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-bundle\") pod \"6a99a325-95df-433d-87b1-966c2750c328\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") "
Aug 04 16:08:01.227464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.227382    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2wdg\" (UniqueName: \"kubernetes.io/projected/6a99a325-95df-433d-87b1-966c2750c328-kube-api-access-r2wdg\") pod \"6a99a325-95df-433d-87b1-966c2750c328\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") "
Aug 04 16:08:01.227464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.227406    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-util\") pod \"6a99a325-95df-433d-87b1-966c2750c328\" (UID: \"6a99a325-95df-433d-87b1-966c2750c328\") "
Aug 04 16:08:01.228066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.228044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-bundle" (OuterVolumeSpecName: "bundle") pod "6a99a325-95df-433d-87b1-966c2750c328" (UID: "6a99a325-95df-433d-87b1-966c2750c328"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:01.229617 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.229587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a99a325-95df-433d-87b1-966c2750c328-kube-api-access-r2wdg" (OuterVolumeSpecName: "kube-api-access-r2wdg") pod "6a99a325-95df-433d-87b1-966c2750c328" (UID: "6a99a325-95df-433d-87b1-966c2750c328"). InnerVolumeSpecName "kube-api-access-r2wdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:01.231513 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.231489    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-util" (OuterVolumeSpecName: "util") pod "6a99a325-95df-433d-87b1-966c2750c328" (UID: "6a99a325-95df-433d-87b1-966c2750c328"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:01.328488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.328422    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2wdg\" (UniqueName: \"kubernetes.io/projected/6a99a325-95df-433d-87b1-966c2750c328-kube-api-access-r2wdg\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:01.328488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.328446    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-util\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:01.328488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:01.328455    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99a325-95df-433d-87b1-966c2750c328-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:02.038843 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:02.038818    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh"
Aug 04 16:08:02.038843 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:02.038826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qw5nh" event={"ID":"6a99a325-95df-433d-87b1-966c2750c328","Type":"ContainerDied","Data":"ad7763f11c895960335ef264abcbfe09370d80090763866a5a7f33d08ce2d15f"}
Aug 04 16:08:02.039112 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:02.038866    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad7763f11c895960335ef264abcbfe09370d80090763866a5a7f33d08ce2d15f"
Aug 04 16:08:03.343746 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:03.343715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:03.975208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:03.975175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:05.530946 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.530895    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"]
Aug 04 16:08:05.531302 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.531208    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a99a325-95df-433d-87b1-966c2750c328" containerName="pull"
Aug 04 16:08:05.531302 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.531219    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99a325-95df-433d-87b1-966c2750c328" containerName="pull"
Aug 04 16:08:05.531302 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.531234    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a99a325-95df-433d-87b1-966c2750c328" containerName="extract"
Aug 04 16:08:05.531302 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.531239    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99a325-95df-433d-87b1-966c2750c328" containerName="extract"
Aug 04 16:08:05.531302 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.531254    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a99a325-95df-433d-87b1-966c2750c328" containerName="util"
Aug 04 16:08:05.531302 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.531259    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99a325-95df-433d-87b1-966c2750c328" containerName="util"
Aug 04 16:08:05.531302 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.531300    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a99a325-95df-433d-87b1-966c2750c328" containerName="extract"
Aug 04 16:08:05.534787 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.534771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"
Aug 04 16:08:05.537519 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.537495    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 04 16:08:05.538307 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.538283    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 04 16:08:05.538486 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.538469    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2xfmr\""
Aug 04 16:08:05.552046 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.552023    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"]
Aug 04 16:08:05.559822 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.559800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d26b5f41-2205-4b66-945e-1c9d846086be-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wjxt\" (UID: \"d26b5f41-2205-4b66-945e-1c9d846086be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"
Aug 04 16:08:05.559933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.559851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2l54\" (UniqueName: \"kubernetes.io/projected/d26b5f41-2205-4b66-945e-1c9d846086be-kube-api-access-z2l54\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wjxt\" (UID: \"d26b5f41-2205-4b66-945e-1c9d846086be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"
Aug 04 16:08:05.660447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.660415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d26b5f41-2205-4b66-945e-1c9d846086be-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wjxt\" (UID: \"d26b5f41-2205-4b66-945e-1c9d846086be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"
Aug 04 16:08:05.660596 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.660471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2l54\" (UniqueName: \"kubernetes.io/projected/d26b5f41-2205-4b66-945e-1c9d846086be-kube-api-access-z2l54\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wjxt\" (UID: \"d26b5f41-2205-4b66-945e-1c9d846086be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"
Aug 04 16:08:05.660811 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.660794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d26b5f41-2205-4b66-945e-1c9d846086be-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wjxt\" (UID: \"d26b5f41-2205-4b66-945e-1c9d846086be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"
Aug 04 16:08:05.674274 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.674247    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2l54\" (UniqueName: \"kubernetes.io/projected/d26b5f41-2205-4b66-945e-1c9d846086be-kube-api-access-z2l54\") pod \"cert-manager-operator-controller-manager-55c444bf86-9wjxt\" (UID: \"d26b5f41-2205-4b66-945e-1c9d846086be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"
Aug 04 16:08:05.844558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.844471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"
Aug 04 16:08:05.995615 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:05.995588    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt"]
Aug 04 16:08:05.996594 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:08:05.996569    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26b5f41_2205_4b66_945e_1c9d846086be.slice/crio-8cfdd234330d8f5ee4011539b2760afcd6fc77a3ea94b2be4b5e81cf53ee3192 WatchSource:0}: Error finding container 8cfdd234330d8f5ee4011539b2760afcd6fc77a3ea94b2be4b5e81cf53ee3192: Status 404 returned error can't find the container with id 8cfdd234330d8f5ee4011539b2760afcd6fc77a3ea94b2be4b5e81cf53ee3192
Aug 04 16:08:06.053791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:06.053756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt" event={"ID":"d26b5f41-2205-4b66-945e-1c9d846086be","Type":"ContainerStarted","Data":"8cfdd234330d8f5ee4011539b2760afcd6fc77a3ea94b2be4b5e81cf53ee3192"}
Aug 04 16:08:08.064358 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:08.064317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt" event={"ID":"d26b5f41-2205-4b66-945e-1c9d846086be","Type":"ContainerStarted","Data":"cc8e07effd7d3ff710d94c5ec4455b0949f2a1fa3825942c3dba9ca9b37b666f"}
Aug 04 16:08:08.110378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:08.110268    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9wjxt" podStartSLOduration=1.282398503 podStartE2EDuration="3.110247271s" totalImagesPullingTime="1.827848768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:08.107390719 +0000 UTC m=+368.934088182" watchObservedRunningTime="2026-08-04 16:08:08.110247271 +0000 UTC m=+368.936944745"
Aug 04 16:08:09.024781 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.024750    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"]
Aug 04 16:08:09.028236 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.028219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.034655 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.034633    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 16:08:09.034759 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.034642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 16:08:09.042755 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.042739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qcfb5\""
Aug 04 16:08:09.056383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.056357    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"]
Aug 04 16:08:09.085774 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.085746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.085774 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.085776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.086163 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.085800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbblp\" (UniqueName: \"kubernetes.io/projected/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-kube-api-access-nbblp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.186257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.186226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.186257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.186260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.186458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.186285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbblp\" (UniqueName: \"kubernetes.io/projected/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-kube-api-access-nbblp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.186603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.186583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.186667 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.186606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.209612 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.209590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbblp\" (UniqueName: \"kubernetes.io/projected/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-kube-api-access-nbblp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.337488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.337406    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:09.399476 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.399437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:09.490309 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.490288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"]
Aug 04 16:08:09.492776 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:08:09.492749    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd152fc20_e508_4ed5_9ab7_7ad7a1eb2b05.slice/crio-5cb4e3c3362294b4c81784bb96292ff514be4e63c353f04b48e6b3ff0a73abed WatchSource:0}: Error finding container 5cb4e3c3362294b4c81784bb96292ff514be4e63c353f04b48e6b3ff0a73abed: Status 404 returned error can't find the container with id 5cb4e3c3362294b4c81784bb96292ff514be4e63c353f04b48e6b3ff0a73abed
Aug 04 16:08:09.919991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.919920    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-blfr8"]
Aug 04 16:08:09.923083 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.923067    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:09.949491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.949472    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 04 16:08:09.949953 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.949938    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xnm69\""
Aug 04 16:08:09.950019 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.949940    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 04 16:08:09.969332 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.969309    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-blfr8"]
Aug 04 16:08:09.993401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.993374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92b88\" (UniqueName: \"kubernetes.io/projected/6bc23906-79ff-4b04-8f68-235b2061e383-kube-api-access-92b88\") pod \"cert-manager-webhook-6486ffd997-blfr8\" (UID: \"6bc23906-79ff-4b04-8f68-235b2061e383\") " pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:09.993505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:09.993423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bc23906-79ff-4b04-8f68-235b2061e383-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-blfr8\" (UID: \"6bc23906-79ff-4b04-8f68-235b2061e383\") " pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:10.074217 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.074188    2563 generic.go:356] "Generic (PLEG): container finished" podID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerID="2e4a43a894182fcece32ddb2475fa967d9aac206037f2a0b2bca489fae3361e4" exitCode=0
Aug 04 16:08:10.074348 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.074271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q" event={"ID":"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05","Type":"ContainerDied","Data":"2e4a43a894182fcece32ddb2475fa967d9aac206037f2a0b2bca489fae3361e4"}
Aug 04 16:08:10.074348 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.074321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q" event={"ID":"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05","Type":"ContainerStarted","Data":"5cb4e3c3362294b4c81784bb96292ff514be4e63c353f04b48e6b3ff0a73abed"}
Aug 04 16:08:10.094055 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.094034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b88\" (UniqueName: \"kubernetes.io/projected/6bc23906-79ff-4b04-8f68-235b2061e383-kube-api-access-92b88\") pod \"cert-manager-webhook-6486ffd997-blfr8\" (UID: \"6bc23906-79ff-4b04-8f68-235b2061e383\") " pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:10.094368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.094081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bc23906-79ff-4b04-8f68-235b2061e383-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-blfr8\" (UID: \"6bc23906-79ff-4b04-8f68-235b2061e383\") " pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:10.111021 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.110992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bc23906-79ff-4b04-8f68-235b2061e383-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-blfr8\" (UID: \"6bc23906-79ff-4b04-8f68-235b2061e383\") " pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:10.111108 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.111028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92b88\" (UniqueName: \"kubernetes.io/projected/6bc23906-79ff-4b04-8f68-235b2061e383-kube-api-access-92b88\") pod \"cert-manager-webhook-6486ffd997-blfr8\" (UID: \"6bc23906-79ff-4b04-8f68-235b2061e383\") " pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:10.238840 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.238814    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:10.378922 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:10.378872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-blfr8"]
Aug 04 16:08:10.381779 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:08:10.381753    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bc23906_79ff_4b04_8f68_235b2061e383.slice/crio-2145009d9af8b8bef9625d0edcd9bce4317f82afadfb22d5ddfedd3c131dd316 WatchSource:0}: Error finding container 2145009d9af8b8bef9625d0edcd9bce4317f82afadfb22d5ddfedd3c131dd316: Status 404 returned error can't find the container with id 2145009d9af8b8bef9625d0edcd9bce4317f82afadfb22d5ddfedd3c131dd316
Aug 04 16:08:11.081238 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.081198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8" event={"ID":"6bc23906-79ff-4b04-8f68-235b2061e383","Type":"ContainerStarted","Data":"2145009d9af8b8bef9625d0edcd9bce4317f82afadfb22d5ddfedd3c131dd316"}
Aug 04 16:08:11.667166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.667133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:11.776128 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.776095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:11.833181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.833153    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"]
Aug 04 16:08:11.843221 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.843194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"
Aug 04 16:08:11.846692 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.846672    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vvz8h\""
Aug 04 16:08:11.855564 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.855543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"]
Aug 04 16:08:11.910385 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.910341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwgs\" (UniqueName: \"kubernetes.io/projected/88504fec-ac41-470b-81d7-187d5d27bd68-kube-api-access-pnwgs\") pod \"cert-manager-cainjector-559cdd8c87-ltbrb\" (UID: \"88504fec-ac41-470b-81d7-187d5d27bd68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"
Aug 04 16:08:11.910562 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:11.910453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88504fec-ac41-470b-81d7-187d5d27bd68-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ltbrb\" (UID: \"88504fec-ac41-470b-81d7-187d5d27bd68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"
Aug 04 16:08:12.011289 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:12.011259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwgs\" (UniqueName: \"kubernetes.io/projected/88504fec-ac41-470b-81d7-187d5d27bd68-kube-api-access-pnwgs\") pod \"cert-manager-cainjector-559cdd8c87-ltbrb\" (UID: \"88504fec-ac41-470b-81d7-187d5d27bd68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"
Aug 04 16:08:12.011461 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:12.011334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88504fec-ac41-470b-81d7-187d5d27bd68-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ltbrb\" (UID: \"88504fec-ac41-470b-81d7-187d5d27bd68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"
Aug 04 16:08:12.022745 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:12.022719    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwgs\" (UniqueName: \"kubernetes.io/projected/88504fec-ac41-470b-81d7-187d5d27bd68-kube-api-access-pnwgs\") pod \"cert-manager-cainjector-559cdd8c87-ltbrb\" (UID: \"88504fec-ac41-470b-81d7-187d5d27bd68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"
Aug 04 16:08:12.023268 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:12.023248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88504fec-ac41-470b-81d7-187d5d27bd68-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ltbrb\" (UID: \"88504fec-ac41-470b-81d7-187d5d27bd68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"
Aug 04 16:08:12.155380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:12.155354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"
Aug 04 16:08:12.295551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:12.295462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb"]
Aug 04 16:08:12.299507 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:08:12.299485    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88504fec_ac41_470b_81d7_187d5d27bd68.slice/crio-9268fc5784c6dfb8532c1235a5b86a3b9d4132549929048ba0e8e1aca0104d91 WatchSource:0}: Error finding container 9268fc5784c6dfb8532c1235a5b86a3b9d4132549929048ba0e8e1aca0104d91: Status 404 returned error can't find the container with id 9268fc5784c6dfb8532c1235a5b86a3b9d4132549929048ba0e8e1aca0104d91
Aug 04 16:08:13.093155 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:13.093116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb" event={"ID":"88504fec-ac41-470b-81d7-187d5d27bd68","Type":"ContainerStarted","Data":"9268fc5784c6dfb8532c1235a5b86a3b9d4132549929048ba0e8e1aca0104d91"}
Aug 04 16:08:13.095577 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:13.095444    2563 generic.go:356] "Generic (PLEG): container finished" podID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerID="2fbba7eb32772a88e98002263f8b8781863b6ae742535e6f1caff8858cde5ac6" exitCode=0
Aug 04 16:08:13.095577 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:13.095486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q" event={"ID":"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05","Type":"ContainerDied","Data":"2fbba7eb32772a88e98002263f8b8781863b6ae742535e6f1caff8858cde5ac6"}
Aug 04 16:08:13.756859 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:13.756824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:13.852826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:13.852791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:14.107827 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:14.107744    2563 generic.go:356] "Generic (PLEG): container finished" podID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerID="1b64724557d10c35fefbefcbf5d6d03534ae3b659243a391ec4db7c20332b43c" exitCode=0
Aug 04 16:08:14.108241 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:14.107863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q" event={"ID":"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05","Type":"ContainerDied","Data":"1b64724557d10c35fefbefcbf5d6d03534ae3b659243a391ec4db7c20332b43c"}
Aug 04 16:08:15.113340 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.113303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8" event={"ID":"6bc23906-79ff-4b04-8f68-235b2061e383","Type":"ContainerStarted","Data":"188f56afae1166fb18cbd4a35581411d1a97ca78dc1444df34979f2dcf3e89e5"}
Aug 04 16:08:15.113753 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.113373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:15.114926 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.114882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb" event={"ID":"88504fec-ac41-470b-81d7-187d5d27bd68","Type":"ContainerStarted","Data":"4e13a90d683d18c34eb9fc9fc64d0bd075d89a20a2b2363b21be4cd0916ae2af"}
Aug 04 16:08:15.135104 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.135049    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8" podStartSLOduration=2.070489282 podStartE2EDuration="6.135028616s" totalImagesPullingTime="4.064539334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:15.133195498 +0000 UTC m=+375.959892994" watchObservedRunningTime="2026-08-04 16:08:15.135028616 +0000 UTC m=+375.961726089"
Aug 04 16:08:15.153630 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.153555    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ltbrb" podStartSLOduration=2.001333462 podStartE2EDuration="4.15353534s" totalImagesPullingTime="2.152201878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:15.153339097 +0000 UTC m=+375.980036571" watchObservedRunningTime="2026-08-04 16:08:15.15353534 +0000 UTC m=+375.980232813"
Aug 04 16:08:15.245729 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.245707    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:15.339440 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.339411    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbblp\" (UniqueName: \"kubernetes.io/projected/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-kube-api-access-nbblp\") pod \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") "
Aug 04 16:08:15.339582 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.339459    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-bundle\") pod \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") "
Aug 04 16:08:15.339582 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.339481    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-util\") pod \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\" (UID: \"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05\") "
Aug 04 16:08:15.339834 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.339814    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-bundle" (OuterVolumeSpecName: "bundle") pod "d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" (UID: "d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:15.341608 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.341583    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-kube-api-access-nbblp" (OuterVolumeSpecName: "kube-api-access-nbblp") pod "d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" (UID: "d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05"). InnerVolumeSpecName "kube-api-access-nbblp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:15.343733 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.343713    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-util" (OuterVolumeSpecName: "util") pod "d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" (UID: "d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:15.440265 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.440202    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbblp\" (UniqueName: \"kubernetes.io/projected/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-kube-api-access-nbblp\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:15.440265 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.440223    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:15.440265 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:15.440232    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05-util\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:16.120804 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:16.120766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q" event={"ID":"d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05","Type":"ContainerDied","Data":"5cb4e3c3362294b4c81784bb96292ff514be4e63c353f04b48e6b3ff0a73abed"}
Aug 04 16:08:16.120804 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:16.120801    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm822q"
Aug 04 16:08:16.121323 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:16.120814    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cb4e3c3362294b4c81784bb96292ff514be4e63c353f04b48e6b3ff0a73abed"
Aug 04 16:08:19.206599 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:19.206554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:19.305655 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:19.305596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:19.380598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:19.380565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:20.043274 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:20.043242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:20.144374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:20.144343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:21.123696 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.123662    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-blfr8"
Aug 04 16:08:21.757694 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.757660    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"]
Aug 04 16:08:21.758040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.758024    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerName="util"
Aug 04 16:08:21.758134 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.758043    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerName="util"
Aug 04 16:08:21.758134 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.758073    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerName="pull"
Aug 04 16:08:21.758134 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.758081    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerName="pull"
Aug 04 16:08:21.758134 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.758096    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerName="extract"
Aug 04 16:08:21.758134 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.758105    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerName="extract"
Aug 04 16:08:21.758379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.758182    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d152fc20-e508-4ed5-9ab7-7ad7a1eb2b05" containerName="extract"
Aug 04 16:08:21.791039 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.791008    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"]
Aug 04 16:08:21.791183 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.791107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"
Aug 04 16:08:21.793739 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.793717    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 16:08:21.794066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.794049    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 16:08:21.794170 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.794069    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f292j\""
Aug 04 16:08:21.888281 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.888249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6213d7ea-e693-41d4-bdd0-b11fd5101a3d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hqlsx\" (UID: \"6213d7ea-e693-41d4-bdd0-b11fd5101a3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"
Aug 04 16:08:21.888429 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.888288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpfg8\" (UniqueName: \"kubernetes.io/projected/6213d7ea-e693-41d4-bdd0-b11fd5101a3d-kube-api-access-kpfg8\") pod \"openshift-lws-operator-fd8ccff4c-hqlsx\" (UID: \"6213d7ea-e693-41d4-bdd0-b11fd5101a3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"
Aug 04 16:08:21.988661 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.988628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6213d7ea-e693-41d4-bdd0-b11fd5101a3d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hqlsx\" (UID: \"6213d7ea-e693-41d4-bdd0-b11fd5101a3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"
Aug 04 16:08:21.988797 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.988672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpfg8\" (UniqueName: \"kubernetes.io/projected/6213d7ea-e693-41d4-bdd0-b11fd5101a3d-kube-api-access-kpfg8\") pod \"openshift-lws-operator-fd8ccff4c-hqlsx\" (UID: \"6213d7ea-e693-41d4-bdd0-b11fd5101a3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"
Aug 04 16:08:21.989084 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.989066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6213d7ea-e693-41d4-bdd0-b11fd5101a3d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hqlsx\" (UID: \"6213d7ea-e693-41d4-bdd0-b11fd5101a3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"
Aug 04 16:08:21.997325 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:21.997304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpfg8\" (UniqueName: \"kubernetes.io/projected/6213d7ea-e693-41d4-bdd0-b11fd5101a3d-kube-api-access-kpfg8\") pod \"openshift-lws-operator-fd8ccff4c-hqlsx\" (UID: \"6213d7ea-e693-41d4-bdd0-b11fd5101a3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"
Aug 04 16:08:22.100091 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.100030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"
Aug 04 16:08:22.233319 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.233290    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6f2st"]
Aug 04 16:08:22.239083 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.239060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6f2st"
Aug 04 16:08:22.241213 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.241192    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2nqsj\""
Aug 04 16:08:22.249102 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.249076    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6f2st"]
Aug 04 16:08:22.263209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.263106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx"]
Aug 04 16:08:22.266293 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:08:22.266270    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6213d7ea_e693_41d4_bdd0_b11fd5101a3d.slice/crio-885f8eaf11cb5ef8324a85157d08cbcb4d58e93ed53084bb56690e7c3e9ed695 WatchSource:0}: Error finding container 885f8eaf11cb5ef8324a85157d08cbcb4d58e93ed53084bb56690e7c3e9ed695: Status 404 returned error can't find the container with id 885f8eaf11cb5ef8324a85157d08cbcb4d58e93ed53084bb56690e7c3e9ed695
Aug 04 16:08:22.291223 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.291194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b393a5b-82a1-44a2-b133-9ff33c4e45da-bound-sa-token\") pod \"cert-manager-55b4d954d5-6f2st\" (UID: \"6b393a5b-82a1-44a2-b133-9ff33c4e45da\") " pod="cert-manager/cert-manager-55b4d954d5-6f2st"
Aug 04 16:08:22.291327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.291230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjp5v\" (UniqueName: \"kubernetes.io/projected/6b393a5b-82a1-44a2-b133-9ff33c4e45da-kube-api-access-mjp5v\") pod \"cert-manager-55b4d954d5-6f2st\" (UID: \"6b393a5b-82a1-44a2-b133-9ff33c4e45da\") " pod="cert-manager/cert-manager-55b4d954d5-6f2st"
Aug 04 16:08:22.392505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.392446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b393a5b-82a1-44a2-b133-9ff33c4e45da-bound-sa-token\") pod \"cert-manager-55b4d954d5-6f2st\" (UID: \"6b393a5b-82a1-44a2-b133-9ff33c4e45da\") " pod="cert-manager/cert-manager-55b4d954d5-6f2st"
Aug 04 16:08:22.392505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.392482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjp5v\" (UniqueName: \"kubernetes.io/projected/6b393a5b-82a1-44a2-b133-9ff33c4e45da-kube-api-access-mjp5v\") pod \"cert-manager-55b4d954d5-6f2st\" (UID: \"6b393a5b-82a1-44a2-b133-9ff33c4e45da\") " pod="cert-manager/cert-manager-55b4d954d5-6f2st"
Aug 04 16:08:22.401061 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.401035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjp5v\" (UniqueName: \"kubernetes.io/projected/6b393a5b-82a1-44a2-b133-9ff33c4e45da-kube-api-access-mjp5v\") pod \"cert-manager-55b4d954d5-6f2st\" (UID: \"6b393a5b-82a1-44a2-b133-9ff33c4e45da\") " pod="cert-manager/cert-manager-55b4d954d5-6f2st"
Aug 04 16:08:22.401170 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.401153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b393a5b-82a1-44a2-b133-9ff33c4e45da-bound-sa-token\") pod \"cert-manager-55b4d954d5-6f2st\" (UID: \"6b393a5b-82a1-44a2-b133-9ff33c4e45da\") " pod="cert-manager/cert-manager-55b4d954d5-6f2st"
Aug 04 16:08:22.548748 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.548711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6f2st"
Aug 04 16:08:22.680786 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:22.680716    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6f2st"]
Aug 04 16:08:22.683474 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:08:22.683452    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b393a5b_82a1_44a2_b133_9ff33c4e45da.slice/crio-684e3f9bd3cea3c7a1053b3d8bccc4efac1898a8ad8718a8e143a06e91dae5c9 WatchSource:0}: Error finding container 684e3f9bd3cea3c7a1053b3d8bccc4efac1898a8ad8718a8e143a06e91dae5c9: Status 404 returned error can't find the container with id 684e3f9bd3cea3c7a1053b3d8bccc4efac1898a8ad8718a8e143a06e91dae5c9
Aug 04 16:08:23.157209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:23.157167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6f2st" event={"ID":"6b393a5b-82a1-44a2-b133-9ff33c4e45da","Type":"ContainerStarted","Data":"dde9d88bb927ccc4065a5af033977455babd2b12719a2d2998425023075e455f"}
Aug 04 16:08:23.157383 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:23.157217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6f2st" event={"ID":"6b393a5b-82a1-44a2-b133-9ff33c4e45da","Type":"ContainerStarted","Data":"684e3f9bd3cea3c7a1053b3d8bccc4efac1898a8ad8718a8e143a06e91dae5c9"}
Aug 04 16:08:23.158651 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:23.158625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx" event={"ID":"6213d7ea-e693-41d4-bdd0-b11fd5101a3d","Type":"ContainerStarted","Data":"885f8eaf11cb5ef8324a85157d08cbcb4d58e93ed53084bb56690e7c3e9ed695"}
Aug 04 16:08:23.174092 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:23.174042    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6f2st" podStartSLOduration=1.174023831 podStartE2EDuration="1.174023831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:23.172742182 +0000 UTC m=+383.999439656" watchObservedRunningTime="2026-08-04 16:08:23.174023831 +0000 UTC m=+384.000721304"
Aug 04 16:08:24.165088 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:24.165050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx" event={"ID":"6213d7ea-e693-41d4-bdd0-b11fd5101a3d","Type":"ContainerStarted","Data":"40ecbce06028f071c22e11cf8b0ed90a18119f3cb8a5f51d46dcf78d3243fbde"}
Aug 04 16:08:24.188032 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:24.187987    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hqlsx" podStartSLOduration=1.505642302 podStartE2EDuration="3.187971706s" totalImagesPullingTime="1.682329404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:24.186817582 +0000 UTC m=+385.013515053" watchObservedRunningTime="2026-08-04 16:08:24.187971706 +0000 UTC m=+385.014669180"
Aug 04 16:08:24.934468 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:24.934434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:26.686251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:26.686216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:26.887167 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:26.887139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:27.234558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.234523    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"]
Aug 04 16:08:27.236817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.236800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.239891 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.239867    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 16:08:27.240005 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.239987    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qcfb5\""
Aug 04 16:08:27.240426 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.240409    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 16:08:27.250079 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.250056    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"]
Aug 04 16:08:27.333608 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.333585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.333761 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.333644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.333761 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.333726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hclzg\" (UniqueName: \"kubernetes.io/projected/b367358b-2627-4f00-ad83-f084fa97472c-kube-api-access-hclzg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.434606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.434568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.434724 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.434628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hclzg\" (UniqueName: \"kubernetes.io/projected/b367358b-2627-4f00-ad83-f084fa97472c-kube-api-access-hclzg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.434785 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.434746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.434984 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.434965    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.435068 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.435053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.443032 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.443012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hclzg\" (UniqueName: \"kubernetes.io/projected/b367358b-2627-4f00-ad83-f084fa97472c-kube-api-access-hclzg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.546013 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.545992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:27.705048 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:27.705017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"]
Aug 04 16:08:27.708693 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:08:27.708667    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb367358b_2627_4f00_ad83_f084fa97472c.slice/crio-71854ec997ebfffb6b69c0b21fd494cc17d4df927381ec80d9e6810782e4caa8 WatchSource:0}: Error finding container 71854ec997ebfffb6b69c0b21fd494cc17d4df927381ec80d9e6810782e4caa8: Status 404 returned error can't find the container with id 71854ec997ebfffb6b69c0b21fd494cc17d4df927381ec80d9e6810782e4caa8
Aug 04 16:08:28.184309 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:28.184225    2563 generic.go:356] "Generic (PLEG): container finished" podID="b367358b-2627-4f00-ad83-f084fa97472c" containerID="2614df989d8cb5f34babd0472474ddc886ba8846e72061bacd3609f2269af35a" exitCode=0
Aug 04 16:08:28.184309 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:28.184292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7" event={"ID":"b367358b-2627-4f00-ad83-f084fa97472c","Type":"ContainerDied","Data":"2614df989d8cb5f34babd0472474ddc886ba8846e72061bacd3609f2269af35a"}
Aug 04 16:08:28.184475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:28.184330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7" event={"ID":"b367358b-2627-4f00-ad83-f084fa97472c","Type":"ContainerStarted","Data":"71854ec997ebfffb6b69c0b21fd494cc17d4df927381ec80d9e6810782e4caa8"}
Aug 04 16:08:29.190882 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:29.190796    2563 generic.go:356] "Generic (PLEG): container finished" podID="b367358b-2627-4f00-ad83-f084fa97472c" containerID="f348e38958108932af7543ad84bdb83a2da107167d7b4fbbe155e6ad9396cce4" exitCode=0
Aug 04 16:08:29.190882 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:29.190863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7" event={"ID":"b367358b-2627-4f00-ad83-f084fa97472c","Type":"ContainerDied","Data":"f348e38958108932af7543ad84bdb83a2da107167d7b4fbbe155e6ad9396cce4"}
Aug 04 16:08:30.197015 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:30.196981    2563 generic.go:356] "Generic (PLEG): container finished" podID="b367358b-2627-4f00-ad83-f084fa97472c" containerID="a2d6964d0fb46fccbf1564f89f11e331d93131b29783a20ceeea34788fe07b1a" exitCode=0
Aug 04 16:08:30.197382 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:30.197046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7" event={"ID":"b367358b-2627-4f00-ad83-f084fa97472c","Type":"ContainerDied","Data":"a2d6964d0fb46fccbf1564f89f11e331d93131b29783a20ceeea34788fe07b1a"}
Aug 04 16:08:31.320989 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.320963    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:31.467406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.467348    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-bundle\") pod \"b367358b-2627-4f00-ad83-f084fa97472c\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") "
Aug 04 16:08:31.467406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.467378    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-util\") pod \"b367358b-2627-4f00-ad83-f084fa97472c\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") "
Aug 04 16:08:31.467582 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.467416    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hclzg\" (UniqueName: \"kubernetes.io/projected/b367358b-2627-4f00-ad83-f084fa97472c-kube-api-access-hclzg\") pod \"b367358b-2627-4f00-ad83-f084fa97472c\" (UID: \"b367358b-2627-4f00-ad83-f084fa97472c\") "
Aug 04 16:08:31.468063 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.468037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-bundle" (OuterVolumeSpecName: "bundle") pod "b367358b-2627-4f00-ad83-f084fa97472c" (UID: "b367358b-2627-4f00-ad83-f084fa97472c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:31.469542 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.469519    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b367358b-2627-4f00-ad83-f084fa97472c-kube-api-access-hclzg" (OuterVolumeSpecName: "kube-api-access-hclzg") pod "b367358b-2627-4f00-ad83-f084fa97472c" (UID: "b367358b-2627-4f00-ad83-f084fa97472c"). InnerVolumeSpecName "kube-api-access-hclzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:31.472712 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.472690    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-util" (OuterVolumeSpecName: "util") pod "b367358b-2627-4f00-ad83-f084fa97472c" (UID: "b367358b-2627-4f00-ad83-f084fa97472c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:31.567837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.567814    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:31.567837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.567835    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b367358b-2627-4f00-ad83-f084fa97472c-util\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:31.567981 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:31.567843    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hclzg\" (UniqueName: \"kubernetes.io/projected/b367358b-2627-4f00-ad83-f084fa97472c-kube-api-access-hclzg\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:08:32.206838 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:32.206804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7" event={"ID":"b367358b-2627-4f00-ad83-f084fa97472c","Type":"ContainerDied","Data":"71854ec997ebfffb6b69c0b21fd494cc17d4df927381ec80d9e6810782e4caa8"}
Aug 04 16:08:32.206838 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:32.206834    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hzz7"
Aug 04 16:08:32.206838 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:32.206854    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71854ec997ebfffb6b69c0b21fd494cc17d4df927381ec80d9e6810782e4caa8"
Aug 04 16:08:41.809536 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:41.809498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:43.328991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.328959    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"]
Aug 04 16:08:43.329368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.329247    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b367358b-2627-4f00-ad83-f084fa97472c" containerName="util"
Aug 04 16:08:43.329368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.329257    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b367358b-2627-4f00-ad83-f084fa97472c" containerName="util"
Aug 04 16:08:43.329368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.329265    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b367358b-2627-4f00-ad83-f084fa97472c" containerName="extract"
Aug 04 16:08:43.329368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.329270    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b367358b-2627-4f00-ad83-f084fa97472c" containerName="extract"
Aug 04 16:08:43.329368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.329282    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b367358b-2627-4f00-ad83-f084fa97472c" containerName="pull"
Aug 04 16:08:43.329368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.329287    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b367358b-2627-4f00-ad83-f084fa97472c" containerName="pull"
Aug 04 16:08:43.329368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.329342    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b367358b-2627-4f00-ad83-f084fa97472c" containerName="extract"
Aug 04 16:08:43.335310 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.335291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.337174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.337153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 16:08:43.337471 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.337455    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 16:08:43.337572 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.337493    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 16:08:43.337572 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.337563    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m5dcn\""
Aug 04 16:08:43.337952 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.337936    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 16:08:43.348489 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.348467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"]
Aug 04 16:08:43.457937 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.457894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d68e6b-af16-4887-9112-605b2eeeaa24-tmp\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.458078 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.457950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4599\" (UniqueName: \"kubernetes.io/projected/74d68e6b-af16-4887-9112-605b2eeeaa24-kube-api-access-w4599\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.458078 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.458029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74d68e6b-af16-4887-9112-605b2eeeaa24-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.458078 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.458058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/74d68e6b-af16-4887-9112-605b2eeeaa24-manifests\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.458179 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.458082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/74d68e6b-af16-4887-9112-605b2eeeaa24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.492701 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.492674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:43.558850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.558827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d68e6b-af16-4887-9112-605b2eeeaa24-tmp\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.558974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.558867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4599\" (UniqueName: \"kubernetes.io/projected/74d68e6b-af16-4887-9112-605b2eeeaa24-kube-api-access-w4599\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.558974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.558930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74d68e6b-af16-4887-9112-605b2eeeaa24-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.558974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.558956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/74d68e6b-af16-4887-9112-605b2eeeaa24-manifests\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.559118 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.558987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/74d68e6b-af16-4887-9112-605b2eeeaa24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.559336 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.559316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/74d68e6b-af16-4887-9112-605b2eeeaa24-manifests\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.561092 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.561065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d68e6b-af16-4887-9112-605b2eeeaa24-tmp\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.561381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.561363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/74d68e6b-af16-4887-9112-605b2eeeaa24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.561483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.561465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74d68e6b-af16-4887-9112-605b2eeeaa24-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.567539 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.567515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4599\" (UniqueName: \"kubernetes.io/projected/74d68e6b-af16-4887-9112-605b2eeeaa24-kube-api-access-w4599\") pod \"opendatahub-operator-controller-manager-7dd47f799b-cnqww\" (UID: \"74d68e6b-af16-4887-9112-605b2eeeaa24\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.593862 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.593804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:43.646157 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.646131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:43.703505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.703472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:43.793055 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:43.793030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"]
Aug 04 16:08:43.795419 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:08:43.795393    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d68e6b_af16_4887_9112_605b2eeeaa24.slice/crio-6a57f6acd7de38fef676302f820d43c6589a948cfc602e8e601b8ab80d9457bf WatchSource:0}: Error finding container 6a57f6acd7de38fef676302f820d43c6589a948cfc602e8e601b8ab80d9457bf: Status 404 returned error can't find the container with id 6a57f6acd7de38fef676302f820d43c6589a948cfc602e8e601b8ab80d9457bf
Aug 04 16:08:44.082496 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:44.082463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:44.190835 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:44.190805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:44.263156 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:44.263124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww" event={"ID":"74d68e6b-af16-4887-9112-605b2eeeaa24","Type":"ContainerStarted","Data":"6a57f6acd7de38fef676302f820d43c6589a948cfc602e8e601b8ab80d9457bf"}
Aug 04 16:08:47.279700 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:47.279628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww" event={"ID":"74d68e6b-af16-4887-9112-605b2eeeaa24","Type":"ContainerStarted","Data":"5d6e9d0415b015333230d477a3ab7e3562744cf794bcbb4c1d832c1dc603ab9f"}
Aug 04 16:08:48.285426 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:48.285388    2563 generic.go:356] "Generic (PLEG): container finished" podID="74d68e6b-af16-4887-9112-605b2eeeaa24" containerID="5d6e9d0415b015333230d477a3ab7e3562744cf794bcbb4c1d832c1dc603ab9f" exitCode=0
Aug 04 16:08:48.285822 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:48.285478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww" event={"ID":"74d68e6b-af16-4887-9112-605b2eeeaa24","Type":"ContainerDied","Data":"5d6e9d0415b015333230d477a3ab7e3562744cf794bcbb4c1d832c1dc603ab9f"}
Aug 04 16:08:49.291785 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:49.291746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww" event={"ID":"74d68e6b-af16-4887-9112-605b2eeeaa24","Type":"ContainerStarted","Data":"9d8d9e585e6f516e32e05b07751cde8aad175f005dcf4ddfb09edb2b387cc35e"}
Aug 04 16:08:49.292211 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:49.291824    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:08:49.317835 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:49.317766    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww" podStartSLOduration=1.659988628 podStartE2EDuration="6.317746097s" totalImagesPullingTime="3.574607232s" totalInitContainerRuntime="1.083150237s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:49.31634065 +0000 UTC m=+410.143038121" watchObservedRunningTime="2026-08-04 16:08:49.317746097 +0000 UTC m=+410.144443572"
Aug 04 16:08:53.192356 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:53.192297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:53.283354 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:08:53.283321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:00.298401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:00.298370    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-cnqww"
Aug 04 16:09:02.033312 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.033276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:02.219824 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.219789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:02.647680 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.647648    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"]
Aug 04 16:09:02.657335 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.657315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.664482 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.664464    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 16:09:02.665100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.665086    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 16:09:02.665357 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.665344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 16:09:02.665451 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.665371    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 16:09:02.674674 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.674642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"]
Aug 04 16:09:02.712995 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.712971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57kdr\" (UniqueName: \"kubernetes.io/projected/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-kube-api-access-57kdr\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.713117 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.713032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-tls-certs\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.713117 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.713088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-tmp\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.814295 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.814264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-tls-certs\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.814442 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.814307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-tmp\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.814442 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.814347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57kdr\" (UniqueName: \"kubernetes.io/projected/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-kube-api-access-57kdr\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.816719 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.816695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-tmp\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.816825 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.816806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-tls-certs\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.827193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.827171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57kdr\" (UniqueName: \"kubernetes.io/projected/f9db57cc-6dad-495a-92a6-3fe88d3ee2ca-kube-api-access-57kdr\") pod \"kube-auth-proxy-5cb97f6d89-mvwcn\" (UID: \"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:02.966386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:02.966312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"
Aug 04 16:09:03.163020 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:03.162994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn"]
Aug 04 16:09:03.163991 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:09:03.163966    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9db57cc_6dad_495a_92a6_3fe88d3ee2ca.slice/crio-f6e3e35ab778f5e66f6452dea6951898ec9520b758f8eb6135fa3874cae81238 WatchSource:0}: Error finding container f6e3e35ab778f5e66f6452dea6951898ec9520b758f8eb6135fa3874cae81238: Status 404 returned error can't find the container with id f6e3e35ab778f5e66f6452dea6951898ec9520b758f8eb6135fa3874cae81238
Aug 04 16:09:03.353199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:03.353166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn" event={"ID":"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca","Type":"ContainerStarted","Data":"f6e3e35ab778f5e66f6452dea6951898ec9520b758f8eb6135fa3874cae81238"}
Aug 04 16:09:03.639586 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:03.639512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:03.762155 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:03.762119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:04.231401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.231309    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-66w78"]
Aug 04 16:09:04.235648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.235625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:04.238938 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.238896    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 04 16:09:04.246632 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.246554    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-66w78"]
Aug 04 16:09:04.327809 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.327775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86hwx\" (UniqueName: \"kubernetes.io/projected/c4348217-5101-4ecb-9a5e-8c3df020073e-kube-api-access-86hwx\") pod \"model-serving-api-54d89bd5fc-66w78\" (UID: \"c4348217-5101-4ecb-9a5e-8c3df020073e\") " pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:04.328030 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.327832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4348217-5101-4ecb-9a5e-8c3df020073e-tls-certs\") pod \"model-serving-api-54d89bd5fc-66w78\" (UID: \"c4348217-5101-4ecb-9a5e-8c3df020073e\") " pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:04.428659 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.428624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86hwx\" (UniqueName: \"kubernetes.io/projected/c4348217-5101-4ecb-9a5e-8c3df020073e-kube-api-access-86hwx\") pod \"model-serving-api-54d89bd5fc-66w78\" (UID: \"c4348217-5101-4ecb-9a5e-8c3df020073e\") " pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:04.428837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.428667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4348217-5101-4ecb-9a5e-8c3df020073e-tls-certs\") pod \"model-serving-api-54d89bd5fc-66w78\" (UID: \"c4348217-5101-4ecb-9a5e-8c3df020073e\") " pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:04.431718 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.431694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4348217-5101-4ecb-9a5e-8c3df020073e-tls-certs\") pod \"model-serving-api-54d89bd5fc-66w78\" (UID: \"c4348217-5101-4ecb-9a5e-8c3df020073e\") " pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:04.443778 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.443747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86hwx\" (UniqueName: \"kubernetes.io/projected/c4348217-5101-4ecb-9a5e-8c3df020073e-kube-api-access-86hwx\") pod \"model-serving-api-54d89bd5fc-66w78\" (UID: \"c4348217-5101-4ecb-9a5e-8c3df020073e\") " pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:04.554089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.554049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:04.721648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:04.721607    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-66w78"]
Aug 04 16:09:05.163521 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:05.163485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:05.273267 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:05.273232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:05.796438 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:05.796404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:05.982472 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:09:05.982443    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4348217_5101_4ecb_9a5e_8c3df020073e.slice/crio-f26b353a8f362de9617abc6980fce24d63fe03e8715edb29f0e7e18d3b345b2f WatchSource:0}: Error finding container f26b353a8f362de9617abc6980fce24d63fe03e8715edb29f0e7e18d3b345b2f: Status 404 returned error can't find the container with id f26b353a8f362de9617abc6980fce24d63fe03e8715edb29f0e7e18d3b345b2f
Aug 04 16:09:06.370466 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:06.370374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-66w78" event={"ID":"c4348217-5101-4ecb-9a5e-8c3df020073e","Type":"ContainerStarted","Data":"f26b353a8f362de9617abc6980fce24d63fe03e8715edb29f0e7e18d3b345b2f"}
Aug 04 16:09:06.371755 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:06.371733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn" event={"ID":"f9db57cc-6dad-495a-92a6-3fe88d3ee2ca","Type":"ContainerStarted","Data":"abb8a70a89e07fab265d202ac33c13aa50ca7004fbcd79ebf32eeead964d1f23"}
Aug 04 16:09:06.388337 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:06.388204    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-mvwcn" podStartSLOduration=1.518197232 podStartE2EDuration="4.388185277s" totalImagesPullingTime="2.869988045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:06.387528967 +0000 UTC m=+427.214226438" watchObservedRunningTime="2026-08-04 16:09:06.388185277 +0000 UTC m=+427.214882750"
Aug 04 16:09:08.382734 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:08.382689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-66w78" event={"ID":"c4348217-5101-4ecb-9a5e-8c3df020073e","Type":"ContainerStarted","Data":"fab9126143054c10927cd7bcb66e249e24107ddc38b95ec8ca0213f8cbb7ab38"}
Aug 04 16:09:08.383204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:08.382749    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:08.403360 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:08.403307    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-66w78" podStartSLOduration=2.612168013 podStartE2EDuration="4.403294259s" totalImagesPullingTime="1.791126246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:08.401631427 +0000 UTC m=+429.228328912" watchObservedRunningTime="2026-08-04 16:09:08.403294259 +0000 UTC m=+429.229991731"
Aug 04 16:09:10.296875 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.296836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:10.402218 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.402179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:10.727483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.727413    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"]
Aug 04 16:09:10.730655 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.730640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.733042 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.733021    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bhftk\""
Aug 04 16:09:10.733398 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.733387    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 16:09:10.770505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.770479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"]
Aug 04 16:09:10.788799 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.788768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.788921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.788806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.788921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.788837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a6728c5-b5b6-4746-abc7-9f92671ba669-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.789067 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.788964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.789067 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.788985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgc6t\" (UniqueName: \"kubernetes.io/projected/5a6728c5-b5b6-4746-abc7-9f92671ba669-kube-api-access-pgc6t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.789204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.789182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.789244 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.789214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.789277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.789248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.789313 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.789275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.803094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.803061    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"]
Aug 04 16:09:10.809147 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.809127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.812673 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.812631    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 16:09:10.812833 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.812819    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 16:09:10.812897 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.812862    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 16:09:10.813342 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.813329    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dd8bn\""
Aug 04 16:09:10.836784 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.836760    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"]
Aug 04 16:09:10.889771 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.889734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.889943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.889787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.889943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.889822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a6728c5-b5b6-4746-abc7-9f92671ba669-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.889943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.889848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.889943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.889875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.889943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.889931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.890181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.889973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.890181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgc6t\" (UniqueName: \"kubernetes.io/projected/5a6728c5-b5b6-4746-abc7-9f92671ba669-kube-api-access-pgc6t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890364 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890364 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890451 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pdq9\" (UniqueName: \"kubernetes.io/projected/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-kube-api-access-7pdq9\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.890451 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890451 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890642 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.890805 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.890987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.891146 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890807    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.891146 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.890834    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a6728c5-b5b6-4746-abc7-9f92671ba669-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.892887 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.892831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.893051 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.893013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.911181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.911155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgc6t\" (UniqueName: \"kubernetes.io/projected/5a6728c5-b5b6-4746-abc7-9f92671ba669-kube-api-access-pgc6t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.912685 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.912664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a6728c5-b5b6-4746-abc7-9f92671ba669-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8\" (UID: \"5a6728c5-b5b6-4746-abc7-9f92671ba669\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:10.958135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.958098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:10.992142 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.992107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.992274 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.992154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.992274 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.992172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.992274 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.992189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.992274 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.992208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.992274 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.992243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.992518 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.992319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pdq9\" (UniqueName: \"kubernetes.io/projected/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-kube-api-access-7pdq9\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.992901 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.992880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.994480 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.994453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.994669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.994649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.994980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.994959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:10.995061 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:10.995004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:11.005451 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.005433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pdq9\" (UniqueName: \"kubernetes.io/projected/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-kube-api-access-7pdq9\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:11.005898 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.005881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7256aeeb-72fc-4f5a-be79-1fcf234aeafe-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-czxzd\" (UID: \"7256aeeb-72fc-4f5a-be79-1fcf234aeafe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:11.040377 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.040351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:11.041244 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.041221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:11.118576 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.118550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:11.192203 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.192174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"]
Aug 04 16:09:11.197101 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:09:11.197072    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6728c5_b5b6_4746_abc7_9f92671ba669.slice/crio-23179e14e454300cc04ca22a03ec42a48bd28d396ea35d35ff204d6b00bc94e6 WatchSource:0}: Error finding container 23179e14e454300cc04ca22a03ec42a48bd28d396ea35d35ff204d6b00bc94e6: Status 404 returned error can't find the container with id 23179e14e454300cc04ca22a03ec42a48bd28d396ea35d35ff204d6b00bc94e6
Aug 04 16:09:11.294024 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.293999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"]
Aug 04 16:09:11.296694 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:09:11.296667    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7256aeeb_72fc_4f5a_be79_1fcf234aeafe.slice/crio-d852a013865514736f4f2f29e2f75ca9723932804d93f9b59c83ff696c11ba12 WatchSource:0}: Error finding container d852a013865514736f4f2f29e2f75ca9723932804d93f9b59c83ff696c11ba12: Status 404 returned error can't find the container with id d852a013865514736f4f2f29e2f75ca9723932804d93f9b59c83ff696c11ba12
Aug 04 16:09:11.398983 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.398927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd" event={"ID":"7256aeeb-72fc-4f5a-be79-1fcf234aeafe","Type":"ContainerStarted","Data":"d852a013865514736f4f2f29e2f75ca9723932804d93f9b59c83ff696c11ba12"}
Aug 04 16:09:11.400343 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:11.400312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8" event={"ID":"5a6728c5-b5b6-4746-abc7-9f92671ba669","Type":"ContainerStarted","Data":"23179e14e454300cc04ca22a03ec42a48bd28d396ea35d35ff204d6b00bc94e6"}
Aug 04 16:09:13.711491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:13.711440    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:09:13.711815 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:13.711530    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:09:14.421776 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:14.421743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd" event={"ID":"7256aeeb-72fc-4f5a-be79-1fcf234aeafe","Type":"ContainerStarted","Data":"1a53a12d861ecd211e34a798d6fb377844b6d33657fee3c6aeda2d010131b62d"}
Aug 04 16:09:14.422231 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:14.422182    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:14.424412 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:14.424387    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-czxzd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 16:09:14.424549 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:14.424456    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd" podUID="7256aeeb-72fc-4f5a-be79-1fcf234aeafe" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 16:09:14.481498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:14.481438    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd" podStartSLOduration=2.069018952 podStartE2EDuration="4.481418448s" totalImagesPullingTime="2.412399496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:14.478962476 +0000 UTC m=+435.305659948" watchObservedRunningTime="2026-08-04 16:09:14.481418448 +0000 UTC m=+435.308115919"
Aug 04 16:09:14.855188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:14.855148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:14.968867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:14.968827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:15.045460 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.045422    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"]
Aug 04 16:09:15.049208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.049184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:15.053009 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.052987    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 04 16:09:15.053279 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.053262    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2gqsl\""
Aug 04 16:09:15.079436 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.079412    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"]
Aug 04 16:09:15.134230 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.134143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx2gl\" (UniqueName: \"kubernetes.io/projected/a893012a-c78f-482c-8e9b-b9b27b3d50df-kube-api-access-rx2gl\") pod \"kserve-controller-manager-d6f4b65b8-42tsd\" (UID: \"a893012a-c78f-482c-8e9b-b9b27b3d50df\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:15.134230 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.134208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a893012a-c78f-482c-8e9b-b9b27b3d50df-cert\") pod \"kserve-controller-manager-d6f4b65b8-42tsd\" (UID: \"a893012a-c78f-482c-8e9b-b9b27b3d50df\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:15.138130 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.138097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:15.234765 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.234735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx2gl\" (UniqueName: \"kubernetes.io/projected/a893012a-c78f-482c-8e9b-b9b27b3d50df-kube-api-access-rx2gl\") pod \"kserve-controller-manager-d6f4b65b8-42tsd\" (UID: \"a893012a-c78f-482c-8e9b-b9b27b3d50df\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:15.234975 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.234797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a893012a-c78f-482c-8e9b-b9b27b3d50df-cert\") pod \"kserve-controller-manager-d6f4b65b8-42tsd\" (UID: \"a893012a-c78f-482c-8e9b-b9b27b3d50df\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:15.237481 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.237455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a893012a-c78f-482c-8e9b-b9b27b3d50df-cert\") pod \"kserve-controller-manager-d6f4b65b8-42tsd\" (UID: \"a893012a-c78f-482c-8e9b-b9b27b3d50df\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:15.254170 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.254146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:15.255850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.255827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx2gl\" (UniqueName: \"kubernetes.io/projected/a893012a-c78f-482c-8e9b-b9b27b3d50df-kube-api-access-rx2gl\") pod \"kserve-controller-manager-d6f4b65b8-42tsd\" (UID: \"a893012a-c78f-482c-8e9b-b9b27b3d50df\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:15.361248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.361218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:15.375067 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.375043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:15.427398 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.427335    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-czxzd"
Aug 04 16:09:15.471563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:15.471530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:16.272353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:16.272318    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:09:16.272650 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:16.272397    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:09:16.272650 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:16.272431    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:09:16.342546 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:16.342526    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"]
Aug 04 16:09:16.344953 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:09:16.344900    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda893012a_c78f_482c_8e9b_b9b27b3d50df.slice/crio-bde42ddb6f9e62daf820ed84a19f1e0b3e8abf26d975f94c24e80a7323dcd8c5 WatchSource:0}: Error finding container bde42ddb6f9e62daf820ed84a19f1e0b3e8abf26d975f94c24e80a7323dcd8c5: Status 404 returned error can't find the container with id bde42ddb6f9e62daf820ed84a19f1e0b3e8abf26d975f94c24e80a7323dcd8c5
Aug 04 16:09:16.348799 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:16.348773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:16.433414 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:16.433382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8" event={"ID":"5a6728c5-b5b6-4746-abc7-9f92671ba669","Type":"ContainerStarted","Data":"1ecf68fa924f7da5c142673cc0864ac71f7ea2bf0098aa5439f2cadbc26574eb"}
Aug 04 16:09:16.434691 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:16.434668    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd" event={"ID":"a893012a-c78f-482c-8e9b-b9b27b3d50df","Type":"ContainerStarted","Data":"bde42ddb6f9e62daf820ed84a19f1e0b3e8abf26d975f94c24e80a7323dcd8c5"}
Aug 04 16:09:16.475997 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:16.475877    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8" podStartSLOduration=1.403217622 podStartE2EDuration="6.475861063s" totalImagesPullingTime="5.072643441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:16.468964339 +0000 UTC m=+437.295661835" watchObservedRunningTime="2026-08-04 16:09:16.475861063 +0000 UTC m=+437.302558535"
Aug 04 16:09:17.041094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:17.041056    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:17.046007 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:17.045975    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:17.439816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:17.439726    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:17.440603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:17.440582    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8"
Aug 04 16:09:19.011568 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:19.011530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:19.111689 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:19.111651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:19.392596 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:19.392523    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-66w78"
Aug 04 16:09:20.457397 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:20.457322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd" event={"ID":"a893012a-c78f-482c-8e9b-b9b27b3d50df","Type":"ContainerStarted","Data":"e2a203c25efcc256d7601014b76c6b5db80afbbb7a36927e8cc690962d077c20"}
Aug 04 16:09:20.457770 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:20.457433    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:09:20.473565 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:20.473506    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd" podStartSLOduration=1.6808887879999999 podStartE2EDuration="5.473487703s" totalImagesPullingTime="3.792598915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:20.472721249 +0000 UTC m=+441.299418734" watchObservedRunningTime="2026-08-04 16:09:20.473487703 +0000 UTC m=+441.300185178"
Aug 04 16:09:51.467166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:09:51.467139    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-42tsd"
Aug 04 16:10:03.892295 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:03.892261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:03.996397 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:03.996363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:07.590150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.590110    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"]
Aug 04 16:10:07.592568 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.592553    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.594563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.594541    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qcfb5\""
Aug 04 16:10:07.594692 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.594584    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 16:10:07.595103 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.595085    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 16:10:07.603782 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.603758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"]
Aug 04 16:10:07.674197 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.674152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.674358 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.674218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.674358 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.674242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppdgp\" (UniqueName: \"kubernetes.io/projected/beab10e6-9964-4e56-9818-20137b9680dd-kube-api-access-ppdgp\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.699388 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.699358    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"]
Aug 04 16:10:07.701799 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.701784    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.748133 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.748102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"]
Aug 04 16:10:07.774882 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.774849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.775056 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.774894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9vh\" (UniqueName: \"kubernetes.io/projected/bc46df87-6c3d-4530-9a15-4e610bd72ca8-kube-api-access-4q9vh\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.775056 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.774952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppdgp\" (UniqueName: \"kubernetes.io/projected/beab10e6-9964-4e56-9818-20137b9680dd-kube-api-access-ppdgp\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.775056 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.774978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.775216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.775074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.775216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.775109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.775216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.775201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.775433 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.775412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.785672 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.785652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppdgp\" (UniqueName: \"kubernetes.io/projected/beab10e6-9964-4e56-9818-20137b9680dd-kube-api-access-ppdgp\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.792878 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.792857    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"]
Aug 04 16:10:07.795481 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.795467    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.806306 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.806281    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"]
Aug 04 16:10:07.875812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.875744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gm8\" (UniqueName: \"kubernetes.io/projected/582e47bd-3273-445a-a6ec-653a674fa4f8-kube-api-access-j9gm8\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.875812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.875781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.875812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.875812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.876087 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.875860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9vh\" (UniqueName: \"kubernetes.io/projected/bc46df87-6c3d-4530-9a15-4e610bd72ca8-kube-api-access-4q9vh\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.876087 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.875878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.876087 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.875897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.876245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.876136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.876245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.876207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.884587 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.884564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9vh\" (UniqueName: \"kubernetes.io/projected/bc46df87-6c3d-4530-9a15-4e610bd72ca8-kube-api-access-4q9vh\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:07.890647 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.890622    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"]
Aug 04 16:10:07.893753 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.893736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:07.903597 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.903169    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:07.905609 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.905582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"]
Aug 04 16:10:07.976638 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.976607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:07.976789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.976651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h76n\" (UniqueName: \"kubernetes.io/projected/5808aabb-a4eb-460d-8cd5-fc3ace20d070-kube-api-access-4h76n\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:07.976789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.976695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gm8\" (UniqueName: \"kubernetes.io/projected/582e47bd-3273-445a-a6ec-653a674fa4f8-kube-api-access-j9gm8\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.976789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.976773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.976952 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.976829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:07.976952 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.976852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.977166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.977151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.977204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.977177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:07.986389 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:07.986220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gm8\" (UniqueName: \"kubernetes.io/projected/582e47bd-3273-445a-a6ec-653a674fa4f8-kube-api-access-j9gm8\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:08.010662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.010636    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:08.046720 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.046687    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"]
Aug 04 16:10:08.047083 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:10:08.047053    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeab10e6_9964_4e56_9818_20137b9680dd.slice/crio-60c95c9339f84a1d5d8e1fc218555b9d88cbb95bed9dfe576bfca4e8d48beb1d WatchSource:0}: Error finding container 60c95c9339f84a1d5d8e1fc218555b9d88cbb95bed9dfe576bfca4e8d48beb1d: Status 404 returned error can't find the container with id 60c95c9339f84a1d5d8e1fc218555b9d88cbb95bed9dfe576bfca4e8d48beb1d
Aug 04 16:10:08.078274 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.078249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h76n\" (UniqueName: \"kubernetes.io/projected/5808aabb-a4eb-460d-8cd5-fc3ace20d070-kube-api-access-4h76n\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:08.078392 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.078356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:08.078440 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.078402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:08.078802 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.078781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:08.078870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.078826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:08.087430 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.087407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h76n\" (UniqueName: \"kubernetes.io/projected/5808aabb-a4eb-460d-8cd5-fc3ace20d070-kube-api-access-4h76n\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:08.105457 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.105255    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:08.153742 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.153563    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"]
Aug 04 16:10:08.156373 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:10:08.156348    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc46df87_6c3d_4530_9a15_4e610bd72ca8.slice/crio-1ab5d5c57ef7fc23e0c09399caa575bf6936d02db69a992be8fd0e01284c6b8b WatchSource:0}: Error finding container 1ab5d5c57ef7fc23e0c09399caa575bf6936d02db69a992be8fd0e01284c6b8b: Status 404 returned error can't find the container with id 1ab5d5c57ef7fc23e0c09399caa575bf6936d02db69a992be8fd0e01284c6b8b
Aug 04 16:10:08.203608 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.203582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:08.254940 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.254890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"]
Aug 04 16:10:08.260592 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:10:08.259282    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582e47bd_3273_445a_a6ec_653a674fa4f8.slice/crio-a8823310589f4c1653f5dd1b307b36805a8cca54c199f16b885c7180b584d8e2 WatchSource:0}: Error finding container a8823310589f4c1653f5dd1b307b36805a8cca54c199f16b885c7180b584d8e2: Status 404 returned error can't find the container with id a8823310589f4c1653f5dd1b307b36805a8cca54c199f16b885c7180b584d8e2
Aug 04 16:10:08.371353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.371331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"]
Aug 04 16:10:08.372827 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:10:08.372798    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5808aabb_a4eb_460d_8cd5_fc3ace20d070.slice/crio-37f74d3f4d3b05516c0c64672f10e480dd6524ec9bdce5c6b5bbe61ea20734c9 WatchSource:0}: Error finding container 37f74d3f4d3b05516c0c64672f10e480dd6524ec9bdce5c6b5bbe61ea20734c9: Status 404 returned error can't find the container with id 37f74d3f4d3b05516c0c64672f10e480dd6524ec9bdce5c6b5bbe61ea20734c9
Aug 04 16:10:08.373269 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.373245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:08.473756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.473728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:08.687757 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.687718    2563 generic.go:356] "Generic (PLEG): container finished" podID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerID="06019f990da04386694ff567b4b1bee17201fbe48984a0b64e14cd3abf2049b6" exitCode=0
Aug 04 16:10:08.688248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.687798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k" event={"ID":"582e47bd-3273-445a-a6ec-653a674fa4f8","Type":"ContainerDied","Data":"06019f990da04386694ff567b4b1bee17201fbe48984a0b64e14cd3abf2049b6"}
Aug 04 16:10:08.688248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.687843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k" event={"ID":"582e47bd-3273-445a-a6ec-653a674fa4f8","Type":"ContainerStarted","Data":"a8823310589f4c1653f5dd1b307b36805a8cca54c199f16b885c7180b584d8e2"}
Aug 04 16:10:08.689617 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.689596    2563 generic.go:356] "Generic (PLEG): container finished" podID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerID="413d5b79236b628736257d4bb0255048bf7626330c51846eb764241b820fc360" exitCode=0
Aug 04 16:10:08.689717 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.689690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9" event={"ID":"bc46df87-6c3d-4530-9a15-4e610bd72ca8","Type":"ContainerDied","Data":"413d5b79236b628736257d4bb0255048bf7626330c51846eb764241b820fc360"}
Aug 04 16:10:08.689780 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.689746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9" event={"ID":"bc46df87-6c3d-4530-9a15-4e610bd72ca8","Type":"ContainerStarted","Data":"1ab5d5c57ef7fc23e0c09399caa575bf6936d02db69a992be8fd0e01284c6b8b"}
Aug 04 16:10:08.691538 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.691518    2563 generic.go:356] "Generic (PLEG): container finished" podID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerID="7ebd7bb2decc0f08ee46f20bca47eb73a20c1958c91172e6175c382fa56cfceb" exitCode=0
Aug 04 16:10:08.691629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.691603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp" event={"ID":"5808aabb-a4eb-460d-8cd5-fc3ace20d070","Type":"ContainerDied","Data":"7ebd7bb2decc0f08ee46f20bca47eb73a20c1958c91172e6175c382fa56cfceb"}
Aug 04 16:10:08.691686 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.691649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp" event={"ID":"5808aabb-a4eb-460d-8cd5-fc3ace20d070","Type":"ContainerStarted","Data":"37f74d3f4d3b05516c0c64672f10e480dd6524ec9bdce5c6b5bbe61ea20734c9"}
Aug 04 16:10:08.693364 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.693343    2563 generic.go:356] "Generic (PLEG): container finished" podID="beab10e6-9964-4e56-9818-20137b9680dd" containerID="4be5e0eb816b4af3241697631ecaef7ffb7f8e7c5d14fbdf4f2d3ca906693ba5" exitCode=0
Aug 04 16:10:08.693464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.693371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97" event={"ID":"beab10e6-9964-4e56-9818-20137b9680dd","Type":"ContainerDied","Data":"4be5e0eb816b4af3241697631ecaef7ffb7f8e7c5d14fbdf4f2d3ca906693ba5"}
Aug 04 16:10:08.693464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:08.693418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97" event={"ID":"beab10e6-9964-4e56-9818-20137b9680dd","Type":"ContainerStarted","Data":"60c95c9339f84a1d5d8e1fc218555b9d88cbb95bed9dfe576bfca4e8d48beb1d"}
Aug 04 16:10:09.700448 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:09.700408    2563 generic.go:356] "Generic (PLEG): container finished" podID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerID="86d9b3ff6a20b75c342a70fcb48cf75aa23993554e13f9ab2fca5f227522519a" exitCode=0
Aug 04 16:10:09.700933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:09.700466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k" event={"ID":"582e47bd-3273-445a-a6ec-653a674fa4f8","Type":"ContainerDied","Data":"86d9b3ff6a20b75c342a70fcb48cf75aa23993554e13f9ab2fca5f227522519a"}
Aug 04 16:10:09.702458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:09.702435    2563 generic.go:356] "Generic (PLEG): container finished" podID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerID="2992453591a6f5524e618550ae5d69afc28d35bd122a2262db2cd6d598d89cdd" exitCode=0
Aug 04 16:10:09.702559 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:09.702485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp" event={"ID":"5808aabb-a4eb-460d-8cd5-fc3ace20d070","Type":"ContainerDied","Data":"2992453591a6f5524e618550ae5d69afc28d35bd122a2262db2cd6d598d89cdd"}
Aug 04 16:10:10.340073 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.340044    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:10.435251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.435180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:10.709789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.709695    2563 generic.go:356] "Generic (PLEG): container finished" podID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerID="33abf0fc34b752ea6cd4b1618a5341a7d346c17c5b2bf2dd3751dcbf433afc0c" exitCode=0
Aug 04 16:10:10.709789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.709737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp" event={"ID":"5808aabb-a4eb-460d-8cd5-fc3ace20d070","Type":"ContainerDied","Data":"33abf0fc34b752ea6cd4b1618a5341a7d346c17c5b2bf2dd3751dcbf433afc0c"}
Aug 04 16:10:10.711443 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.711422    2563 generic.go:356] "Generic (PLEG): container finished" podID="beab10e6-9964-4e56-9818-20137b9680dd" containerID="0041c6ee1573083547f6784a196b55b4f5add9e703dd2d7c99259e9d5082b32e" exitCode=0
Aug 04 16:10:10.711551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.711505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97" event={"ID":"beab10e6-9964-4e56-9818-20137b9680dd","Type":"ContainerDied","Data":"0041c6ee1573083547f6784a196b55b4f5add9e703dd2d7c99259e9d5082b32e"}
Aug 04 16:10:10.713813 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.713793    2563 generic.go:356] "Generic (PLEG): container finished" podID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerID="2180a986479ca95085dba2678456b00f5c795d539a1495bc6a681a49ee0466e6" exitCode=0
Aug 04 16:10:10.713945 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.713821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k" event={"ID":"582e47bd-3273-445a-a6ec-653a674fa4f8","Type":"ContainerDied","Data":"2180a986479ca95085dba2678456b00f5c795d539a1495bc6a681a49ee0466e6"}
Aug 04 16:10:10.715598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.715581    2563 generic.go:356] "Generic (PLEG): container finished" podID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerID="54ffe8f93ff78af8390a0c2e487167fff24272681356e3ca4b524d475fad52bb" exitCode=0
Aug 04 16:10:10.715676 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:10.715651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9" event={"ID":"bc46df87-6c3d-4530-9a15-4e610bd72ca8","Type":"ContainerDied","Data":"54ffe8f93ff78af8390a0c2e487167fff24272681356e3ca4b524d475fad52bb"}
Aug 04 16:10:11.722331 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.722290    2563 generic.go:356] "Generic (PLEG): container finished" podID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerID="3f7a43cfb27767e8173005765006c41ab5763e3198baad014fb71ddeda746a47" exitCode=0
Aug 04 16:10:11.722774 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.722355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9" event={"ID":"bc46df87-6c3d-4530-9a15-4e610bd72ca8","Type":"ContainerDied","Data":"3f7a43cfb27767e8173005765006c41ab5763e3198baad014fb71ddeda746a47"}
Aug 04 16:10:11.724390 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.724366    2563 generic.go:356] "Generic (PLEG): container finished" podID="beab10e6-9964-4e56-9818-20137b9680dd" containerID="a3d3c77404d14a6ab52e6b04ef330fb3b211753e11c86ed312abf791316b4633" exitCode=0
Aug 04 16:10:11.724514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.724437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97" event={"ID":"beab10e6-9964-4e56-9818-20137b9680dd","Type":"ContainerDied","Data":"a3d3c77404d14a6ab52e6b04ef330fb3b211753e11c86ed312abf791316b4633"}
Aug 04 16:10:11.881947 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.881921    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:11.883947 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.883931    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:11.909978 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.909952    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h76n\" (UniqueName: \"kubernetes.io/projected/5808aabb-a4eb-460d-8cd5-fc3ace20d070-kube-api-access-4h76n\") pod \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") "
Aug 04 16:10:11.910124 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.910036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-bundle\") pod \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") "
Aug 04 16:10:11.910124 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.910083    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-util\") pod \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\" (UID: \"5808aabb-a4eb-460d-8cd5-fc3ace20d070\") "
Aug 04 16:10:11.910617 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.910576    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-bundle" (OuterVolumeSpecName: "bundle") pod "5808aabb-a4eb-460d-8cd5-fc3ace20d070" (UID: "5808aabb-a4eb-460d-8cd5-fc3ace20d070"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:11.912090 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.912069    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5808aabb-a4eb-460d-8cd5-fc3ace20d070-kube-api-access-4h76n" (OuterVolumeSpecName: "kube-api-access-4h76n") pod "5808aabb-a4eb-460d-8cd5-fc3ace20d070" (UID: "5808aabb-a4eb-460d-8cd5-fc3ace20d070"). InnerVolumeSpecName "kube-api-access-4h76n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:11.915737 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:11.915713    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-util" (OuterVolumeSpecName: "util") pod "5808aabb-a4eb-460d-8cd5-fc3ace20d070" (UID: "5808aabb-a4eb-460d-8cd5-fc3ace20d070"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:12.011153 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.011126    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-bundle\") pod \"582e47bd-3273-445a-a6ec-653a674fa4f8\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") "
Aug 04 16:10:12.011281 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.011204    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9gm8\" (UniqueName: \"kubernetes.io/projected/582e47bd-3273-445a-a6ec-653a674fa4f8-kube-api-access-j9gm8\") pod \"582e47bd-3273-445a-a6ec-653a674fa4f8\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") "
Aug 04 16:10:12.011281 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.011225    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-util\") pod \"582e47bd-3273-445a-a6ec-653a674fa4f8\" (UID: \"582e47bd-3273-445a-a6ec-653a674fa4f8\") "
Aug 04 16:10:12.011356 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.011342    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h76n\" (UniqueName: \"kubernetes.io/projected/5808aabb-a4eb-460d-8cd5-fc3ace20d070-kube-api-access-4h76n\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.011390 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.011354    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.011390 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.011367    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5808aabb-a4eb-460d-8cd5-fc3ace20d070-util\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.011857 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.011831    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-bundle" (OuterVolumeSpecName: "bundle") pod "582e47bd-3273-445a-a6ec-653a674fa4f8" (UID: "582e47bd-3273-445a-a6ec-653a674fa4f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:12.013356 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.013326    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/582e47bd-3273-445a-a6ec-653a674fa4f8-kube-api-access-j9gm8" (OuterVolumeSpecName: "kube-api-access-j9gm8") pod "582e47bd-3273-445a-a6ec-653a674fa4f8" (UID: "582e47bd-3273-445a-a6ec-653a674fa4f8"). InnerVolumeSpecName "kube-api-access-j9gm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:12.016973 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.016951    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-util" (OuterVolumeSpecName: "util") pod "582e47bd-3273-445a-a6ec-653a674fa4f8" (UID: "582e47bd-3273-445a-a6ec-653a674fa4f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:12.112245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.112216    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9gm8\" (UniqueName: \"kubernetes.io/projected/582e47bd-3273-445a-a6ec-653a674fa4f8-kube-api-access-j9gm8\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.112245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.112240    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-util\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.112245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.112250    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582e47bd-3273-445a-a6ec-653a674fa4f8-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.731874 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.731834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp" event={"ID":"5808aabb-a4eb-460d-8cd5-fc3ace20d070","Type":"ContainerDied","Data":"37f74d3f4d3b05516c0c64672f10e480dd6524ec9bdce5c6b5bbe61ea20734c9"}
Aug 04 16:10:12.731874 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.731857    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ccrjvp"
Aug 04 16:10:12.732347 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.731892    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37f74d3f4d3b05516c0c64672f10e480dd6524ec9bdce5c6b5bbe61ea20734c9"
Aug 04 16:10:12.733805 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.733788    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k"
Aug 04 16:10:12.733938 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.733821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053q4b6k" event={"ID":"582e47bd-3273-445a-a6ec-653a674fa4f8","Type":"ContainerDied","Data":"a8823310589f4c1653f5dd1b307b36805a8cca54c199f16b885c7180b584d8e2"}
Aug 04 16:10:12.733938 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.733856    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8823310589f4c1653f5dd1b307b36805a8cca54c199f16b885c7180b584d8e2"
Aug 04 16:10:12.871329 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.871307    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:12.900876 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.900850    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:12.918702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.918676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-util\") pod \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") "
Aug 04 16:10:12.919593 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.918800    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q9vh\" (UniqueName: \"kubernetes.io/projected/bc46df87-6c3d-4530-9a15-4e610bd72ca8-kube-api-access-4q9vh\") pod \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") "
Aug 04 16:10:12.919593 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.918847    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-bundle\") pod \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\" (UID: \"bc46df87-6c3d-4530-9a15-4e610bd72ca8\") "
Aug 04 16:10:12.920011 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.919986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-bundle" (OuterVolumeSpecName: "bundle") pod "bc46df87-6c3d-4530-9a15-4e610bd72ca8" (UID: "bc46df87-6c3d-4530-9a15-4e610bd72ca8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:12.921757 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.921729    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc46df87-6c3d-4530-9a15-4e610bd72ca8-kube-api-access-4q9vh" (OuterVolumeSpecName: "kube-api-access-4q9vh") pod "bc46df87-6c3d-4530-9a15-4e610bd72ca8" (UID: "bc46df87-6c3d-4530-9a15-4e610bd72ca8"). InnerVolumeSpecName "kube-api-access-4q9vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:12.926747 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:12.926720    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-util" (OuterVolumeSpecName: "util") pod "bc46df87-6c3d-4530-9a15-4e610bd72ca8" (UID: "bc46df87-6c3d-4530-9a15-4e610bd72ca8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:13.020366 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.020336    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppdgp\" (UniqueName: \"kubernetes.io/projected/beab10e6-9964-4e56-9818-20137b9680dd-kube-api-access-ppdgp\") pod \"beab10e6-9964-4e56-9818-20137b9680dd\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") "
Aug 04 16:10:13.020509 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.020409    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-util\") pod \"beab10e6-9964-4e56-9818-20137b9680dd\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") "
Aug 04 16:10:13.020509 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.020486    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-bundle\") pod \"beab10e6-9964-4e56-9818-20137b9680dd\" (UID: \"beab10e6-9964-4e56-9818-20137b9680dd\") "
Aug 04 16:10:13.020675 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.020654    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q9vh\" (UniqueName: \"kubernetes.io/projected/bc46df87-6c3d-4530-9a15-4e610bd72ca8-kube-api-access-4q9vh\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:13.020675 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.020676    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:13.020834 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.020689    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc46df87-6c3d-4530-9a15-4e610bd72ca8-util\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:13.020924 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.020886    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-bundle" (OuterVolumeSpecName: "bundle") pod "beab10e6-9964-4e56-9818-20137b9680dd" (UID: "beab10e6-9964-4e56-9818-20137b9680dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:13.022396 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.022374    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beab10e6-9964-4e56-9818-20137b9680dd-kube-api-access-ppdgp" (OuterVolumeSpecName: "kube-api-access-ppdgp") pod "beab10e6-9964-4e56-9818-20137b9680dd" (UID: "beab10e6-9964-4e56-9818-20137b9680dd"). InnerVolumeSpecName "kube-api-access-ppdgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:13.028573 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.028547    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-util" (OuterVolumeSpecName: "util") pod "beab10e6-9964-4e56-9818-20137b9680dd" (UID: "beab10e6-9964-4e56-9818-20137b9680dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:13.121474 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.121432    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:13.121474 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.121473    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppdgp\" (UniqueName: \"kubernetes.io/projected/beab10e6-9964-4e56-9818-20137b9680dd-kube-api-access-ppdgp\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:13.121474 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.121483    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/beab10e6-9964-4e56-9818-20137b9680dd-util\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:13.740074 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.740051    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9"
Aug 04 16:10:13.740437 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.740072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6z8k9" event={"ID":"bc46df87-6c3d-4530-9a15-4e610bd72ca8","Type":"ContainerDied","Data":"1ab5d5c57ef7fc23e0c09399caa575bf6936d02db69a992be8fd0e01284c6b8b"}
Aug 04 16:10:13.740437 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.740117    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ab5d5c57ef7fc23e0c09399caa575bf6936d02db69a992be8fd0e01284c6b8b"
Aug 04 16:10:13.742186 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.742160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97" event={"ID":"beab10e6-9964-4e56-9818-20137b9680dd","Type":"ContainerDied","Data":"60c95c9339f84a1d5d8e1fc218555b9d88cbb95bed9dfe576bfca4e8d48beb1d"}
Aug 04 16:10:13.742284 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.742199    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60c95c9339f84a1d5d8e1fc218555b9d88cbb95bed9dfe576bfca4e8d48beb1d"
Aug 04 16:10:13.742284 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:13.742266    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0src97"
Aug 04 16:10:17.811429 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:17.811393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:20.603301 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:20.603268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:21.955440 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955405    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"]
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955745    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerName="util"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955756    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerName="util"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955768    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerName="pull"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955773    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerName="pull"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955784    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerName="pull"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955791    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerName="pull"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955796    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerName="extract"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955801    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerName="extract"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955808    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerName="util"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955813    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerName="util"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955819    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerName="util"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955824    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerName="util"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955829    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerName="extract"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955835    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerName="extract"
Aug 04 16:10:21.955837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955846    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerName="extract"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955851    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerName="extract"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955859    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beab10e6-9964-4e56-9818-20137b9680dd" containerName="util"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955863    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="beab10e6-9964-4e56-9818-20137b9680dd" containerName="util"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955870    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beab10e6-9964-4e56-9818-20137b9680dd" containerName="pull"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955875    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="beab10e6-9964-4e56-9818-20137b9680dd" containerName="pull"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955882    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerName="pull"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955887    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerName="pull"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955894    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beab10e6-9964-4e56-9818-20137b9680dd" containerName="extract"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955899    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="beab10e6-9964-4e56-9818-20137b9680dd" containerName="extract"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955966    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5808aabb-a4eb-460d-8cd5-fc3ace20d070" containerName="extract"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955974    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc46df87-6c3d-4530-9a15-4e610bd72ca8" containerName="extract"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955982    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="beab10e6-9964-4e56-9818-20137b9680dd" containerName="extract"
Aug 04 16:10:21.956304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.955988    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="582e47bd-3273-445a-a6ec-653a674fa4f8" containerName="extract"
Aug 04 16:10:21.958997 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.958981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"
Aug 04 16:10:21.961189 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.961164    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 16:10:21.961327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.961211    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 16:10:21.961327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.961212    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rlnf6\""
Aug 04 16:10:21.961327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.961317    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 04 16:10:21.971368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:21.971342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"]
Aug 04 16:10:22.102760 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.102721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-577bd\" (UniqueName: \"kubernetes.io/projected/6c3d6cd6-67b0-461e-bf85-269379d50f1e-kube-api-access-577bd\") pod \"dns-operator-controller-manager-5985564776-jc5h9\" (UID: \"6c3d6cd6-67b0-461e-bf85-269379d50f1e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"
Aug 04 16:10:22.203647 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.203611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-577bd\" (UniqueName: \"kubernetes.io/projected/6c3d6cd6-67b0-461e-bf85-269379d50f1e-kube-api-access-577bd\") pod \"dns-operator-controller-manager-5985564776-jc5h9\" (UID: \"6c3d6cd6-67b0-461e-bf85-269379d50f1e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"
Aug 04 16:10:22.225333 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.225265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-577bd\" (UniqueName: \"kubernetes.io/projected/6c3d6cd6-67b0-461e-bf85-269379d50f1e-kube-api-access-577bd\") pod \"dns-operator-controller-manager-5985564776-jc5h9\" (UID: \"6c3d6cd6-67b0-461e-bf85-269379d50f1e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"
Aug 04 16:10:22.239933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.239876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:22.269413 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.269389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"
Aug 04 16:10:22.407508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.407486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"]
Aug 04 16:10:22.409621 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:10:22.409587    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3d6cd6_67b0_461e_bf85_269379d50f1e.slice/crio-61490395ca5dcf05e68e3ca311770f869b4fb34f52c8bbdf61b2ca1362e5a49f WatchSource:0}: Error finding container 61490395ca5dcf05e68e3ca311770f869b4fb34f52c8bbdf61b2ca1362e5a49f: Status 404 returned error can't find the container with id 61490395ca5dcf05e68e3ca311770f869b4fb34f52c8bbdf61b2ca1362e5a49f
Aug 04 16:10:22.603979 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.603951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:22.795819 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.795782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9" event={"ID":"6c3d6cd6-67b0-461e-bf85-269379d50f1e","Type":"ContainerStarted","Data":"61490395ca5dcf05e68e3ca311770f869b4fb34f52c8bbdf61b2ca1362e5a49f"}
Aug 04 16:10:22.891181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:22.891097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:24.596837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:24.596805    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-9dpzb"]
Aug 04 16:10:24.606037 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:24.606008    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb"
Aug 04 16:10:24.608323 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:24.608304    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8lcrv\""
Aug 04 16:10:24.613598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:24.613577    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-9dpzb"]
Aug 04 16:10:24.727079 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:24.727041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bztp\" (UniqueName: \"kubernetes.io/projected/9007023b-52bd-40f7-8e30-7cc89d1e20e7-kube-api-access-2bztp\") pod \"authorino-operator-68d88948d8-9dpzb\" (UID: \"9007023b-52bd-40f7-8e30-7cc89d1e20e7\") " pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb"
Aug 04 16:10:24.828552 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:24.828522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bztp\" (UniqueName: \"kubernetes.io/projected/9007023b-52bd-40f7-8e30-7cc89d1e20e7-kube-api-access-2bztp\") pod \"authorino-operator-68d88948d8-9dpzb\" (UID: \"9007023b-52bd-40f7-8e30-7cc89d1e20e7\") " pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb"
Aug 04 16:10:24.844538 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:24.844511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bztp\" (UniqueName: \"kubernetes.io/projected/9007023b-52bd-40f7-8e30-7cc89d1e20e7-kube-api-access-2bztp\") pod \"authorino-operator-68d88948d8-9dpzb\" (UID: \"9007023b-52bd-40f7-8e30-7cc89d1e20e7\") " pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb"
Aug 04 16:10:24.919882 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:24.919785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb"
Aug 04 16:10:25.335551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:25.335525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-9dpzb"]
Aug 04 16:10:25.337317 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:10:25.337291    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9007023b_52bd_40f7_8e30_7cc89d1e20e7.slice/crio-c5c2f73d9faf7df74b29d48c55a7296deab7112d08aa2de96302fc632327bd1b WatchSource:0}: Error finding container c5c2f73d9faf7df74b29d48c55a7296deab7112d08aa2de96302fc632327bd1b: Status 404 returned error can't find the container with id c5c2f73d9faf7df74b29d48c55a7296deab7112d08aa2de96302fc632327bd1b
Aug 04 16:10:25.815706 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:25.815672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9" event={"ID":"6c3d6cd6-67b0-461e-bf85-269379d50f1e","Type":"ContainerStarted","Data":"c328b95534bda875165df6f933a418a43adec3a3e0f81ee488b84d9827026ac4"}
Aug 04 16:10:25.816189 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:25.815782    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"
Aug 04 16:10:25.817012 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:25.816987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb" event={"ID":"9007023b-52bd-40f7-8e30-7cc89d1e20e7","Type":"ContainerStarted","Data":"c5c2f73d9faf7df74b29d48c55a7296deab7112d08aa2de96302fc632327bd1b"}
Aug 04 16:10:25.835680 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:25.835629    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9" podStartSLOduration=1.995004003 podStartE2EDuration="4.835616577s" totalImagesPullingTime="2.840612574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:10:25.834240993 +0000 UTC m=+506.660938477" watchObservedRunningTime="2026-08-04 16:10:25.835616577 +0000 UTC m=+506.662314048"
Aug 04 16:10:27.886170 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:27.886120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:27.990549 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:27.990516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:29.839821 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:29.839785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb" event={"ID":"9007023b-52bd-40f7-8e30-7cc89d1e20e7","Type":"ContainerStarted","Data":"cf87039bed533a3ecad2df7a98be00c892adab5c05ced6920c7e7fd1e67b5826"}
Aug 04 16:10:29.840236 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:29.839963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb"
Aug 04 16:10:30.411251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:30.411214    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:30.524011 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:30.523975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:33.213336 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:33.213303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:33.313546 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:33.313513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:36.154052 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:36.154018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:36.288837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:36.288806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:36.825013 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:36.824985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-jc5h9"
Aug 04 16:10:36.857224 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:36.857176    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb" podStartSLOduration=8.963885259 podStartE2EDuration="12.857162899s" totalImagesPullingTime="3.89327764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:10:29.857364234 +0000 UTC m=+510.684061740" watchObservedRunningTime="2026-08-04 16:10:36.857162899 +0000 UTC m=+517.683860371"
Aug 04 16:10:38.230783 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:38.230755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:38.330928 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:38.330882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:40.847312 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:40.847275    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-9dpzb"
Aug 04 16:10:42.999160 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:42.999127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:43.098077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:43.098047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:43.197723 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:43.197691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:47.194186 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.194146    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"]
Aug 04 16:10:47.206176 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.206146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:47.208392 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.208369    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jzpbj\""
Aug 04 16:10:47.212228 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.212201    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"]
Aug 04 16:10:47.322818 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.322786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkln9\" (UniqueName: \"kubernetes.io/projected/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-kube-api-access-zkln9\") pod \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" (UID: \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:47.323002 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.322867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" (UID: \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:47.424081 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.424044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkln9\" (UniqueName: \"kubernetes.io/projected/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-kube-api-access-zkln9\") pod \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" (UID: \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:47.424237 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.424113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" (UID: \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:47.424461 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.424445    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" (UID: \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:47.433648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.433625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkln9\" (UniqueName: \"kubernetes.io/projected/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-kube-api-access-zkln9\") pod \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" (UID: \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:47.460065 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.459987    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"]
Aug 04 16:10:47.460372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.460355    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:47.464734 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.464689    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"]
Aug 04 16:10:47.486284 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.486250    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"]
Aug 04 16:10:47.491135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.491108    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:47.512885 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.512854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"]
Aug 04 16:10:47.525457 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.525427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q9hv\" (UniqueName: \"kubernetes.io/projected/a0107b3b-77f0-4840-a353-6ea42af7f130-kube-api-access-7q9hv\") pod \"kuadrant-operator-controller-manager-6bd956ccf-rcksb\" (UID: \"a0107b3b-77f0-4840-a353-6ea42af7f130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:47.525584 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.525489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0107b3b-77f0-4840-a353-6ea42af7f130-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-rcksb\" (UID: \"a0107b3b-77f0-4840-a353-6ea42af7f130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:47.626725 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.626690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0107b3b-77f0-4840-a353-6ea42af7f130-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-rcksb\" (UID: \"a0107b3b-77f0-4840-a353-6ea42af7f130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:47.626952 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.626805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q9hv\" (UniqueName: \"kubernetes.io/projected/a0107b3b-77f0-4840-a353-6ea42af7f130-kube-api-access-7q9hv\") pod \"kuadrant-operator-controller-manager-6bd956ccf-rcksb\" (UID: \"a0107b3b-77f0-4840-a353-6ea42af7f130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:47.627183 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.627162    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0107b3b-77f0-4840-a353-6ea42af7f130-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-rcksb\" (UID: \"a0107b3b-77f0-4840-a353-6ea42af7f130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:47.637894 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.637872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q9hv\" (UniqueName: \"kubernetes.io/projected/a0107b3b-77f0-4840-a353-6ea42af7f130-kube-api-access-7q9hv\") pod \"kuadrant-operator-controller-manager-6bd956ccf-rcksb\" (UID: \"a0107b3b-77f0-4840-a353-6ea42af7f130\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:47.803687 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.803656    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:47.945747 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:47.945723    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"]
Aug 04 16:10:47.947547 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:10:47.947521    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0107b3b_77f0_4840_a353_6ea42af7f130.slice/crio-d7db4945fc4e07e028f565421a9dcf93991eccc9ebcb890530c803b31d8bb90d WatchSource:0}: Error finding container d7db4945fc4e07e028f565421a9dcf93991eccc9ebcb890530c803b31d8bb90d: Status 404 returned error can't find the container with id d7db4945fc4e07e028f565421a9dcf93991eccc9ebcb890530c803b31d8bb90d
Aug 04 16:10:48.943266 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:48.943231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb" event={"ID":"a0107b3b-77f0-4840-a353-6ea42af7f130","Type":"ContainerStarted","Data":"d7db4945fc4e07e028f565421a9dcf93991eccc9ebcb890530c803b31d8bb90d"}
Aug 04 16:10:49.685922 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:49.685870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:49.792733 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:49.792698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:50.020615 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:10:50.020560    2563 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6bd956ccf-czsj7_kuadrant-system_bc33dd57-b2f0-46e3-9029-e12e69b4bfcf_0(f3ecd3a92a8a6383ad16a931a5d962f7b734c38897dfb6ad938618b420c3c7ad): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6bd956ccf-czsj7 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Aug 04 16:10:50.020988 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:10:50.020649    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6bd956ccf-czsj7_kuadrant-system_bc33dd57-b2f0-46e3-9029-e12e69b4bfcf_0(f3ecd3a92a8a6383ad16a931a5d962f7b734c38897dfb6ad938618b420c3c7ad): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6bd956ccf-czsj7 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:50.393599 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:50.393516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:50.493651 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:50.493609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:50.955480 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:50.955445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:50.957313 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:10:50.957281    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="bc33dd57-b2f0-46e3-9029-e12e69b4bfcf" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:50.962660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:50.962634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:50.965015 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:10:50.964982    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="bc33dd57-b2f0-46e3-9029-e12e69b4bfcf" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:51.058579 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.058542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkln9\" (UniqueName: \"kubernetes.io/projected/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-kube-api-access-zkln9\") pod \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\" (UID: \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\") "
Aug 04 16:10:51.059073 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.058612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-extensions-socket-volume\") pod \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\" (UID: \"bc33dd57-b2f0-46e3-9029-e12e69b4bfcf\") "
Aug 04 16:10:51.059400 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.059364    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bc33dd57-b2f0-46e3-9029-e12e69b4bfcf" (UID: "bc33dd57-b2f0-46e3-9029-e12e69b4bfcf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:51.066406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.066364    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-kube-api-access-zkln9" (OuterVolumeSpecName: "kube-api-access-zkln9") pod "bc33dd57-b2f0-46e3-9029-e12e69b4bfcf" (UID: "bc33dd57-b2f0-46e3-9029-e12e69b4bfcf"). InnerVolumeSpecName "kube-api-access-zkln9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:51.160303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.160261    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkln9\" (UniqueName: \"kubernetes.io/projected/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-kube-api-access-zkln9\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:51.160303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.160299    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf-extensions-socket-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:10:51.716650 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.716615    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc33dd57-b2f0-46e3-9029-e12e69b4bfcf" path="/var/lib/kubelet/pods/bc33dd57-b2f0-46e3-9029-e12e69b4bfcf/volumes"
Aug 04 16:10:51.962366 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.962271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb" event={"ID":"a0107b3b-77f0-4840-a353-6ea42af7f130","Type":"ContainerStarted","Data":"6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797"}
Aug 04 16:10:51.962366 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.962315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:51.962598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.962410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:10:51.984256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:51.984211    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb" podStartSLOduration=1.411558423 podStartE2EDuration="4.984195727s" totalImagesPullingTime="3.572637304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:10:51.983231584 +0000 UTC m=+532.809929056" watchObservedRunningTime="2026-08-04 16:10:51.984195727 +0000 UTC m=+532.810893199"
Aug 04 16:10:51.985782 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:10:51.985751    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-czsj7\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="bc33dd57-b2f0-46e3-9029-e12e69b4bfcf" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-czsj7"
Aug 04 16:10:52.669355 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:52.669253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:52.769957 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:52.769921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:58.465048 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:58.465012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:58.528792 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:58.528762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:59.065095 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:59.065065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:59.118291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:10:59.118263    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:02.540900 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:02.540867    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:02.636333 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:02.636296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:02.737954 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:02.737902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:02.970936 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:02.970843    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:11:03.277645 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.277614    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"]
Aug 04 16:11:03.282741 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.282722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:03.303486 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.303462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"]
Aug 04 16:11:03.362648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.362623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42068674-374a-4e52-a19b-7515900a1e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-drjqr\" (UID: \"42068674-374a-4e52-a19b-7515900a1e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:03.362795 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.362677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvtqp\" (UniqueName: \"kubernetes.io/projected/42068674-374a-4e52-a19b-7515900a1e98-kube-api-access-nvtqp\") pod \"kuadrant-operator-controller-manager-68cf589589-drjqr\" (UID: \"42068674-374a-4e52-a19b-7515900a1e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:03.463501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.463468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtqp\" (UniqueName: \"kubernetes.io/projected/42068674-374a-4e52-a19b-7515900a1e98-kube-api-access-nvtqp\") pod \"kuadrant-operator-controller-manager-68cf589589-drjqr\" (UID: \"42068674-374a-4e52-a19b-7515900a1e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:03.463673 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.463562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42068674-374a-4e52-a19b-7515900a1e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-drjqr\" (UID: \"42068674-374a-4e52-a19b-7515900a1e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:03.463962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.463931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42068674-374a-4e52-a19b-7515900a1e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-drjqr\" (UID: \"42068674-374a-4e52-a19b-7515900a1e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:03.475472 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.475449    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtqp\" (UniqueName: \"kubernetes.io/projected/42068674-374a-4e52-a19b-7515900a1e98-kube-api-access-nvtqp\") pod \"kuadrant-operator-controller-manager-68cf589589-drjqr\" (UID: \"42068674-374a-4e52-a19b-7515900a1e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:03.593687 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.593661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:03.744765 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:11:03.744730    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42068674_374a_4e52_a19b_7515900a1e98.slice/crio-320d8fc3c2a34a844a72d85ae404f63486b9499ea0067b55453279ce518e196d WatchSource:0}: Error finding container 320d8fc3c2a34a844a72d85ae404f63486b9499ea0067b55453279ce518e196d: Status 404 returned error can't find the container with id 320d8fc3c2a34a844a72d85ae404f63486b9499ea0067b55453279ce518e196d
Aug 04 16:11:03.746214 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:03.746193    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"]
Aug 04 16:11:04.028475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:04.028443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr" event={"ID":"42068674-374a-4e52-a19b-7515900a1e98","Type":"ContainerStarted","Data":"1a1e757d59a345e782fcdc17324530064c1d35c63327ab4fb0f05100d25a0889"}
Aug 04 16:11:04.028673 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:04.028491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr" event={"ID":"42068674-374a-4e52-a19b-7515900a1e98","Type":"ContainerStarted","Data":"320d8fc3c2a34a844a72d85ae404f63486b9499ea0067b55453279ce518e196d"}
Aug 04 16:11:04.028673 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:04.028541    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:04.050427 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:04.050380    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr" podStartSLOduration=1.050355169 podStartE2EDuration="1.050355169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:11:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:04.049887575 +0000 UTC m=+544.876585039" watchObservedRunningTime="2026-08-04 16:11:04.050355169 +0000 UTC m=+544.877052642"
Aug 04 16:11:15.036167 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.036135    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:11:15.098179 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.098147    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"]
Aug 04 16:11:15.098404 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.098378    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb" podUID="a0107b3b-77f0-4840-a353-6ea42af7f130" containerName="manager" containerID="cri-o://6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797" gracePeriod=10
Aug 04 16:11:15.345310 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.345288    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:11:15.477261 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.477228    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q9hv\" (UniqueName: \"kubernetes.io/projected/a0107b3b-77f0-4840-a353-6ea42af7f130-kube-api-access-7q9hv\") pod \"a0107b3b-77f0-4840-a353-6ea42af7f130\" (UID: \"a0107b3b-77f0-4840-a353-6ea42af7f130\") "
Aug 04 16:11:15.477449 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.477291    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0107b3b-77f0-4840-a353-6ea42af7f130-extensions-socket-volume\") pod \"a0107b3b-77f0-4840-a353-6ea42af7f130\" (UID: \"a0107b3b-77f0-4840-a353-6ea42af7f130\") "
Aug 04 16:11:15.477689 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.477666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0107b3b-77f0-4840-a353-6ea42af7f130-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a0107b3b-77f0-4840-a353-6ea42af7f130" (UID: "a0107b3b-77f0-4840-a353-6ea42af7f130"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:11:15.479672 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.479645    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0107b3b-77f0-4840-a353-6ea42af7f130-kube-api-access-7q9hv" (OuterVolumeSpecName: "kube-api-access-7q9hv") pod "a0107b3b-77f0-4840-a353-6ea42af7f130" (UID: "a0107b3b-77f0-4840-a353-6ea42af7f130"). InnerVolumeSpecName "kube-api-access-7q9hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:11:15.578216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.578139    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q9hv\" (UniqueName: \"kubernetes.io/projected/a0107b3b-77f0-4840-a353-6ea42af7f130-kube-api-access-7q9hv\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:11:15.578216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:15.578166    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0107b3b-77f0-4840-a353-6ea42af7f130-extensions-socket-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:11:16.094165 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.094130    2563 generic.go:356] "Generic (PLEG): container finished" podID="a0107b3b-77f0-4840-a353-6ea42af7f130" containerID="6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797" exitCode=0
Aug 04 16:11:16.094563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.094177    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"
Aug 04 16:11:16.094563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.094204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb" event={"ID":"a0107b3b-77f0-4840-a353-6ea42af7f130","Type":"ContainerDied","Data":"6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797"}
Aug 04 16:11:16.094563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.094255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb" event={"ID":"a0107b3b-77f0-4840-a353-6ea42af7f130","Type":"ContainerDied","Data":"d7db4945fc4e07e028f565421a9dcf93991eccc9ebcb890530c803b31d8bb90d"}
Aug 04 16:11:16.094563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.094284    2563 scope.go:117] "RemoveContainer" containerID="6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797"
Aug 04 16:11:16.103462 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.103277    2563 scope.go:117] "RemoveContainer" containerID="6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797"
Aug 04 16:11:16.103525 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:11:16.103504    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797\": container with ID starting with 6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797 not found: ID does not exist" containerID="6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797"
Aug 04 16:11:16.103566 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.103530    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797"} err="failed to get container status \"6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797\": rpc error: code = NotFound desc = could not find container \"6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797\": container with ID starting with 6860ea4dd5d5518574a7351b10d5845ae2d726ca06e6b9abc00640eac5039797 not found: ID does not exist"
Aug 04 16:11:16.120224 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.120194    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"]
Aug 04 16:11:16.127772 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:16.127752    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-rcksb"]
Aug 04 16:11:17.021643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:17.021610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:17.716683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:17.716651    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0107b3b-77f0-4840-a353-6ea42af7f130" path="/var/lib/kubelet/pods/a0107b3b-77f0-4840-a353-6ea42af7f130/volumes"
Aug 04 16:11:19.424303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:19.424267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:19.999315 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:19.999279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:29.563914 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:29.563881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:34.645963 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:34.645927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:34.745091 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:34.745058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:34.808863 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:34.808830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:35.513128 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:35.513090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:35.601106 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:35.601071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:46.644355 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:46.644324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:52.251760 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:52.251713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:52.409208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:52.409176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:52.768233 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:52.768205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:11:59.602388 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:59.602348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:11:59.605414 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:11:59.605394    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:12:05.352712 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:05.352681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:06.631327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:06.631289    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:13.005654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.005609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:13.113953 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.113893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:13.215954 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.215890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:13.228816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.228786    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-cw5n9"]
Aug 04 16:12:13.229179 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.229166    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0107b3b-77f0-4840-a353-6ea42af7f130" containerName="manager"
Aug 04 16:12:13.229240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.229181    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0107b3b-77f0-4840-a353-6ea42af7f130" containerName="manager"
Aug 04 16:12:13.229284 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.229249    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0107b3b-77f0-4840-a353-6ea42af7f130" containerName="manager"
Aug 04 16:12:13.232009 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.231992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:13.234152 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.234131    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 16:12:13.234723 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.234701    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kqxq7\""
Aug 04 16:12:13.234811 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.234723    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 16:12:13.244793 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.244771    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-cw5n9"]
Aug 04 16:12:13.278628 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.278556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-webhook-cert\") pod \"maas-controller-76cc9b5f7d-cw5n9\" (UID: \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\") " pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:13.278755 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.278630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hfvv\" (UniqueName: \"kubernetes.io/projected/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-kube-api-access-5hfvv\") pod \"maas-controller-76cc9b5f7d-cw5n9\" (UID: \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\") " pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:13.314749 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.314722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:13.379464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.379439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-webhook-cert\") pod \"maas-controller-76cc9b5f7d-cw5n9\" (UID: \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\") " pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:13.379601 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.379481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hfvv\" (UniqueName: \"kubernetes.io/projected/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-kube-api-access-5hfvv\") pod \"maas-controller-76cc9b5f7d-cw5n9\" (UID: \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\") " pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:13.381958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.381935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-webhook-cert\") pod \"maas-controller-76cc9b5f7d-cw5n9\" (UID: \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\") " pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:13.387671 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.387639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hfvv\" (UniqueName: \"kubernetes.io/projected/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-kube-api-access-5hfvv\") pod \"maas-controller-76cc9b5f7d-cw5n9\" (UID: \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\") " pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:13.542391 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.542298    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:13.680270 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:13.680242    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-cw5n9"]
Aug 04 16:12:13.681767 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:12:13.681737    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4439ef_6a5a_4480_a925_42ccaf2d4e43.slice/crio-9c1672d3b475f70ac39978e19893a21442b5a72f3cc410ec5ad3254f16fa9ab3 WatchSource:0}: Error finding container 9c1672d3b475f70ac39978e19893a21442b5a72f3cc410ec5ad3254f16fa9ab3: Status 404 returned error can't find the container with id 9c1672d3b475f70ac39978e19893a21442b5a72f3cc410ec5ad3254f16fa9ab3
Aug 04 16:12:14.416973 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:14.416929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9" event={"ID":"cb4439ef-6a5a-4480-a925-42ccaf2d4e43","Type":"ContainerStarted","Data":"9c1672d3b475f70ac39978e19893a21442b5a72f3cc410ec5ad3254f16fa9ab3"}
Aug 04 16:12:16.094832 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:16.094765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:16.185544 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:16.185449    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:16.431662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:16.431625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9" event={"ID":"cb4439ef-6a5a-4480-a925-42ccaf2d4e43","Type":"ContainerStarted","Data":"64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a"}
Aug 04 16:12:16.431855 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:16.431732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:16.451831 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:16.451737    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9" podStartSLOduration=1.207300565 podStartE2EDuration="3.451722175s" totalImagesPullingTime="2.24442161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:12:16.449934551 +0000 UTC m=+617.276632020" watchObservedRunningTime="2026-08-04 16:12:16.451722175 +0000 UTC m=+617.278419646"
Aug 04 16:12:27.439868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:27.439792    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:12:47.689925 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:47.689880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:47.782878 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:47.782843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:49.358216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.358186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:49.429380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.429347    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67c8968587-h8p52"]
Aug 04 16:12:49.432833 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.432814    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.435689 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.435669    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 16:12:49.435810 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.435707    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 04 16:12:49.435941 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.435927    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7kwkk\""
Aug 04 16:12:49.436012 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.435959    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 16:12:49.445751 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.445727    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c8968587-h8p52"]
Aug 04 16:12:49.468579 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.468557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:49.570770 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.570738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5zmn\" (UniqueName: \"kubernetes.io/projected/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-kube-api-access-t5zmn\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.570970 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.570790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-maas-api-tls\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.570970 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.570855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-openshift-service-ca\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.671688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.671604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-maas-api-tls\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.671688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.671648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-openshift-service-ca\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.671940 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.671761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5zmn\" (UniqueName: \"kubernetes.io/projected/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-kube-api-access-t5zmn\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.672618 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.672597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-openshift-service-ca\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.674579 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.674552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-maas-api-tls\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.685966 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.685892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5zmn\" (UniqueName: \"kubernetes.io/projected/7d39ef9b-93a4-4c1d-9162-a87e71de7b3d-kube-api-access-t5zmn\") pod \"maas-api-67c8968587-h8p52\" (UID: \"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d\") " pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.743088 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.743052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:49.854118 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.854086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:49.891707 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.891680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c8968587-h8p52"]
Aug 04 16:12:49.893377 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:12:49.893346    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d39ef9b_93a4_4c1d_9162_a87e71de7b3d.slice/crio-5d9821672f54b2e37cd8ec504af6f4e49a4ffeadaef9cabc9b26956b66c73c14 WatchSource:0}: Error finding container 5d9821672f54b2e37cd8ec504af6f4e49a4ffeadaef9cabc9b26956b66c73c14: Status 404 returned error can't find the container with id 5d9821672f54b2e37cd8ec504af6f4e49a4ffeadaef9cabc9b26956b66c73c14
Aug 04 16:12:49.894930 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.894888    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:12:49.952067 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.951962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:49.958849 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.958822    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"]
Aug 04 16:12:49.963422 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.963407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:49.965587 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.965571    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 04 16:12:49.975524 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.975501    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"]
Aug 04 16:12:49.999117 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:49.999086    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-rjj74"]
Aug 04 16:12:50.002495 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.002478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:50.005100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.005078    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2xgnb\""
Aug 04 16:12:50.014628 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.014605    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-rjj74"]
Aug 04 16:12:50.076979 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.076941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67a520b9-9663-482d-90c1-b14743896017-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-rjj74\" (UID: \"67a520b9-9663-482d-90c1-b14743896017\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:50.077150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.077004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pcrm\" (UniqueName: \"kubernetes.io/projected/67a520b9-9663-482d-90c1-b14743896017-kube-api-access-2pcrm\") pod \"payload-processing-5cc6cd444b-rjj74\" (UID: \"67a520b9-9663-482d-90c1-b14743896017\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:50.077150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.077069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb1d33ce-0355-4019-af14-5644bd4aef45-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-m4q6d\" (UID: \"fb1d33ce-0355-4019-af14-5644bd4aef45\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:50.077150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.077116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92fvh\" (UniqueName: \"kubernetes.io/projected/fb1d33ce-0355-4019-af14-5644bd4aef45-kube-api-access-92fvh\") pod \"payload-pre-processing-687dbb6cf6-m4q6d\" (UID: \"fb1d33ce-0355-4019-af14-5644bd4aef45\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:50.178288 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.178252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67a520b9-9663-482d-90c1-b14743896017-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-rjj74\" (UID: \"67a520b9-9663-482d-90c1-b14743896017\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:50.178476 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.178303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pcrm\" (UniqueName: \"kubernetes.io/projected/67a520b9-9663-482d-90c1-b14743896017-kube-api-access-2pcrm\") pod \"payload-processing-5cc6cd444b-rjj74\" (UID: \"67a520b9-9663-482d-90c1-b14743896017\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:50.178476 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.178352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb1d33ce-0355-4019-af14-5644bd4aef45-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-m4q6d\" (UID: \"fb1d33ce-0355-4019-af14-5644bd4aef45\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:50.178476 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.178374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92fvh\" (UniqueName: \"kubernetes.io/projected/fb1d33ce-0355-4019-af14-5644bd4aef45-kube-api-access-92fvh\") pod \"payload-pre-processing-687dbb6cf6-m4q6d\" (UID: \"fb1d33ce-0355-4019-af14-5644bd4aef45\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:50.179062 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.179040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb1d33ce-0355-4019-af14-5644bd4aef45-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-m4q6d\" (UID: \"fb1d33ce-0355-4019-af14-5644bd4aef45\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:50.179165 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.179064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67a520b9-9663-482d-90c1-b14743896017-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-rjj74\" (UID: \"67a520b9-9663-482d-90c1-b14743896017\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:50.186700 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.186674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pcrm\" (UniqueName: \"kubernetes.io/projected/67a520b9-9663-482d-90c1-b14743896017-kube-api-access-2pcrm\") pod \"payload-processing-5cc6cd444b-rjj74\" (UID: \"67a520b9-9663-482d-90c1-b14743896017\") " pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:50.186809 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.186689    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92fvh\" (UniqueName: \"kubernetes.io/projected/fb1d33ce-0355-4019-af14-5644bd4aef45-kube-api-access-92fvh\") pod \"payload-pre-processing-687dbb6cf6-m4q6d\" (UID: \"fb1d33ce-0355-4019-af14-5644bd4aef45\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:50.276375 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.276339    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:50.312481 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.312447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:50.466683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.466656    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-rjj74"]
Aug 04 16:12:50.468223 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:12:50.468200    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a520b9_9663_482d_90c1_b14743896017.slice/crio-e31bd3a43f09dd1000cb72f98c7de141f80e6510f84f3c0aac4b7c5461c83066 WatchSource:0}: Error finding container e31bd3a43f09dd1000cb72f98c7de141f80e6510f84f3c0aac4b7c5461c83066: Status 404 returned error can't find the container with id e31bd3a43f09dd1000cb72f98c7de141f80e6510f84f3c0aac4b7c5461c83066
Aug 04 16:12:50.617743 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.617660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52" event={"ID":"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d","Type":"ContainerStarted","Data":"5d9821672f54b2e37cd8ec504af6f4e49a4ffeadaef9cabc9b26956b66c73c14"}
Aug 04 16:12:50.619234 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.619203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74" event={"ID":"67a520b9-9663-482d-90c1-b14743896017","Type":"ContainerStarted","Data":"e31bd3a43f09dd1000cb72f98c7de141f80e6510f84f3c0aac4b7c5461c83066"}
Aug 04 16:12:50.632031 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:50.631984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"]
Aug 04 16:12:50.634779 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:12:50.634750    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1d33ce_0355_4019_af14_5644bd4aef45.slice/crio-5677c18603217cb4ff95fccabf96ec48e173774711dca9754434fb4afe63cac7 WatchSource:0}: Error finding container 5677c18603217cb4ff95fccabf96ec48e173774711dca9754434fb4afe63cac7: Status 404 returned error can't find the container with id 5677c18603217cb4ff95fccabf96ec48e173774711dca9754434fb4afe63cac7
Aug 04 16:12:51.630188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:51.630120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d" event={"ID":"fb1d33ce-0355-4019-af14-5644bd4aef45","Type":"ContainerStarted","Data":"5677c18603217cb4ff95fccabf96ec48e173774711dca9754434fb4afe63cac7"}
Aug 04 16:12:52.636621 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.636524    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74" event={"ID":"67a520b9-9663-482d-90c1-b14743896017","Type":"ContainerStarted","Data":"b19e6d0f2c7613e0953e8f513062eca1f9e4e012d575d4f2d58c6ccdb483e101"}
Aug 04 16:12:52.636621 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.636606    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:12:52.638143 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.638119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d" event={"ID":"fb1d33ce-0355-4019-af14-5644bd4aef45","Type":"ContainerStarted","Data":"5efd820d93aed21d0abc747dfc154f4893b5d816903c1b1f654803853beccbdf"}
Aug 04 16:12:52.638244 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.638172    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:12:52.639450 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.639431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52" event={"ID":"7d39ef9b-93a4-4c1d-9162-a87e71de7b3d","Type":"ContainerStarted","Data":"28f94f863a3043304dc9adb1ddcc4e9d0407091ec8f5b8083e13d1b3774ddffe"}
Aug 04 16:12:52.639566 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.639545    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:52.667415 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.667373    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74" podStartSLOduration=1.783575452 podStartE2EDuration="3.667359146s" totalImagesPullingTime="1.883783694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:12:52.665891714 +0000 UTC m=+653.492589186" watchObservedRunningTime="2026-08-04 16:12:52.667359146 +0000 UTC m=+653.494056618"
Aug 04 16:12:52.690148 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.690077    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52" podStartSLOduration=1.802030883 podStartE2EDuration="3.690065327s" totalImagesPullingTime="1.888034444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:12:52.68780278 +0000 UTC m=+653.514500254" watchObservedRunningTime="2026-08-04 16:12:52.690065327 +0000 UTC m=+653.516762798"
Aug 04 16:12:52.710350 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:52.710309    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d" podStartSLOduration=1.9992865640000002 podStartE2EDuration="3.710295383s" totalImagesPullingTime="1.711008819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:12:52.707923445 +0000 UTC m=+653.534620913" watchObservedRunningTime="2026-08-04 16:12:52.710295383 +0000 UTC m=+653.536992905"
Aug 04 16:12:58.651244 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:58.651217    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67c8968587-h8p52"
Aug 04 16:12:59.685266 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:59.685237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:12:59.779883 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:12:59.779839    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:13:03.647319 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:03.647285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-rjj74"
Aug 04 16:13:03.647718 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:03.647365    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m4q6d"
Aug 04 16:13:07.398736 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.398701    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"]
Aug 04 16:13:07.402369 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.402351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.404449 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.404428    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 16:13:07.404833 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.404813    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l4q6r\""
Aug 04 16:13:07.404880 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.404854    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 04 16:13:07.404965 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.404877    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 16:13:07.415842 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.415819    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"]
Aug 04 16:13:07.435116 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.435086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:13:07.536606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.536573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.536771 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.536620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.536771 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.536717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46c6b330-b05e-4138-b79d-615b6960f9a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.536849 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.536791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.536849 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.536817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.536947 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.536856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjn2b\" (UniqueName: \"kubernetes.io/projected/46c6b330-b05e-4138-b79d-615b6960f9a5-kube-api-access-sjn2b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.637950 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.637894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjn2b\" (UniqueName: \"kubernetes.io/projected/46c6b330-b05e-4138-b79d-615b6960f9a5-kube-api-access-sjn2b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.638120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.637965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.638120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.637991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.638120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.638024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46c6b330-b05e-4138-b79d-615b6960f9a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.638120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.638060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.638120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.638082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.638480 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.638458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.638568 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.638502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.638568 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.638510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.640475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.640454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46c6b330-b05e-4138-b79d-615b6960f9a5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.640685 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.640667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46c6b330-b05e-4138-b79d-615b6960f9a5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.645418 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.645399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjn2b\" (UniqueName: \"kubernetes.io/projected/46c6b330-b05e-4138-b79d-615b6960f9a5-kube-api-access-sjn2b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb\" (UID: \"46c6b330-b05e-4138-b79d-615b6960f9a5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.714690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.714615    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:07.854334 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:07.854303    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"]
Aug 04 16:13:07.855326 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:13:07.855297    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c6b330_b05e_4138_b79d_615b6960f9a5.slice/crio-5ee3346f91edafa68d3d0657622b8dc4104541422402b017cc8ea564fa35aaf9 WatchSource:0}: Error finding container 5ee3346f91edafa68d3d0657622b8dc4104541422402b017cc8ea564fa35aaf9: Status 404 returned error can't find the container with id 5ee3346f91edafa68d3d0657622b8dc4104541422402b017cc8ea564fa35aaf9
Aug 04 16:13:08.728665 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:08.728623    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb" event={"ID":"46c6b330-b05e-4138-b79d-615b6960f9a5","Type":"ContainerStarted","Data":"5ee3346f91edafa68d3d0657622b8dc4104541422402b017cc8ea564fa35aaf9"}
Aug 04 16:13:09.735051 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:09.735012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb" event={"ID":"46c6b330-b05e-4138-b79d-615b6960f9a5","Type":"ContainerStarted","Data":"325213f71a55442e0ef202a5d8ea8bfd7cf6ede26ad59da9261a42806669505f"}
Aug 04 16:13:09.754494 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:09.754446    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb" podStartSLOduration=1.695342691 podStartE2EDuration="2.754430994s" totalImagesPullingTime="1.059088303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:13:09.754110362 +0000 UTC m=+670.580807835" watchObservedRunningTime="2026-08-04 16:13:09.754430994 +0000 UTC m=+670.581128465"
Aug 04 16:13:12.835236 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:12.835203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:13:15.610545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:15.610513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:13:17.717579 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:17.717540    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:17.718012 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:17.717607    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:17.727669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:17.727648    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:17.788975 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:17.788948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb"
Aug 04 16:13:21.221667 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:21.221518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:13:28.296254 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:28.296220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:13:31.932136 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:31.932097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:13:38.147696 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:38.147652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:13:47.627469 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:13:47.627429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:14:20.183891 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:14:20.183855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:14:21.561307 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:14:21.561265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:14:21.662857 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:14:21.662823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:15:00.147938 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:00.147876    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"]
Aug 04 16:15:00.151549 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:00.151528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"
Aug 04 16:15:00.153873 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:00.153846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4pxfk\""
Aug 04 16:15:00.160709 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:00.160685    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"]
Aug 04 16:15:00.162375 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:00.162357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"
Aug 04 16:15:00.302542 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:00.302515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"]
Aug 04 16:15:00.304072 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:15:00.304042    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc6d4b1_2ff8_4bfd_8a90_c6ae4ce3238d.slice/crio-230ae8f4e2b275f098c608725a2b1d301e8e85989073ae697493e790510e3240 WatchSource:0}: Error finding container 230ae8f4e2b275f098c608725a2b1d301e8e85989073ae697493e790510e3240: Status 404 returned error can't find the container with id 230ae8f4e2b275f098c608725a2b1d301e8e85989073ae697493e790510e3240
Aug 04 16:15:00.345077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:00.345051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk" event={"ID":"5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d","Type":"ContainerStarted","Data":"230ae8f4e2b275f098c608725a2b1d301e8e85989073ae697493e790510e3240"}
Aug 04 16:15:03.363156 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:03.363116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk" event={"ID":"5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d","Type":"ContainerStarted","Data":"4bcf3c2bcbba2b1bb72e819cd491351a01e7fb2a2b3e1708d959d4e464c28b0e"}
Aug 04 16:15:03.382094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:03.382047    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk" podStartSLOduration=0.791285244 podStartE2EDuration="3.382032032s" totalImagesPullingTime="2.590746788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:15:03.379460257 +0000 UTC m=+784.206157743" watchObservedRunningTime="2026-08-04 16:15:03.382032032 +0000 UTC m=+784.208729504"
Aug 04 16:15:04.370316 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:04.370282    2563 generic.go:356] "Generic (PLEG): container finished" podID="5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d" containerID="4bcf3c2bcbba2b1bb72e819cd491351a01e7fb2a2b3e1708d959d4e464c28b0e" exitCode=0
Aug 04 16:15:04.370688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:04.370325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk" event={"ID":"5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d","Type":"ContainerDied","Data":"4bcf3c2bcbba2b1bb72e819cd491351a01e7fb2a2b3e1708d959d4e464c28b0e"}
Aug 04 16:15:05.515430 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:05.515402    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"
Aug 04 16:15:06.382388 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:06.382356    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"
Aug 04 16:15:06.382563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:06.382398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk" event={"ID":"5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d","Type":"ContainerDied","Data":"230ae8f4e2b275f098c608725a2b1d301e8e85989073ae697493e790510e3240"}
Aug 04 16:15:06.382563 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:06.382445    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="230ae8f4e2b275f098c608725a2b1d301e8e85989073ae697493e790510e3240"
Aug 04 16:15:08.548313 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.548275    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-cw5n9"]
Aug 04 16:15:08.548846 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.548548    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9" podUID="cb4439ef-6a5a-4480-a925-42ccaf2d4e43" containerName="manager" containerID="cri-o://64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a" gracePeriod=30
Aug 04 16:15:08.804881 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.804815    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:15:08.885748 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.885716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-webhook-cert\") pod \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\" (UID: \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\") "
Aug 04 16:15:08.885952 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.885825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hfvv\" (UniqueName: \"kubernetes.io/projected/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-kube-api-access-5hfvv\") pod \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\" (UID: \"cb4439ef-6a5a-4480-a925-42ccaf2d4e43\") "
Aug 04 16:15:08.888187 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.888152    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cb4439ef-6a5a-4480-a925-42ccaf2d4e43" (UID: "cb4439ef-6a5a-4480-a925-42ccaf2d4e43"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:15:08.888297 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.888219    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-kube-api-access-5hfvv" (OuterVolumeSpecName: "kube-api-access-5hfvv") pod "cb4439ef-6a5a-4480-a925-42ccaf2d4e43" (UID: "cb4439ef-6a5a-4480-a925-42ccaf2d4e43"). InnerVolumeSpecName "kube-api-access-5hfvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:15:08.986992 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.986955    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hfvv\" (UniqueName: \"kubernetes.io/projected/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-kube-api-access-5hfvv\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:15:08.986992 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:08.986988    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb4439ef-6a5a-4480-a925-42ccaf2d4e43-webhook-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:15:09.400371 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.400337    2563 generic.go:356] "Generic (PLEG): container finished" podID="cb4439ef-6a5a-4480-a925-42ccaf2d4e43" containerID="64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a" exitCode=0
Aug 04 16:15:09.400558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.400389    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9"
Aug 04 16:15:09.400558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.400413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9" event={"ID":"cb4439ef-6a5a-4480-a925-42ccaf2d4e43","Type":"ContainerDied","Data":"64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a"}
Aug 04 16:15:09.400558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.400497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-cw5n9" event={"ID":"cb4439ef-6a5a-4480-a925-42ccaf2d4e43","Type":"ContainerDied","Data":"9c1672d3b475f70ac39978e19893a21442b5a72f3cc410ec5ad3254f16fa9ab3"}
Aug 04 16:15:09.400558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.400520    2563 scope.go:117] "RemoveContainer" containerID="64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a"
Aug 04 16:15:09.410069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.410046    2563 scope.go:117] "RemoveContainer" containerID="64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a"
Aug 04 16:15:09.410336 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:15:09.410318    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a\": container with ID starting with 64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a not found: ID does not exist" containerID="64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a"
Aug 04 16:15:09.410377 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.410347    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a"} err="failed to get container status \"64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a\": rpc error: code = NotFound desc = could not find container \"64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a\": container with ID starting with 64f3667b4742c45552670d1d3c02078b2102b6d70026b6198550ac704478cd0a not found: ID does not exist"
Aug 04 16:15:09.425063 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.425031    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-cw5n9"]
Aug 04 16:15:09.430511 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.430487    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-cw5n9"]
Aug 04 16:15:09.717082 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:09.717006    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4439ef-6a5a-4480-a925-42ccaf2d4e43" path="/var/lib/kubelet/pods/cb4439ef-6a5a-4480-a925-42ccaf2d4e43/volumes"
Aug 04 16:15:42.247552 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:42.247464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:15:42.348226 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:15:42.348199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:16:02.536235 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:02.536201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:16:10.366883 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.366848    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-7z8nh"]
Aug 04 16:16:10.367318 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.367303    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d" containerName="cleanup"
Aug 04 16:16:10.367371 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.367320    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d" containerName="cleanup"
Aug 04 16:16:10.367371 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.367334    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4439ef-6a5a-4480-a925-42ccaf2d4e43" containerName="manager"
Aug 04 16:16:10.367371 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.367340    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4439ef-6a5a-4480-a925-42ccaf2d4e43" containerName="manager"
Aug 04 16:16:10.367476 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.367400    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4439ef-6a5a-4480-a925-42ccaf2d4e43" containerName="manager"
Aug 04 16:16:10.367476 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.367410    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d" containerName="cleanup"
Aug 04 16:16:10.371660 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.371644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:10.378428 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.378404    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 16:16:10.378538 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.378448    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 16:16:10.378538 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.378401    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kqxq7\""
Aug 04 16:16:10.399335 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.399304    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-7z8nh"]
Aug 04 16:16:10.437021 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.436977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/831e3211-7bcd-4c9e-9af6-ed4965c1890c-webhook-cert\") pod \"maas-controller-76cc9b5f7d-7z8nh\" (UID: \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\") " pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:10.437185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.437112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66frn\" (UniqueName: \"kubernetes.io/projected/831e3211-7bcd-4c9e-9af6-ed4965c1890c-kube-api-access-66frn\") pod \"maas-controller-76cc9b5f7d-7z8nh\" (UID: \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\") " pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:10.538149 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.538116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/831e3211-7bcd-4c9e-9af6-ed4965c1890c-webhook-cert\") pod \"maas-controller-76cc9b5f7d-7z8nh\" (UID: \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\") " pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:10.538320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.538178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66frn\" (UniqueName: \"kubernetes.io/projected/831e3211-7bcd-4c9e-9af6-ed4965c1890c-kube-api-access-66frn\") pod \"maas-controller-76cc9b5f7d-7z8nh\" (UID: \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\") " pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:10.540733 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.540701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/831e3211-7bcd-4c9e-9af6-ed4965c1890c-webhook-cert\") pod \"maas-controller-76cc9b5f7d-7z8nh\" (UID: \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\") " pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:10.546107 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.546086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66frn\" (UniqueName: \"kubernetes.io/projected/831e3211-7bcd-4c9e-9af6-ed4965c1890c-kube-api-access-66frn\") pod \"maas-controller-76cc9b5f7d-7z8nh\" (UID: \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\") " pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:10.681365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.681288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:10.818800 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:10.818772    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-7z8nh"]
Aug 04 16:16:10.820179 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:16:10.820156    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831e3211_7bcd_4c9e_9af6_ed4965c1890c.slice/crio-cdebf1a1d2ca807698ce2ae5b87a001d72a13f5c92b57e38e9eac7586ec7039c WatchSource:0}: Error finding container cdebf1a1d2ca807698ce2ae5b87a001d72a13f5c92b57e38e9eac7586ec7039c: Status 404 returned error can't find the container with id cdebf1a1d2ca807698ce2ae5b87a001d72a13f5c92b57e38e9eac7586ec7039c
Aug 04 16:16:11.745763 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:11.745730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh" event={"ID":"831e3211-7bcd-4c9e-9af6-ed4965c1890c","Type":"ContainerStarted","Data":"f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386"}
Aug 04 16:16:11.746308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:11.745787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh" event={"ID":"831e3211-7bcd-4c9e-9af6-ed4965c1890c","Type":"ContainerStarted","Data":"cdebf1a1d2ca807698ce2ae5b87a001d72a13f5c92b57e38e9eac7586ec7039c"}
Aug 04 16:16:11.746308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:11.745813    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:11.766552 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:11.766499    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh" podStartSLOduration=1.158771374 podStartE2EDuration="1.766484605s" totalImagesPullingTime="607.713231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:16:11.764892191 +0000 UTC m=+852.591589663" watchObservedRunningTime="2026-08-04 16:16:11.766484605 +0000 UTC m=+852.593182076"
Aug 04 16:16:22.753385 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:22.753357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:27.334387 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.334353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:16:27.421626 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.421591    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-7z8nh"]
Aug 04 16:16:27.421895 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.421852    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh" podUID="831e3211-7bcd-4c9e-9af6-ed4965c1890c" containerName="manager" containerID="cri-o://f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386" gracePeriod=30
Aug 04 16:16:27.666373 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.666348    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:27.782802 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.782770    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66frn\" (UniqueName: \"kubernetes.io/projected/831e3211-7bcd-4c9e-9af6-ed4965c1890c-kube-api-access-66frn\") pod \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\" (UID: \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\") "
Aug 04 16:16:27.783020 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.782820    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/831e3211-7bcd-4c9e-9af6-ed4965c1890c-webhook-cert\") pod \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\" (UID: \"831e3211-7bcd-4c9e-9af6-ed4965c1890c\") "
Aug 04 16:16:27.784846 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.784820    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831e3211-7bcd-4c9e-9af6-ed4965c1890c-kube-api-access-66frn" (OuterVolumeSpecName: "kube-api-access-66frn") pod "831e3211-7bcd-4c9e-9af6-ed4965c1890c" (UID: "831e3211-7bcd-4c9e-9af6-ed4965c1890c"). InnerVolumeSpecName "kube-api-access-66frn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:16:27.784985 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.784898    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/831e3211-7bcd-4c9e-9af6-ed4965c1890c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "831e3211-7bcd-4c9e-9af6-ed4965c1890c" (UID: "831e3211-7bcd-4c9e-9af6-ed4965c1890c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:16:27.830854 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.830822    2563 generic.go:356] "Generic (PLEG): container finished" podID="831e3211-7bcd-4c9e-9af6-ed4965c1890c" containerID="f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386" exitCode=0
Aug 04 16:16:27.831021 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.830870    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh"
Aug 04 16:16:27.831021 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.830927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh" event={"ID":"831e3211-7bcd-4c9e-9af6-ed4965c1890c","Type":"ContainerDied","Data":"f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386"}
Aug 04 16:16:27.831021 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.830994    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-7z8nh" event={"ID":"831e3211-7bcd-4c9e-9af6-ed4965c1890c","Type":"ContainerDied","Data":"cdebf1a1d2ca807698ce2ae5b87a001d72a13f5c92b57e38e9eac7586ec7039c"}
Aug 04 16:16:27.831021 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.831015    2563 scope.go:117] "RemoveContainer" containerID="f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386"
Aug 04 16:16:27.840109 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.840094    2563 scope.go:117] "RemoveContainer" containerID="f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386"
Aug 04 16:16:27.840373 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:16:27.840354    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386\": container with ID starting with f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386 not found: ID does not exist" containerID="f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386"
Aug 04 16:16:27.840425 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.840381    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386"} err="failed to get container status \"f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386\": rpc error: code = NotFound desc = could not find container \"f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386\": container with ID starting with f9e3a988e1c8fd51282407b00fbe542cab9d4f4481bee5c64dca69c0f269c386 not found: ID does not exist"
Aug 04 16:16:27.858160 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.858139    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-7z8nh"]
Aug 04 16:16:27.860525 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.860501    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-7z8nh"]
Aug 04 16:16:27.884013 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.883989    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66frn\" (UniqueName: \"kubernetes.io/projected/831e3211-7bcd-4c9e-9af6-ed4965c1890c-kube-api-access-66frn\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:16:27.884013 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:27.884011    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/831e3211-7bcd-4c9e-9af6-ed4965c1890c-webhook-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:16:28.590097 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.590070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:16:28.692621 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.692587    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-685dx"]
Aug 04 16:16:28.693242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.693178    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="831e3211-7bcd-4c9e-9af6-ed4965c1890c" containerName="manager"
Aug 04 16:16:28.693242 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.693200    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="831e3211-7bcd-4c9e-9af6-ed4965c1890c" containerName="manager"
Aug 04 16:16:28.693466 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.693341    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="831e3211-7bcd-4c9e-9af6-ed4965c1890c" containerName="manager"
Aug 04 16:16:28.697749 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.697729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:28.700276 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.700257    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 16:16:28.700401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.700318    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kqxq7\""
Aug 04 16:16:28.700401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.700326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 16:16:28.705886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.705784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-685dx"]
Aug 04 16:16:28.789638 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.789612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71d2fe32-4e8e-4086-9830-e7a3a693bc6a-webhook-cert\") pod \"maas-controller-76cc9b5f7d-685dx\" (UID: \"71d2fe32-4e8e-4086-9830-e7a3a693bc6a\") " pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:28.789783 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.789702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt75p\" (UniqueName: \"kubernetes.io/projected/71d2fe32-4e8e-4086-9830-e7a3a693bc6a-kube-api-access-bt75p\") pod \"maas-controller-76cc9b5f7d-685dx\" (UID: \"71d2fe32-4e8e-4086-9830-e7a3a693bc6a\") " pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:28.890929 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.890840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt75p\" (UniqueName: \"kubernetes.io/projected/71d2fe32-4e8e-4086-9830-e7a3a693bc6a-kube-api-access-bt75p\") pod \"maas-controller-76cc9b5f7d-685dx\" (UID: \"71d2fe32-4e8e-4086-9830-e7a3a693bc6a\") " pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:28.890929 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.890893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71d2fe32-4e8e-4086-9830-e7a3a693bc6a-webhook-cert\") pod \"maas-controller-76cc9b5f7d-685dx\" (UID: \"71d2fe32-4e8e-4086-9830-e7a3a693bc6a\") " pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:28.893363 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.893339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71d2fe32-4e8e-4086-9830-e7a3a693bc6a-webhook-cert\") pod \"maas-controller-76cc9b5f7d-685dx\" (UID: \"71d2fe32-4e8e-4086-9830-e7a3a693bc6a\") " pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:28.900356 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:28.900333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt75p\" (UniqueName: \"kubernetes.io/projected/71d2fe32-4e8e-4086-9830-e7a3a693bc6a-kube-api-access-bt75p\") pod \"maas-controller-76cc9b5f7d-685dx\" (UID: \"71d2fe32-4e8e-4086-9830-e7a3a693bc6a\") " pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:29.010260 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:29.010231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:29.144709 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:29.144675    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cc9b5f7d-685dx"]
Aug 04 16:16:29.146166 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:16:29.146140    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d2fe32_4e8e_4086_9830_e7a3a693bc6a.slice/crio-6c8ade76428a6c56d2535ab51f26b9cdb99a7445d37ace5e5310b35944481818 WatchSource:0}: Error finding container 6c8ade76428a6c56d2535ab51f26b9cdb99a7445d37ace5e5310b35944481818: Status 404 returned error can't find the container with id 6c8ade76428a6c56d2535ab51f26b9cdb99a7445d37ace5e5310b35944481818
Aug 04 16:16:29.718216 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:29.718183    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="831e3211-7bcd-4c9e-9af6-ed4965c1890c" path="/var/lib/kubelet/pods/831e3211-7bcd-4c9e-9af6-ed4965c1890c/volumes"
Aug 04 16:16:29.850248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:29.850205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-685dx" event={"ID":"71d2fe32-4e8e-4086-9830-e7a3a693bc6a","Type":"ContainerStarted","Data":"6c8ade76428a6c56d2535ab51f26b9cdb99a7445d37ace5e5310b35944481818"}
Aug 04 16:16:30.858468 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:30.858432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc9b5f7d-685dx" event={"ID":"71d2fe32-4e8e-4086-9830-e7a3a693bc6a","Type":"ContainerStarted","Data":"c1453e1c652f15efb2fd47f0028fa477d094509a5f7cafe5e010d34386ffd7fb"}
Aug 04 16:16:30.858829 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:30.858512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:30.879777 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:30.879730    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76cc9b5f7d-685dx" podStartSLOduration=1.332593494 podStartE2EDuration="2.87971587s" totalImagesPullingTime="1.547122376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:16:30.878198186 +0000 UTC m=+871.704895670" watchObservedRunningTime="2026-08-04 16:16:30.87971587 +0000 UTC m=+871.706413345"
Aug 04 16:16:41.866559 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:41.866524    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76cc9b5f7d-685dx"
Aug 04 16:16:59.644717 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:59.644691    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:16:59.652615 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:16:59.652588    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:17:20.483880 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:20.483845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:33.191374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:33.191339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:33.291647 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:33.291617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:33.441815 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:33.441745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:39.421412 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:39.421380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:39.479819 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:39.479772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:39.546619 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:39.546585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:39.646228 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:39.646200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:39.784063 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:39.784029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:45.810850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:45.810815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:45.869046 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:45.869019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:59.229848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:59.229815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:17:59.300644 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:17:59.300616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:19:55.036898 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:19:55.036802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:21:59.692826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:21:59.692798    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:21:59.693890 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:21:59.693870    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:22:04.530106 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:22:04.530055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:22:04.620245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:22:04.620218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:22:59.868677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:22:59.868643    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"]
Aug 04 16:22:59.871099 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:22:59.868834    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr" podUID="42068674-374a-4e52-a19b-7515900a1e98" containerName="manager" containerID="cri-o://1a1e757d59a345e782fcdc17324530064c1d35c63327ab4fb0f05100d25a0889" gracePeriod=10
Aug 04 16:23:00.045365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.045336    2563 generic.go:356] "Generic (PLEG): container finished" podID="42068674-374a-4e52-a19b-7515900a1e98" containerID="1a1e757d59a345e782fcdc17324530064c1d35c63327ab4fb0f05100d25a0889" exitCode=0
Aug 04 16:23:00.045525 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.045372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr" event={"ID":"42068674-374a-4e52-a19b-7515900a1e98","Type":"ContainerDied","Data":"1a1e757d59a345e782fcdc17324530064c1d35c63327ab4fb0f05100d25a0889"}
Aug 04 16:23:00.118549 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.118517    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:23:00.155447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.155364    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvtqp\" (UniqueName: \"kubernetes.io/projected/42068674-374a-4e52-a19b-7515900a1e98-kube-api-access-nvtqp\") pod \"42068674-374a-4e52-a19b-7515900a1e98\" (UID: \"42068674-374a-4e52-a19b-7515900a1e98\") "
Aug 04 16:23:00.155447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.155402    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42068674-374a-4e52-a19b-7515900a1e98-extensions-socket-volume\") pod \"42068674-374a-4e52-a19b-7515900a1e98\" (UID: \"42068674-374a-4e52-a19b-7515900a1e98\") "
Aug 04 16:23:00.155885 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.155861    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42068674-374a-4e52-a19b-7515900a1e98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42068674-374a-4e52-a19b-7515900a1e98" (UID: "42068674-374a-4e52-a19b-7515900a1e98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:23:00.157643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.157614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42068674-374a-4e52-a19b-7515900a1e98-kube-api-access-nvtqp" (OuterVolumeSpecName: "kube-api-access-nvtqp") pod "42068674-374a-4e52-a19b-7515900a1e98" (UID: "42068674-374a-4e52-a19b-7515900a1e98"). InnerVolumeSpecName "kube-api-access-nvtqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:23:00.256505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.256474    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvtqp\" (UniqueName: \"kubernetes.io/projected/42068674-374a-4e52-a19b-7515900a1e98-kube-api-access-nvtqp\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:23:00.256505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:00.256501    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42068674-374a-4e52-a19b-7515900a1e98-extensions-socket-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:23:01.053333 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:01.053302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr" event={"ID":"42068674-374a-4e52-a19b-7515900a1e98","Type":"ContainerDied","Data":"320d8fc3c2a34a844a72d85ae404f63486b9499ea0067b55453279ce518e196d"}
Aug 04 16:23:01.053728 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:01.053341    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"
Aug 04 16:23:01.053728 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:01.053363    2563 scope.go:117] "RemoveContainer" containerID="1a1e757d59a345e782fcdc17324530064c1d35c63327ab4fb0f05100d25a0889"
Aug 04 16:23:01.076597 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:01.076571    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"]
Aug 04 16:23:01.082721 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:01.082700    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-drjqr"]
Aug 04 16:23:01.717113 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:01.717084    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42068674-374a-4e52-a19b-7515900a1e98" path="/var/lib/kubelet/pods/42068674-374a-4e52-a19b-7515900a1e98/volumes"
Aug 04 16:23:32.045848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:23:32.045813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:24:00.604197 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.604160    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"]
Aug 04 16:24:00.604625 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.604579    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42068674-374a-4e52-a19b-7515900a1e98" containerName="manager"
Aug 04 16:24:00.604625 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.604590    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42068674-374a-4e52-a19b-7515900a1e98" containerName="manager"
Aug 04 16:24:00.604697 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.604658    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42068674-374a-4e52-a19b-7515900a1e98" containerName="manager"
Aug 04 16:24:00.608897 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.608878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:00.611095 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.611073    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jzpbj\""
Aug 04 16:24:00.623049 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.623024    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"]
Aug 04 16:24:00.678654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.678613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjbgd\" (UniqueName: \"kubernetes.io/projected/8b868276-d9e9-4545-9be7-938f4ce4a601-kube-api-access-wjbgd\") pod \"kuadrant-operator-controller-manager-68cf589589-v9hvf\" (UID: \"8b868276-d9e9-4545-9be7-938f4ce4a601\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:00.678844 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.678684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b868276-d9e9-4545-9be7-938f4ce4a601-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-v9hvf\" (UID: \"8b868276-d9e9-4545-9be7-938f4ce4a601\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:00.779633 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.779591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbgd\" (UniqueName: \"kubernetes.io/projected/8b868276-d9e9-4545-9be7-938f4ce4a601-kube-api-access-wjbgd\") pod \"kuadrant-operator-controller-manager-68cf589589-v9hvf\" (UID: \"8b868276-d9e9-4545-9be7-938f4ce4a601\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:00.779788 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.779665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b868276-d9e9-4545-9be7-938f4ce4a601-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-v9hvf\" (UID: \"8b868276-d9e9-4545-9be7-938f4ce4a601\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:00.780041 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.780024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b868276-d9e9-4545-9be7-938f4ce4a601-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-v9hvf\" (UID: \"8b868276-d9e9-4545-9be7-938f4ce4a601\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:00.788799 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.788780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbgd\" (UniqueName: \"kubernetes.io/projected/8b868276-d9e9-4545-9be7-938f4ce4a601-kube-api-access-wjbgd\") pod \"kuadrant-operator-controller-manager-68cf589589-v9hvf\" (UID: \"8b868276-d9e9-4545-9be7-938f4ce4a601\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:00.919551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:00.919469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:01.073804 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:01.073770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"]
Aug 04 16:24:01.075804 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:24:01.075761    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b868276_d9e9_4545_9be7_938f4ce4a601.slice/crio-401948f977aa0631c21eb699a8145eb635ae29212504e1fb558cf15a374a0c9e WatchSource:0}: Error finding container 401948f977aa0631c21eb699a8145eb635ae29212504e1fb558cf15a374a0c9e: Status 404 returned error can't find the container with id 401948f977aa0631c21eb699a8145eb635ae29212504e1fb558cf15a374a0c9e
Aug 04 16:24:01.389328 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:01.389293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf" event={"ID":"8b868276-d9e9-4545-9be7-938f4ce4a601","Type":"ContainerStarted","Data":"7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a"}
Aug 04 16:24:01.389516 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:01.389353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf" event={"ID":"8b868276-d9e9-4545-9be7-938f4ce4a601","Type":"ContainerStarted","Data":"401948f977aa0631c21eb699a8145eb635ae29212504e1fb558cf15a374a0c9e"}
Aug 04 16:24:01.389516 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:01.389417    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:01.413596 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:01.413543    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf" podStartSLOduration=1.413523613 podStartE2EDuration="1.413523613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:24:01.411983736 +0000 UTC m=+1322.238681206" watchObservedRunningTime="2026-08-04 16:24:01.413523613 +0000 UTC m=+1322.240221137"
Aug 04 16:24:12.398515 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:12.398485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:24:34.508179 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:24:34.508088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:26:59.730284 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:26:59.730259    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:26:59.739472 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:26:59.739447    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:27:16.223662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:27:16.223630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:27:32.027651 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:27:32.027615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:27:49.558610 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:27:49.558566    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:28:02.120683 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:28:02.120606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:28:03.670281 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:28:03.670240    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:29:27.524083 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:29:27.524053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:29:30.713377 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:29:30.713344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:30:00.133604 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:00.133575    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n"]
Aug 04 16:30:00.137038 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:00.137022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n"
Aug 04 16:30:00.139142 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:00.139125    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4pxfk\""
Aug 04 16:30:00.146571 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:00.146554    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n"
Aug 04 16:30:00.152820 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:00.152798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n"]
Aug 04 16:30:00.283566 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:00.283544    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n"]
Aug 04 16:30:00.285624 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:30:00.285600    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f44a81_0e67_4188_98d8_d6ce133f0e2d.slice/crio-82b92c7eb4b1fc4a03da178146659021ee40f950cc7dd905f4c4d93a8d936718 WatchSource:0}: Error finding container 82b92c7eb4b1fc4a03da178146659021ee40f950cc7dd905f4c4d93a8d936718: Status 404 returned error can't find the container with id 82b92c7eb4b1fc4a03da178146659021ee40f950cc7dd905f4c4d93a8d936718
Aug 04 16:30:00.412004 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:00.411932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n" event={"ID":"96f44a81-0e67-4188-98d8-d6ce133f0e2d","Type":"ContainerStarted","Data":"82b92c7eb4b1fc4a03da178146659021ee40f950cc7dd905f4c4d93a8d936718"}
Aug 04 16:30:01.421993 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:01.421961    2563 generic.go:356] "Generic (PLEG): container finished" podID="96f44a81-0e67-4188-98d8-d6ce133f0e2d" containerID="93e3dfba13cd71bc597e3d046ad0d3d755efcfbf9a3a9fbfa7f380150728cb88" exitCode=0
Aug 04 16:30:01.422356 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:01.422014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n" event={"ID":"96f44a81-0e67-4188-98d8-d6ce133f0e2d","Type":"ContainerDied","Data":"93e3dfba13cd71bc597e3d046ad0d3d755efcfbf9a3a9fbfa7f380150728cb88"}
Aug 04 16:30:02.562515 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:02.562490    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n"
Aug 04 16:30:03.433991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:03.433955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n" event={"ID":"96f44a81-0e67-4188-98d8-d6ce133f0e2d","Type":"ContainerDied","Data":"82b92c7eb4b1fc4a03da178146659021ee40f950cc7dd905f4c4d93a8d936718"}
Aug 04 16:30:03.433991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:03.433985    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764350-pfj5n"
Aug 04 16:30:03.434210 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:30:03.434004    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82b92c7eb4b1fc4a03da178146659021ee40f950cc7dd905f4c4d93a8d936718"
Aug 04 16:31:15.978315 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:15.978277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:31:24.762756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:24.762725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:31:50.837482 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:50.837401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:31:53.262771 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:53.262737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:31:53.366466 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:53.366433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:31:53.998358 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:53.998320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:31:54.090649 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:54.090606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:31:54.450271 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:54.450174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:31:59.774763 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:59.774740    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:31:59.778636 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:31:59.778618    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:32:00.375009 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.374946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:00.477731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.477694    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:00.621718 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.621689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:00.921057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.921028    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"]
Aug 04 16:32:00.921449 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.921435    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f44a81-0e67-4188-98d8-d6ce133f0e2d" containerName="cleanup"
Aug 04 16:32:00.921506 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.921452    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f44a81-0e67-4188-98d8-d6ce133f0e2d" containerName="cleanup"
Aug 04 16:32:00.921561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.921551    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f44a81-0e67-4188-98d8-d6ce133f0e2d" containerName="cleanup"
Aug 04 16:32:00.924329 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.924312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:00.926458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.926441    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6d639331-openshift-default-dockercfg-c27r8\""
Aug 04 16:32:00.945570 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:00.945548    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"]
Aug 04 16:32:01.011314 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-data\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.011314 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f3b0d96-a122-4de2-9901-326dd403b172-istiod-ca-cert\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.011561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-credential-socket\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.011561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-certs\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.011561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-envoy\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.011561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f3b0d96-a122-4de2-9901-326dd403b172-istio-podinfo\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.011561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pclh7\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-kube-api-access-pclh7\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.011561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-socket\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.011890 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.011572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-istio-token\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.112888 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.112850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-data\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.112892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f3b0d96-a122-4de2-9901-326dd403b172-istiod-ca-cert\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.112974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-credential-socket\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.113023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-certs\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.113048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-envoy\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.113085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f3b0d96-a122-4de2-9901-326dd403b172-istio-podinfo\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.113143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclh7\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-kube-api-access-pclh7\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.113215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-socket\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.113241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-istio-token\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113990 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.113770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-credential-socket\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.113990 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.113900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-socket\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.114191 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.114097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-certs\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.114191 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.114158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-data\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.116719 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.114563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f3b0d96-a122-4de2-9901-326dd403b172-istiod-ca-cert\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.117488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.117455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f3b0d96-a122-4de2-9901-326dd403b172-istio-podinfo\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.122652 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.122627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-envoy\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.123320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.123297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pclh7\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-kube-api-access-pclh7\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.123400 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.123378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-istio-token\") pod \"e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") " pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.235302 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.235233    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:01.376015 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.375985    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"]
Aug 04 16:32:01.378111 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:32:01.378070    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3b0d96_a122_4de2_9901_326dd403b172.slice/crio-bbb6b67723b951fb739b42f0328a47c3ed6eb2077920eb48f0771bf19eeb294c WatchSource:0}: Error finding container bbb6b67723b951fb739b42f0328a47c3ed6eb2077920eb48f0771bf19eeb294c: Status 404 returned error can't find the container with id bbb6b67723b951fb739b42f0328a47c3ed6eb2077920eb48f0771bf19eeb294c
Aug 04 16:32:01.380401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.380361    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:01.380478 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.380451    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:01.380515 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:01.380501    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:02.098552 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:02.098519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" event={"ID":"2f3b0d96-a122-4de2-9901-326dd403b172","Type":"ContainerStarted","Data":"93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998"}
Aug 04 16:32:02.098962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:02.098566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" event={"ID":"2f3b0d96-a122-4de2-9901-326dd403b172","Type":"ContainerStarted","Data":"bbb6b67723b951fb739b42f0328a47c3ed6eb2077920eb48f0771bf19eeb294c"}
Aug 04 16:32:02.124368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:02.124307    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podStartSLOduration=2.124275369 podStartE2EDuration="2.124275369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:32:02.123125248 +0000 UTC m=+1802.949822721" watchObservedRunningTime="2026-08-04 16:32:02.124275369 +0000 UTC m=+1802.950972842"
Aug 04 16:32:02.235876 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:02.235844    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:02.241701 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:02.241679    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:02.624022 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:02.623981    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:02.684187 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:02.684149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:03.104333 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:03.104302    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:03.105103 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:03.105087    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:03.581229 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:03.581194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:03.684029 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:03.683999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:04.683271 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.683238    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"]
Aug 04 16:32:04.687996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.687969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:04.690837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.690808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6d639331-serving-cert\""
Aug 04 16:32:04.697502 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.697476    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"]
Aug 04 16:32:04.735101 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.735058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:04.746584 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.746545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:04.746734 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.746586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj4mk\" (UniqueName: \"kubernetes.io/projected/ea5ea33c-d3e5-4063-9796-95c79eff7924-kube-api-access-sj4mk\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:04.746734 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.746702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ea33c-d3e5-4063-9796-95c79eff7924-openshift-service-ca\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:04.847628 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.847595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:04.847813 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.847644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj4mk\" (UniqueName: \"kubernetes.io/projected/ea5ea33c-d3e5-4063-9796-95c79eff7924-kube-api-access-sj4mk\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:04.847813 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.847732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ea33c-d3e5-4063-9796-95c79eff7924-openshift-service-ca\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:04.847813 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:04.847740    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-serving-cert: secret "maas-api-e2e-ait-6d639331-serving-cert" not found
Aug 04 16:32:04.847813 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:04.847806    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls podName:ea5ea33c-d3e5-4063-9796-95c79eff7924 nodeName:}" failed. No retries permitted until 2026-08-04 16:32:05.347783392 +0000 UTC m=+1806.174480846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls") pod "maas-api-e2e-ait-6d639331-7db5dc6657-hj877" (UID: "ea5ea33c-d3e5-4063-9796-95c79eff7924") : secret "maas-api-e2e-ait-6d639331-serving-cert" not found
Aug 04 16:32:04.848434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.848414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ea33c-d3e5-4063-9796-95c79eff7924-openshift-service-ca\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:04.857924 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:04.857882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj4mk\" (UniqueName: \"kubernetes.io/projected/ea5ea33c-d3e5-4063-9796-95c79eff7924-kube-api-access-sj4mk\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:05.319796 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.319750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:05.351075 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.351044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:05.353538 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.353515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls\") pod \"maas-api-e2e-ait-6d639331-7db5dc6657-hj877\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:05.372207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.372183    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"]
Aug 04 16:32:05.375735 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.375717    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:05.378770 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.378731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-6d639331-dockercfg-b4wgf\""
Aug 04 16:32:05.379202 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.379186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-6d639331\""
Aug 04 16:32:05.389407 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.389383    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"]
Aug 04 16:32:05.395605 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.395550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:05.434790 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.434760    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"]
Aug 04 16:32:05.438361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.438340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:05.450992 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.450966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"]
Aug 04 16:32:05.451572 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.451548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gctzl\" (UniqueName: \"kubernetes.io/projected/29fa320d-fbee-44cd-b72f-00a1040488d3-kube-api-access-gctzl\") pod \"payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb\" (UID: \"29fa320d-fbee-44cd-b72f-00a1040488d3\") " pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:05.451728 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.451706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbjxp\" (UniqueName: \"kubernetes.io/projected/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-kube-api-access-wbjxp\") pod \"payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7\" (UID: \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:05.451832 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.451802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fa320d-fbee-44cd-b72f-00a1040488d3-plugins-config-volume\") pod \"payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb\" (UID: \"29fa320d-fbee-44cd-b72f-00a1040488d3\") " pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:05.451977 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.451887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7\" (UID: \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:05.553010 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.552979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbjxp\" (UniqueName: \"kubernetes.io/projected/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-kube-api-access-wbjxp\") pod \"payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7\" (UID: \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:05.553199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.553018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fa320d-fbee-44cd-b72f-00a1040488d3-plugins-config-volume\") pod \"payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb\" (UID: \"29fa320d-fbee-44cd-b72f-00a1040488d3\") " pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:05.553199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.553045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7\" (UID: \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:05.553199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.553071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gctzl\" (UniqueName: \"kubernetes.io/projected/29fa320d-fbee-44cd-b72f-00a1040488d3-kube-api-access-gctzl\") pod \"payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb\" (UID: \"29fa320d-fbee-44cd-b72f-00a1040488d3\") " pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:05.553765 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.553744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7\" (UID: \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:05.553809 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.553758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fa320d-fbee-44cd-b72f-00a1040488d3-plugins-config-volume\") pod \"payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb\" (UID: \"29fa320d-fbee-44cd-b72f-00a1040488d3\") " pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:05.560826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.560805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gctzl\" (UniqueName: \"kubernetes.io/projected/29fa320d-fbee-44cd-b72f-00a1040488d3-kube-api-access-gctzl\") pod \"payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb\" (UID: \"29fa320d-fbee-44cd-b72f-00a1040488d3\") " pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:05.560988 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.560957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbjxp\" (UniqueName: \"kubernetes.io/projected/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-kube-api-access-wbjxp\") pod \"payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7\" (UID: \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:05.601946 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.601799    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:05.687572 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.687537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:05.751533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.751254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:05.753281 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.753180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"]
Aug 04 16:32:05.755986 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:32:05.755962    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5ea33c_d3e5_4063_9796_95c79eff7924.slice/crio-783ac54d2a8bbab5fe9107ca13ff594110e581248852ca5ee20f24856ccf18b8 WatchSource:0}: Error finding container 783ac54d2a8bbab5fe9107ca13ff594110e581248852ca5ee20f24856ccf18b8: Status 404 returned error can't find the container with id 783ac54d2a8bbab5fe9107ca13ff594110e581248852ca5ee20f24856ccf18b8
Aug 04 16:32:05.757093 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.757074    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:32:05.849714 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.849681    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"]
Aug 04 16:32:05.851256 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:32:05.851221    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29fa320d_fbee_44cd_b72f_00a1040488d3.slice/crio-f1c027a415ea90b0acc4b3dc1e8bc360906b3378f22debea9eab6f928f181256 WatchSource:0}: Error finding container f1c027a415ea90b0acc4b3dc1e8bc360906b3378f22debea9eab6f928f181256: Status 404 returned error can't find the container with id f1c027a415ea90b0acc4b3dc1e8bc360906b3378f22debea9eab6f928f181256
Aug 04 16:32:05.916482 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:05.916460    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"]
Aug 04 16:32:05.918243 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:32:05.918213    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda896a44a_96e4_44de_8c13_4c94b9a8e2b6.slice/crio-3c4d37f8bcb7cc55708a02c18f1d1ca10cbece3ce929123ca02cb000f49848ac WatchSource:0}: Error finding container 3c4d37f8bcb7cc55708a02c18f1d1ca10cbece3ce929123ca02cb000f49848ac: Status 404 returned error can't find the container with id 3c4d37f8bcb7cc55708a02c18f1d1ca10cbece3ce929123ca02cb000f49848ac
Aug 04 16:32:06.124826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.124726    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7" event={"ID":"a896a44a-96e4-44de-8c13-4c94b9a8e2b6","Type":"ContainerStarted","Data":"1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628"}
Aug 04 16:32:06.124826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.124780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7" event={"ID":"a896a44a-96e4-44de-8c13-4c94b9a8e2b6","Type":"ContainerStarted","Data":"3c4d37f8bcb7cc55708a02c18f1d1ca10cbece3ce929123ca02cb000f49848ac"}
Aug 04 16:32:06.124826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.124805    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:06.126375 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.126351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb" event={"ID":"29fa320d-fbee-44cd-b72f-00a1040488d3","Type":"ContainerStarted","Data":"5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952"}
Aug 04 16:32:06.126501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.126389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb" event={"ID":"29fa320d-fbee-44cd-b72f-00a1040488d3","Type":"ContainerStarted","Data":"f1c027a415ea90b0acc4b3dc1e8bc360906b3378f22debea9eab6f928f181256"}
Aug 04 16:32:06.126501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.126445    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:06.127634 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.127614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877" event={"ID":"ea5ea33c-d3e5-4063-9796-95c79eff7924","Type":"ContainerStarted","Data":"783ac54d2a8bbab5fe9107ca13ff594110e581248852ca5ee20f24856ccf18b8"}
Aug 04 16:32:06.140386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.140336    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7" podStartSLOduration=1.140317646 podStartE2EDuration="1.140317646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:32:06.139633941 +0000 UTC m=+1806.966331413" watchObservedRunningTime="2026-08-04 16:32:06.140317646 +0000 UTC m=+1806.967015113"
Aug 04 16:32:06.160033 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:06.159986    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb" podStartSLOduration=1.159973493 podStartE2EDuration="1.159973493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:32:06.158302789 +0000 UTC m=+1806.985000261" watchObservedRunningTime="2026-08-04 16:32:06.159973493 +0000 UTC m=+1806.986670969"
Aug 04 16:32:07.134897 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:07.134853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877" event={"ID":"ea5ea33c-d3e5-4063-9796-95c79eff7924","Type":"ContainerStarted","Data":"24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929"}
Aug 04 16:32:07.135421 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:07.134946    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:07.154045 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:07.153995    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877" podStartSLOduration=2.585356466 podStartE2EDuration="3.153981545s" totalImagesPullingTime="568.625079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:32:07.151995127 +0000 UTC m=+1807.978692600" watchObservedRunningTime="2026-08-04 16:32:07.153981545 +0000 UTC m=+1807.980679016"
Aug 04 16:32:13.145848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:13.145818    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:17.137539 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:17.137510    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:17.138003 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:17.137587    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:18.106165 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:18.106127    2563 patch_prober.go:28] interesting pod/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 16:32:18.106409 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:18.106187    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 16:32:18.202017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:18.201987    2563 generic.go:356] "Generic (PLEG): container finished" podID="2f3b0d96-a122-4de2-9901-326dd403b172" containerID="93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998" exitCode=0
Aug 04 16:32:18.202357 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:18.202026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" event={"ID":"2f3b0d96-a122-4de2-9901-326dd403b172","Type":"ContainerDied","Data":"93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998"}
Aug 04 16:32:18.202357 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:18.202352    2563 scope.go:117] "RemoveContainer" containerID="93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998"
Aug 04 16:32:18.203296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:18.203267    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:18.203351 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:18.203341    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:18.203396 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:18.203381    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:19.210138 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:19.210106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" event={"ID":"2f3b0d96-a122-4de2-9901-326dd403b172","Type":"ContainerStarted","Data":"cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c"}
Aug 04 16:32:19.236406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:19.236380    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:19.236566 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:19.236546    2563 patch_prober.go:28] interesting pod/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 16:32:19.236611 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:19.236590    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 16:32:20.235642 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:20.235607    2563 patch_prober.go:28] interesting pod/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 16:32:20.236077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:20.235660    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 16:32:21.236260 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:21.236226    2563 patch_prober.go:28] interesting pod/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 16:32:21.236692 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:21.236277    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 16:32:22.235959 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:22.235930    2563 patch_prober.go:28] interesting pod/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 16:32:22.236204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:22.235981    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 16:32:23.235607 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:23.235572    2563 patch_prober.go:28] interesting pod/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 16:32:23.236019 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:23.235622    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 16:32:24.236666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:24.236627    2563 patch_prober.go:28] interesting pod/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 16:32:24.237103 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:24.236691    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 16:32:25.240326 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:25.240296    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:25.240710 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:25.240687    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:25.241346 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:25.241329    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:45.296944 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.296886    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"]
Aug 04 16:32:45.297376 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.297108    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877" podUID="ea5ea33c-d3e5-4063-9796-95c79eff7924" containerName="maas-api" containerID="cri-o://24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929" gracePeriod=30
Aug 04 16:32:45.319765 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.319720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:45.341847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.341815    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"]
Aug 04 16:32:45.342092 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.342048    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb" podUID="29fa320d-fbee-44cd-b72f-00a1040488d3" containerName="payload-processing" containerID="cri-o://5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952" gracePeriod=30
Aug 04 16:32:45.350196 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.350168    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"]
Aug 04 16:32:45.350458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.350390    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7" podUID="a896a44a-96e4-44de-8c13-4c94b9a8e2b6" containerName="payload-pre-processing" containerID="cri-o://1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628" gracePeriod=30
Aug 04 16:32:45.386535 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.386498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:45.449297 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.449267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:45.508834 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.508803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:45.635049 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.634758    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:45.644574 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.643531    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"]
Aug 04 16:32:45.644574 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.643745    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy" containerID="cri-o://cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c" gracePeriod=30
Aug 04 16:32:45.649322 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.649289    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:45.662567 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.662488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:45.696894 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.696853    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:45.735697 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.735662    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gctzl\" (UniqueName: \"kubernetes.io/projected/29fa320d-fbee-44cd-b72f-00a1040488d3-kube-api-access-gctzl\") pod \"29fa320d-fbee-44cd-b72f-00a1040488d3\" (UID: \"29fa320d-fbee-44cd-b72f-00a1040488d3\") "
Aug 04 16:32:45.735850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.735714    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ea33c-d3e5-4063-9796-95c79eff7924-openshift-service-ca\") pod \"ea5ea33c-d3e5-4063-9796-95c79eff7924\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") "
Aug 04 16:32:45.735850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.735747    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-plugins-config-volume\") pod \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\" (UID: \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\") "
Aug 04 16:32:45.735850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.735777    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fa320d-fbee-44cd-b72f-00a1040488d3-plugins-config-volume\") pod \"29fa320d-fbee-44cd-b72f-00a1040488d3\" (UID: \"29fa320d-fbee-44cd-b72f-00a1040488d3\") "
Aug 04 16:32:45.735850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.735830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbjxp\" (UniqueName: \"kubernetes.io/projected/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-kube-api-access-wbjxp\") pod \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\" (UID: \"a896a44a-96e4-44de-8c13-4c94b9a8e2b6\") "
Aug 04 16:32:45.736100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.735881    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj4mk\" (UniqueName: \"kubernetes.io/projected/ea5ea33c-d3e5-4063-9796-95c79eff7924-kube-api-access-sj4mk\") pod \"ea5ea33c-d3e5-4063-9796-95c79eff7924\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") "
Aug 04 16:32:45.736100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.735945    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls\") pod \"ea5ea33c-d3e5-4063-9796-95c79eff7924\" (UID: \"ea5ea33c-d3e5-4063-9796-95c79eff7924\") "
Aug 04 16:32:45.736208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.736061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea5ea33c-d3e5-4063-9796-95c79eff7924-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea5ea33c-d3e5-4063-9796-95c79eff7924" (UID: "ea5ea33c-d3e5-4063-9796-95c79eff7924"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:32:45.736208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.736186    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a896a44a-96e4-44de-8c13-4c94b9a8e2b6" (UID: "a896a44a-96e4-44de-8c13-4c94b9a8e2b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:32:45.736323 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.736277    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29fa320d-fbee-44cd-b72f-00a1040488d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29fa320d-fbee-44cd-b72f-00a1040488d3" (UID: "29fa320d-fbee-44cd-b72f-00a1040488d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:32:45.736404 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.736376    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ea33c-d3e5-4063-9796-95c79eff7924-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:45.736458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.736401    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:45.736458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.736416    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29fa320d-fbee-44cd-b72f-00a1040488d3-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:45.738376 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.738342    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29fa320d-fbee-44cd-b72f-00a1040488d3-kube-api-access-gctzl" (OuterVolumeSpecName: "kube-api-access-gctzl") pod "29fa320d-fbee-44cd-b72f-00a1040488d3" (UID: "29fa320d-fbee-44cd-b72f-00a1040488d3"). InnerVolumeSpecName "kube-api-access-gctzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:32:45.738496 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.738391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea5ea33c-d3e5-4063-9796-95c79eff7924-kube-api-access-sj4mk" (OuterVolumeSpecName: "kube-api-access-sj4mk") pod "ea5ea33c-d3e5-4063-9796-95c79eff7924" (UID: "ea5ea33c-d3e5-4063-9796-95c79eff7924"). InnerVolumeSpecName "kube-api-access-sj4mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:32:45.738496 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.738461    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-kube-api-access-wbjxp" (OuterVolumeSpecName: "kube-api-access-wbjxp") pod "a896a44a-96e4-44de-8c13-4c94b9a8e2b6" (UID: "a896a44a-96e4-44de-8c13-4c94b9a8e2b6"). InnerVolumeSpecName "kube-api-access-wbjxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:32:45.738768 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.738746    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea5ea33c-d3e5-4063-9796-95c79eff7924" (UID: "ea5ea33c-d3e5-4063-9796-95c79eff7924"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:32:45.837523 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.837436    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj4mk\" (UniqueName: \"kubernetes.io/projected/ea5ea33c-d3e5-4063-9796-95c79eff7924-kube-api-access-sj4mk\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:45.837523 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.837473    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea5ea33c-d3e5-4063-9796-95c79eff7924-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:45.837523 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.837482    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gctzl\" (UniqueName: \"kubernetes.io/projected/29fa320d-fbee-44cd-b72f-00a1040488d3-kube-api-access-gctzl\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:45.837523 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.837491    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbjxp\" (UniqueName: \"kubernetes.io/projected/a896a44a-96e4-44de-8c13-4c94b9a8e2b6-kube-api-access-wbjxp\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:45.901112 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:45.901069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:46.173832 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.173747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:46.376420 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.376385    2563 generic.go:356] "Generic (PLEG): container finished" podID="ea5ea33c-d3e5-4063-9796-95c79eff7924" containerID="24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929" exitCode=0
Aug 04 16:32:46.376864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.376448    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"
Aug 04 16:32:46.376864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.376472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877" event={"ID":"ea5ea33c-d3e5-4063-9796-95c79eff7924","Type":"ContainerDied","Data":"24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929"}
Aug 04 16:32:46.376864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.376523    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877" event={"ID":"ea5ea33c-d3e5-4063-9796-95c79eff7924","Type":"ContainerDied","Data":"783ac54d2a8bbab5fe9107ca13ff594110e581248852ca5ee20f24856ccf18b8"}
Aug 04 16:32:46.376864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.376546    2563 scope.go:117] "RemoveContainer" containerID="24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929"
Aug 04 16:32:46.377965 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.377893    2563 generic.go:356] "Generic (PLEG): container finished" podID="a896a44a-96e4-44de-8c13-4c94b9a8e2b6" containerID="1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628" exitCode=0
Aug 04 16:32:46.378047 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.377978    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"
Aug 04 16:32:46.378047 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.378002    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7" event={"ID":"a896a44a-96e4-44de-8c13-4c94b9a8e2b6","Type":"ContainerDied","Data":"1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628"}
Aug 04 16:32:46.378208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.378053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7" event={"ID":"a896a44a-96e4-44de-8c13-4c94b9a8e2b6","Type":"ContainerDied","Data":"3c4d37f8bcb7cc55708a02c18f1d1ca10cbece3ce929123ca02cb000f49848ac"}
Aug 04 16:32:46.379754 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.379733    2563 generic.go:356] "Generic (PLEG): container finished" podID="29fa320d-fbee-44cd-b72f-00a1040488d3" containerID="5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952" exitCode=0
Aug 04 16:32:46.379949 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.379768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb" event={"ID":"29fa320d-fbee-44cd-b72f-00a1040488d3","Type":"ContainerDied","Data":"5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952"}
Aug 04 16:32:46.380062 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.379979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb" event={"ID":"29fa320d-fbee-44cd-b72f-00a1040488d3","Type":"ContainerDied","Data":"f1c027a415ea90b0acc4b3dc1e8bc360906b3378f22debea9eab6f928f181256"}
Aug 04 16:32:46.380062 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.379796    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"
Aug 04 16:32:46.386826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.386806    2563 scope.go:117] "RemoveContainer" containerID="24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929"
Aug 04 16:32:46.387210 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:46.387181    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929\": container with ID starting with 24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929 not found: ID does not exist" containerID="24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929"
Aug 04 16:32:46.387314 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.387217    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929"} err="failed to get container status \"24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929\": rpc error: code = NotFound desc = could not find container \"24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929\": container with ID starting with 24ce0c86ca55de06d3c1bfa79f5a2a3660d55dcb32a7705ea604a9017f170929 not found: ID does not exist"
Aug 04 16:32:46.387314 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.387243    2563 scope.go:117] "RemoveContainer" containerID="1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628"
Aug 04 16:32:46.398188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.398167    2563 scope.go:117] "RemoveContainer" containerID="1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628"
Aug 04 16:32:46.398597 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:46.398575    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628\": container with ID starting with 1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628 not found: ID does not exist" containerID="1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628"
Aug 04 16:32:46.398641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.398604    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628"} err="failed to get container status \"1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628\": rpc error: code = NotFound desc = could not find container \"1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628\": container with ID starting with 1941537a6afe3a765fe1210363eceb5381876ddf514dcd2f587a27309e08e628 not found: ID does not exist"
Aug 04 16:32:46.398641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.398622    2563 scope.go:117] "RemoveContainer" containerID="5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952"
Aug 04 16:32:46.407056 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.407040    2563 scope.go:117] "RemoveContainer" containerID="5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952"
Aug 04 16:32:46.407326 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:46.407308    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952\": container with ID starting with 5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952 not found: ID does not exist" containerID="5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952"
Aug 04 16:32:46.407392 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.407334    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952"} err="failed to get container status \"5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952\": rpc error: code = NotFound desc = could not find container \"5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952\": container with ID starting with 5c022ecde139e1ba8c9156ab908df3de5637a75fe8336e30ed0b5c390203e952 not found: ID does not exist"
Aug 04 16:32:46.422710 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.422689    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"]
Aug 04 16:32:46.429742 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.429691    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6d639331-7db5dc6657-hj877"]
Aug 04 16:32:46.439406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.439386    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"]
Aug 04 16:32:46.443497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.443477    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6d639331-6c4845448b-kp7fb"]
Aug 04 16:32:46.454657 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.454633    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"]
Aug 04 16:32:46.459226 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.459203    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6d639331-558c85c6-z7vt7"]
Aug 04 16:32:46.771059 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771029    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"]
Aug 04 16:32:46.771477 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771465    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a896a44a-96e4-44de-8c13-4c94b9a8e2b6" containerName="payload-pre-processing"
Aug 04 16:32:46.771522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771479    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a896a44a-96e4-44de-8c13-4c94b9a8e2b6" containerName="payload-pre-processing"
Aug 04 16:32:46.771522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771497    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea5ea33c-d3e5-4063-9796-95c79eff7924" containerName="maas-api"
Aug 04 16:32:46.771522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771504    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea5ea33c-d3e5-4063-9796-95c79eff7924" containerName="maas-api"
Aug 04 16:32:46.771522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771517    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29fa320d-fbee-44cd-b72f-00a1040488d3" containerName="payload-processing"
Aug 04 16:32:46.771522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771523    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="29fa320d-fbee-44cd-b72f-00a1040488d3" containerName="payload-processing"
Aug 04 16:32:46.771677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771587    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a896a44a-96e4-44de-8c13-4c94b9a8e2b6" containerName="payload-pre-processing"
Aug 04 16:32:46.771677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771595    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea5ea33c-d3e5-4063-9796-95c79eff7924" containerName="maas-api"
Aug 04 16:32:46.771677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.771601    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="29fa320d-fbee-44cd-b72f-00a1040488d3" containerName="payload-processing"
Aug 04 16:32:46.779912 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.779881    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.782103 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.782083    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-57d47eb1-gw-openshift-default-dockercfg-87cmc\""
Aug 04 16:32:46.788504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.788461    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"]
Aug 04 16:32:46.847353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-podinfo\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.847529 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-socket\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.847529 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-envoy\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.847529 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-certs\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.847529 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-data\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.847529 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-credential-socket\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.847730 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istiod-ca-cert\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.847730 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pztjw\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-kube-api-access-pztjw\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.847730 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.847590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-token\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948439 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-data\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948640 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-credential-socket\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948640 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istiod-ca-cert\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948640 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pztjw\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-kube-api-access-pztjw\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948640 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-token\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-podinfo\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-data\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-socket\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.948893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-envoy\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.949108 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.948969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-certs\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.949618 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.949590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-certs\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.949752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.949573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-socket\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.949752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.949687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istiod-ca-cert\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.949752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.949725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-credential-socket\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.952831 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.952206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-envoy\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.952831 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.952391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-podinfo\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.956431 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.956412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-token\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:46.956967 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:46.956951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pztjw\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-kube-api-access-pztjw\") pod \"e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") " pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:47.092582 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.092495    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:47.241046 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.241022    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"]
Aug 04 16:32:47.242575 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:32:47.242551    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2982df2_fc7a_42b7_ab0d_f71437b7cb32.slice/crio-3a169c50c85a65f0182b1ee0b9c6dfbcd86ab72e54f3b92e6e6e1e52420c1b07 WatchSource:0}: Error finding container 3a169c50c85a65f0182b1ee0b9c6dfbcd86ab72e54f3b92e6e6e1e52420c1b07: Status 404 returned error can't find the container with id 3a169c50c85a65f0182b1ee0b9c6dfbcd86ab72e54f3b92e6e6e1e52420c1b07
Aug 04 16:32:47.244555 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.244527    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:47.244617 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.244587    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:47.244663 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.244614    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:32:47.390974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.390849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" event={"ID":"c2982df2-fc7a-42b7-ab0d-f71437b7cb32","Type":"ContainerStarted","Data":"1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496"}
Aug 04 16:32:47.390974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.390941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" event={"ID":"c2982df2-fc7a-42b7-ab0d-f71437b7cb32","Type":"ContainerStarted","Data":"3a169c50c85a65f0182b1ee0b9c6dfbcd86ab72e54f3b92e6e6e1e52420c1b07"}
Aug 04 16:32:47.411464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.411408    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" podStartSLOduration=1.411391064 podStartE2EDuration="1.411391064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:32:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:32:47.409643669 +0000 UTC m=+1848.236341142" watchObservedRunningTime="2026-08-04 16:32:47.411391064 +0000 UTC m=+1848.238088536"
Aug 04 16:32:47.717455 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.717355    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29fa320d-fbee-44cd-b72f-00a1040488d3" path="/var/lib/kubelet/pods/29fa320d-fbee-44cd-b72f-00a1040488d3/volumes"
Aug 04 16:32:47.717767 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.717751    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a896a44a-96e4-44de-8c13-4c94b9a8e2b6" path="/var/lib/kubelet/pods/a896a44a-96e4-44de-8c13-4c94b9a8e2b6/volumes"
Aug 04 16:32:47.718129 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:47.718115    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea5ea33c-d3e5-4063-9796-95c79eff7924" path="/var/lib/kubelet/pods/ea5ea33c-d3e5-4063-9796-95c79eff7924/volumes"
Aug 04 16:32:48.092744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:48.092711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:48.097874 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:48.097852    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:48.400045 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:48.399955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:48.400787 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:48.400768    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:32:48.741594 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:48.741560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:48.805157 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:48.805129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:48.946937 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:48.946886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:49.126745 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.126672    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"]
Aug 04 16:32:49.131536 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.131514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.133813 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.133794    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-57d47eb1-serving-cert\""
Aug 04 16:32:49.144255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.144230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"]
Aug 04 16:32:49.150378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.150354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:49.171047 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.171020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.171203 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.171078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.171203 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.171156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wdjl\" (UniqueName: \"kubernetes.io/projected/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-kube-api-access-9wdjl\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.271755 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.271718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.272257 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:49.272230    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-serving-cert: secret "maas-api-e2e-migrate-57d47eb1-serving-cert" not found
Aug 04 16:32:49.272257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.271763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.272478 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:49.272325    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls podName:0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8 nodeName:}" failed. No retries permitted until 2026-08-04 16:32:49.772302482 +0000 UTC m=+1850.598999949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls") pod "maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj" (UID: "0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8") : secret "maas-api-e2e-migrate-57d47eb1-serving-cert" not found
Aug 04 16:32:49.272478 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.272351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wdjl\" (UniqueName: \"kubernetes.io/projected/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-kube-api-access-9wdjl\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.273005 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.272977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.283374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.283341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wdjl\" (UniqueName: \"kubernetes.io/projected/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-kube-api-access-9wdjl\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.645154 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.645117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:49.744014 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.743975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:49.752835 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.752807    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"]
Aug 04 16:32:49.756737 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.756723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:49.758851 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.758829    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-57d47eb1-dockercfg-kk87g\""
Aug 04 16:32:49.758973 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.758934    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-57d47eb1\""
Aug 04 16:32:49.766938 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.766882    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"]
Aug 04 16:32:49.773920 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.773879    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"]
Aug 04 16:32:49.777364 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.777336    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:49.778706 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.778678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:49.778864 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:49.778847    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-serving-cert: secret "maas-api-e2e-migrate-57d47eb1-serving-cert" not found
Aug 04 16:32:49.778981 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:49.778931    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls podName:0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8 nodeName:}" failed. No retries permitted until 2026-08-04 16:32:50.778895623 +0000 UTC m=+1851.605593088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls") pod "maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj" (UID: "0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8") : secret "maas-api-e2e-migrate-57d47eb1-serving-cert" not found
Aug 04 16:32:49.792351 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.792324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"]
Aug 04 16:32:49.882933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.879849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/467f8f23-84de-4d36-a3cf-e215c4a3f38b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b\" (UID: \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\") " pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:49.882933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.879934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zltx\" (UniqueName: \"kubernetes.io/projected/467f8f23-84de-4d36-a3cf-e215c4a3f38b-kube-api-access-5zltx\") pod \"payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b\" (UID: \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\") " pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:49.882933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.880051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6\" (UID: \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:49.882933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.880096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpp2x\" (UniqueName: \"kubernetes.io/projected/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-kube-api-access-lpp2x\") pod \"payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6\" (UID: \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:49.981867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.981768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6\" (UID: \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:49.981867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.981834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpp2x\" (UniqueName: \"kubernetes.io/projected/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-kube-api-access-lpp2x\") pod \"payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6\" (UID: \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:49.982138 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.981961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/467f8f23-84de-4d36-a3cf-e215c4a3f38b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b\" (UID: \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\") " pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:49.982138 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.981992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zltx\" (UniqueName: \"kubernetes.io/projected/467f8f23-84de-4d36-a3cf-e215c4a3f38b-kube-api-access-5zltx\") pod \"payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b\" (UID: \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\") " pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:49.982754 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.982725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6\" (UID: \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:49.982846 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.982763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/467f8f23-84de-4d36-a3cf-e215c4a3f38b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b\" (UID: \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\") " pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:49.986464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.986437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:32:49.990971 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.990948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpp2x\" (UniqueName: \"kubernetes.io/projected/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-kube-api-access-lpp2x\") pod \"payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6\" (UID: \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:49.990971 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:49.990960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zltx\" (UniqueName: \"kubernetes.io/projected/467f8f23-84de-4d36-a3cf-e215c4a3f38b-kube-api-access-5zltx\") pod \"payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b\" (UID: \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\") " pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:50.069115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.069087    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:50.089271 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.089243    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:50.236498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.236467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"]
Aug 04 16:32:50.238060 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:32:50.238030    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147bfcc8_7d0d_4ce1_8a6e_8e6e0e898f04.slice/crio-02a605d9edc2da2fec98b5844c804312b47c011868744a3777ee678de75c45bb WatchSource:0}: Error finding container 02a605d9edc2da2fec98b5844c804312b47c011868744a3777ee678de75c45bb: Status 404 returned error can't find the container with id 02a605d9edc2da2fec98b5844c804312b47c011868744a3777ee678de75c45bb
Aug 04 16:32:50.258614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.258590    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"]
Aug 04 16:32:50.259652 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:32:50.259631    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467f8f23_84de_4d36_a3cf_e215c4a3f38b.slice/crio-0ecad6b48c47eba2c0e8f6672b8ecdc56e954851f9fc1434ab50e14445c77642 WatchSource:0}: Error finding container 0ecad6b48c47eba2c0e8f6672b8ecdc56e954851f9fc1434ab50e14445c77642: Status 404 returned error can't find the container with id 0ecad6b48c47eba2c0e8f6672b8ecdc56e954851f9fc1434ab50e14445c77642
Aug 04 16:32:50.415846 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.415807    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b" event={"ID":"467f8f23-84de-4d36-a3cf-e215c4a3f38b","Type":"ContainerStarted","Data":"f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1"}
Aug 04 16:32:50.416060 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.415872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b" event={"ID":"467f8f23-84de-4d36-a3cf-e215c4a3f38b","Type":"ContainerStarted","Data":"0ecad6b48c47eba2c0e8f6672b8ecdc56e954851f9fc1434ab50e14445c77642"}
Aug 04 16:32:50.417711 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.417684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6" event={"ID":"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04","Type":"ContainerStarted","Data":"bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411"}
Aug 04 16:32:50.417837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.417729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6" event={"ID":"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04","Type":"ContainerStarted","Data":"02a605d9edc2da2fec98b5844c804312b47c011868744a3777ee678de75c45bb"}
Aug 04 16:32:50.417837 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.417787    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:32:50.434529 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.434442    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b" podStartSLOduration=1.434429072 podStartE2EDuration="1.434429072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:32:50.432444907 +0000 UTC m=+1851.259142402" watchObservedRunningTime="2026-08-04 16:32:50.434429072 +0000 UTC m=+1851.261126541"
Aug 04 16:32:50.449582 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.449532    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6" podStartSLOduration=1.449517762 podStartE2EDuration="1.449517762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:32:50.447024459 +0000 UTC m=+1851.273721938" watchObservedRunningTime="2026-08-04 16:32:50.449517762 +0000 UTC m=+1851.276215240"
Aug 04 16:32:50.790966 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.790929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:50.793723 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.793692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls\") pod \"maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:50.914724 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.914698    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:50.943366 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.943337    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:50.993191 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993158    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-envoy\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993230    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-istio-token\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993261    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-data\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-credential-socket\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993384    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pclh7\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-kube-api-access-pclh7\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993410    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-socket\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993449    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-certs\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993486    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f3b0d96-a122-4de2-9901-326dd403b172-istio-podinfo\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f3b0d96-a122-4de2-9901-326dd403b172-istiod-ca-cert\") pod \"2f3b0d96-a122-4de2-9901-326dd403b172\" (UID: \"2f3b0d96-a122-4de2-9901-326dd403b172\") "
Aug 04 16:32:50.993776 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993581    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:32:50.993776 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993759    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:32:50.993882 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993775    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:32:50.993971 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993935    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:50.993971 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993955    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:50.993971 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.993969    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:50.994142 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.994108    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:32:50.994194 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.994154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f3b0d96-a122-4de2-9901-326dd403b172-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:32:50.995702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.995674    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:32:50.995835 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.995798    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:32:50.996603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.996567    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-kube-api-access-pclh7" (OuterVolumeSpecName: "kube-api-access-pclh7") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "kube-api-access-pclh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:32:50.996702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:50.996640    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f3b0d96-a122-4de2-9901-326dd403b172-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f3b0d96-a122-4de2-9901-326dd403b172" (UID: "2f3b0d96-a122-4de2-9901-326dd403b172"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:32:51.091568 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.091538    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"]
Aug 04 16:32:51.093781 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:32:51.093742    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc28343_ef50_4dbc_afd7_9e4f2c1d68f8.slice/crio-d78da49b49b6771fa42a836c898b44336ab6503d992b938654b99d6f9421df9e WatchSource:0}: Error finding container d78da49b49b6771fa42a836c898b44336ab6503d992b938654b99d6f9421df9e: Status 404 returned error can't find the container with id d78da49b49b6771fa42a836c898b44336ab6503d992b938654b99d6f9421df9e
Aug 04 16:32:51.095305 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.095285    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pclh7\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-kube-api-access-pclh7\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:51.095384 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.095307    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:51.095456 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.095446    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f3b0d96-a122-4de2-9901-326dd403b172-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:51.095495 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.095458    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f3b0d96-a122-4de2-9901-326dd403b172-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:51.095495 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.095467    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f3b0d96-a122-4de2-9901-326dd403b172-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:51.095495 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.095480    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f3b0d96-a122-4de2-9901-326dd403b172-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:32:51.425762 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.425724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj" event={"ID":"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8","Type":"ContainerStarted","Data":"d78da49b49b6771fa42a836c898b44336ab6503d992b938654b99d6f9421df9e"}
Aug 04 16:32:51.427783 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.427756    2563 generic.go:356] "Generic (PLEG): container finished" podID="2f3b0d96-a122-4de2-9901-326dd403b172" containerID="cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c" exitCode=0
Aug 04 16:32:51.427943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.427808    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"
Aug 04 16:32:51.427943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.427843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" event={"ID":"2f3b0d96-a122-4de2-9901-326dd403b172","Type":"ContainerDied","Data":"cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c"}
Aug 04 16:32:51.427943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.427928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr" event={"ID":"2f3b0d96-a122-4de2-9901-326dd403b172","Type":"ContainerDied","Data":"bbb6b67723b951fb739b42f0328a47c3ed6eb2077920eb48f0771bf19eeb294c"}
Aug 04 16:32:51.428184 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.427940    2563 scope.go:117] "RemoveContainer" containerID="cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c"
Aug 04 16:32:51.428454 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.428394    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:32:51.440150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.440134    2563 scope.go:117] "RemoveContainer" containerID="93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998"
Aug 04 16:32:51.449140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.449118    2563 scope.go:117] "RemoveContainer" containerID="cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c"
Aug 04 16:32:51.449593 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:51.449409    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c\": container with ID starting with cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c not found: ID does not exist" containerID="cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c"
Aug 04 16:32:51.449593 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.449452    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c"} err="failed to get container status \"cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c\": rpc error: code = NotFound desc = could not find container \"cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c\": container with ID starting with cc5caf59bcc7d12dff34ea3e5ded047aa4e96d76be1f486b8ef75dafb2834c7c not found: ID does not exist"
Aug 04 16:32:51.449593 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.449477    2563 scope.go:117] "RemoveContainer" containerID="93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998"
Aug 04 16:32:51.449846 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:32:51.449825    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998\": container with ID starting with 93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998 not found: ID does not exist" containerID="93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998"
Aug 04 16:32:51.449886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.449854    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998"} err="failed to get container status \"93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998\": rpc error: code = NotFound desc = could not find container \"93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998\": container with ID starting with 93570c45647bc8fc02b5ef28c52e5d3ea5db4ffd46c94fd9a0c78e1e17a7e998 not found: ID does not exist"
Aug 04 16:32:51.451486 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.451466    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"]
Aug 04 16:32:51.455503 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.455484    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6d639331-openshift-default-ddc9847c4-sz6vr"]
Aug 04 16:32:51.718675 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:51.718598    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" path="/var/lib/kubelet/pods/2f3b0d96-a122-4de2-9901-326dd403b172/volumes"
Aug 04 16:32:52.435546 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:52.435508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj" event={"ID":"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8","Type":"ContainerStarted","Data":"992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa"}
Aug 04 16:32:52.436001 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:52.435755    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:32:52.454509 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:52.454458    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj" podStartSLOduration=3.11050217 podStartE2EDuration="3.454443967s" totalImagesPullingTime="343.941797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:32:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:32:52.452337129 +0000 UTC m=+1853.279034603" watchObservedRunningTime="2026-08-04 16:32:52.454443967 +0000 UTC m=+1853.281141439"
Aug 04 16:32:58.451739 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:32:58.451708    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:33:01.431040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:01.431004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:33:02.437507 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:02.437481    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:33:02.506731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:02.506703    2563 generic.go:356] "Generic (PLEG): container finished" podID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerID="1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496" exitCode=0
Aug 04 16:33:02.506885 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:02.506786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" event={"ID":"c2982df2-fc7a-42b7-ab0d-f71437b7cb32","Type":"ContainerDied","Data":"1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496"}
Aug 04 16:33:02.507192 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:02.507177    2563 scope.go:117] "RemoveContainer" containerID="1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496"
Aug 04 16:33:02.508134 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:02.508108    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:02.508199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:02.508172    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:02.508241 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:02.508203    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:03.400445 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:03.400400    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:33:03.514681 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:03.514641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" event={"ID":"c2982df2-fc7a-42b7-ab0d-f71437b7cb32","Type":"ContainerStarted","Data":"c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64"}
Aug 04 16:33:04.093716 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:04.093673    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:33:04.094978 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:04.094949    2563 patch_prober.go:28] interesting pod/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:33:04.095509 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:04.095178    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 16:33:05.093459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:05.093417    2563 patch_prober.go:28] interesting pod/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:33:05.094091 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:05.094054    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 16:33:06.093207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:06.093170    2563 patch_prober.go:28] interesting pod/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:33:06.093521 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:06.093489    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 16:33:07.093864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:07.093820    2563 patch_prober.go:28] interesting pod/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:33:07.094374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:07.093926    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 16:33:08.093279 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:08.093228    2563 patch_prober.go:28] interesting pod/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:33:08.093513 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:08.093313    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 16:33:09.096395 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:09.096362    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:33:09.096864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:09.096752    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:33:09.097350 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:09.097332    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:33:19.773182 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.773145    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"]
Aug 04 16:33:19.773677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.773395    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj" podUID="0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" containerName="maas-api" containerID="cri-o://992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa" gracePeriod=30
Aug 04 16:33:19.804794 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.804758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:19.833490 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.833460    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"]
Aug 04 16:33:19.833959 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.833726    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b" podUID="467f8f23-84de-4d36-a3cf-e215c4a3f38b" containerName="payload-processing" containerID="cri-o://f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1" gracePeriod=30
Aug 04 16:33:19.842269 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.842230    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"]
Aug 04 16:33:19.842531 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.842461    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6" podUID="147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04" containerName="payload-pre-processing" containerID="cri-o://bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411" gracePeriod=30
Aug 04 16:33:19.872517 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.872484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:19.932054 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.932019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:19.988062 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:19.988016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:20.122512 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.121890    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"]
Aug 04 16:33:20.122512 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.122148    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy" containerID="cri-o://c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64" gracePeriod=30
Aug 04 16:33:20.146591 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.145356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:20.154434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.154135    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:33:20.220582 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.220557    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:33:20.221857 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.221836    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:33:20.266424 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.266397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-plugins-config-volume\") pod \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\" (UID: \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\") "
Aug 04 16:33:20.266580 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.266495    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpp2x\" (UniqueName: \"kubernetes.io/projected/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-kube-api-access-lpp2x\") pod \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\" (UID: \"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04\") "
Aug 04 16:33:20.266756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.266736    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04" (UID: "147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:33:20.268722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.268693    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-kube-api-access-lpp2x" (OuterVolumeSpecName: "kube-api-access-lpp2x") pod "147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04" (UID: "147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04"). InnerVolumeSpecName "kube-api-access-lpp2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:33:20.367731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.367658    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zltx\" (UniqueName: \"kubernetes.io/projected/467f8f23-84de-4d36-a3cf-e215c4a3f38b-kube-api-access-5zltx\") pod \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\" (UID: \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\") "
Aug 04 16:33:20.367731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.367702    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls\") pod \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") "
Aug 04 16:33:20.367934 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.367766    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wdjl\" (UniqueName: \"kubernetes.io/projected/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-kube-api-access-9wdjl\") pod \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") "
Aug 04 16:33:20.367934 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.367796    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-openshift-service-ca\") pod \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\" (UID: \"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8\") "
Aug 04 16:33:20.367934 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.367812    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/467f8f23-84de-4d36-a3cf-e215c4a3f38b-plugins-config-volume\") pod \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\" (UID: \"467f8f23-84de-4d36-a3cf-e215c4a3f38b\") "
Aug 04 16:33:20.368131 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.368105    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpp2x\" (UniqueName: \"kubernetes.io/projected/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-kube-api-access-lpp2x\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:20.368131 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.368131    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:20.368261 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.368228    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" (UID: "0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:33:20.368261 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.368235    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467f8f23-84de-4d36-a3cf-e215c4a3f38b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "467f8f23-84de-4d36-a3cf-e215c4a3f38b" (UID: "467f8f23-84de-4d36-a3cf-e215c4a3f38b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:33:20.369996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.369972    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/467f8f23-84de-4d36-a3cf-e215c4a3f38b-kube-api-access-5zltx" (OuterVolumeSpecName: "kube-api-access-5zltx") pod "467f8f23-84de-4d36-a3cf-e215c4a3f38b" (UID: "467f8f23-84de-4d36-a3cf-e215c4a3f38b"). InnerVolumeSpecName "kube-api-access-5zltx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:33:20.370109 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.370008    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" (UID: "0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:33:20.370109 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.370068    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-kube-api-access-9wdjl" (OuterVolumeSpecName: "kube-api-access-9wdjl") pod "0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" (UID: "0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8"). InnerVolumeSpecName "kube-api-access-9wdjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:33:20.371262 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.371239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:20.469031 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.468996    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zltx\" (UniqueName: \"kubernetes.io/projected/467f8f23-84de-4d36-a3cf-e215c4a3f38b-kube-api-access-5zltx\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:20.469031 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.469030    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:20.469031 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.469040    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wdjl\" (UniqueName: \"kubernetes.io/projected/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-kube-api-access-9wdjl\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:20.469209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.469049    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:20.469209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.469057    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/467f8f23-84de-4d36-a3cf-e215c4a3f38b-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:20.601581 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.601553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:20.626360 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.626284    2563 generic.go:356] "Generic (PLEG): container finished" podID="147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04" containerID="bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411" exitCode=0
Aug 04 16:33:20.626360 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.626343    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"
Aug 04 16:33:20.626558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.626369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6" event={"ID":"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04","Type":"ContainerDied","Data":"bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411"}
Aug 04 16:33:20.626558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.626450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6" event={"ID":"147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04","Type":"ContainerDied","Data":"02a605d9edc2da2fec98b5844c804312b47c011868744a3777ee678de75c45bb"}
Aug 04 16:33:20.626558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.626478    2563 scope.go:117] "RemoveContainer" containerID="bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411"
Aug 04 16:33:20.627885 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.627864    2563 generic.go:356] "Generic (PLEG): container finished" podID="0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" containerID="992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa" exitCode=0
Aug 04 16:33:20.628005 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.627942    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"
Aug 04 16:33:20.628005 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.627997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj" event={"ID":"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8","Type":"ContainerDied","Data":"992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa"}
Aug 04 16:33:20.628005 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.628037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj" event={"ID":"0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8","Type":"ContainerDied","Data":"d78da49b49b6771fa42a836c898b44336ab6503d992b938654b99d6f9421df9e"}
Aug 04 16:33:20.629501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.629479    2563 generic.go:356] "Generic (PLEG): container finished" podID="467f8f23-84de-4d36-a3cf-e215c4a3f38b" containerID="f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1" exitCode=0
Aug 04 16:33:20.629629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.629520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b" event={"ID":"467f8f23-84de-4d36-a3cf-e215c4a3f38b","Type":"ContainerDied","Data":"f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1"}
Aug 04 16:33:20.629629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.629557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b" event={"ID":"467f8f23-84de-4d36-a3cf-e215c4a3f38b","Type":"ContainerDied","Data":"0ecad6b48c47eba2c0e8f6672b8ecdc56e954851f9fc1434ab50e14445c77642"}
Aug 04 16:33:20.629629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.629556    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"
Aug 04 16:33:20.637148 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.637131    2563 scope.go:117] "RemoveContainer" containerID="bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411"
Aug 04 16:33:20.637458 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:20.637438    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411\": container with ID starting with bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411 not found: ID does not exist" containerID="bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411"
Aug 04 16:33:20.637549 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.637467    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411"} err="failed to get container status \"bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411\": rpc error: code = NotFound desc = could not find container \"bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411\": container with ID starting with bd29582609c46f38e8fab0600226470f23a8175bd2f6a6a1e7ad11841597a411 not found: ID does not exist"
Aug 04 16:33:20.637549 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.637489    2563 scope.go:117] "RemoveContainer" containerID="992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa"
Aug 04 16:33:20.646224 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.646209    2563 scope.go:117] "RemoveContainer" containerID="992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa"
Aug 04 16:33:20.646468 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:20.646451    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa\": container with ID starting with 992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa not found: ID does not exist" containerID="992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa"
Aug 04 16:33:20.646534 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.646472    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa"} err="failed to get container status \"992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa\": rpc error: code = NotFound desc = could not find container \"992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa\": container with ID starting with 992ca39f0819f7113e452a1d8195d4c61842777054f1aa23075be022a2ffcafa not found: ID does not exist"
Aug 04 16:33:20.646534 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.646485    2563 scope.go:117] "RemoveContainer" containerID="f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1"
Aug 04 16:33:20.652517 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.652494    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"]
Aug 04 16:33:20.655196 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.655180    2563 scope.go:117] "RemoveContainer" containerID="f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1"
Aug 04 16:33:20.655424 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:20.655405    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1\": container with ID starting with f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1 not found: ID does not exist" containerID="f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1"
Aug 04 16:33:20.655487 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.655429    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1"} err="failed to get container status \"f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1\": rpc error: code = NotFound desc = could not find container \"f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1\": container with ID starting with f3a22cec6c4d25b8489a364d12ac092158e1ea06c0bd173f370cc00d6a3464d1 not found: ID does not exist"
Aug 04 16:33:20.655657 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.655641    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-57d47eb1-bb5855b96-krvf6"]
Aug 04 16:33:20.665533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.665516    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"]
Aug 04 16:33:20.669073 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.669056    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-57d47eb1-5b6f9cc56f-7mh8b"]
Aug 04 16:33:20.679436 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.679415    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"]
Aug 04 16:33:20.683311 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.683281    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-57d47eb1-6b8959859d-p57dj"]
Aug 04 16:33:20.935498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935425    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"]
Aug 04 16:33:20.935850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935838    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy"
Aug 04 16:33:20.935893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935851    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy"
Aug 04 16:33:20.935893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935869    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467f8f23-84de-4d36-a3cf-e215c4a3f38b" containerName="payload-processing"
Aug 04 16:33:20.935893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935876    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="467f8f23-84de-4d36-a3cf-e215c4a3f38b" containerName="payload-processing"
Aug 04 16:33:20.935893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935883    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" containerName="maas-api"
Aug 04 16:33:20.935893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935889    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" containerName="maas-api"
Aug 04 16:33:20.936069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935901    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04" containerName="payload-pre-processing"
Aug 04 16:33:20.936069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935925    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04" containerName="payload-pre-processing"
Aug 04 16:33:20.936069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935980    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy"
Aug 04 16:33:20.936069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935987    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04" containerName="payload-pre-processing"
Aug 04 16:33:20.936069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.935996    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="467f8f23-84de-4d36-a3cf-e215c4a3f38b" containerName="payload-processing"
Aug 04 16:33:20.936069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.936004    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy"
Aug 04 16:33:20.936069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.936010    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" containerName="maas-api"
Aug 04 16:33:20.938962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.938942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:20.941243 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.941224    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-160e6699-openshift-default-dockercfg-hrslj\""
Aug 04 16:33:20.953830 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.953805    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"]
Aug 04 16:33:20.958855 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:20.958814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:21.074344 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-podinfo\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.074514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istiod-ca-cert\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.074514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-credential-socket\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.074514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-data\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.074514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-token\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.074746 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-certs\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.074746 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-envoy\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.074821 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkpd8\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-kube-api-access-fkpd8\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.074871 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.074821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-socket\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.138639 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.138604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:21.175725 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.175693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-podinfo\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.175880 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.175731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istiod-ca-cert\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176004 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.175870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-credential-socket\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176004 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.175954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-data\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176004 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.175981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-token\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-certs\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-envoy\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkpd8\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-kube-api-access-fkpd8\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176285 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-socket\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176285 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-credential-socket\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176387 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-data\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176494 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-socket\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176554 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istiod-ca-cert\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.176554 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.176521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-certs\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.178585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.178561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-envoy\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.178701 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.178672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-podinfo\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.183706 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.183676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-token\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.183893 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.183871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkpd8\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-kube-api-access-fkpd8\") pod \"e2e-ait-160e6699-openshift-default-656db678f6-lghnk\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") " pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.249141 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.249115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:21.388847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.388816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"]
Aug 04 16:33:21.390347 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:33:21.390323    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c4ba98_c6f5_4c3f_8124_b9170e4bd9ca.slice/crio-9155f84ca41baa36f104fea649df8d65bd6ac662fdf322e9b55b52ca9248028a WatchSource:0}: Error finding container 9155f84ca41baa36f104fea649df8d65bd6ac662fdf322e9b55b52ca9248028a: Status 404 returned error can't find the container with id 9155f84ca41baa36f104fea649df8d65bd6ac662fdf322e9b55b52ca9248028a
Aug 04 16:33:21.392521 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.392491    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:21.392623 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.392560    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:21.392623 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.392589    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:21.640080 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.640001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" event={"ID":"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca","Type":"ContainerStarted","Data":"e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874"}
Aug 04 16:33:21.640080 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.640052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" event={"ID":"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca","Type":"ContainerStarted","Data":"9155f84ca41baa36f104fea649df8d65bd6ac662fdf322e9b55b52ca9248028a"}
Aug 04 16:33:21.661310 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.661259    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podStartSLOduration=1.6612446749999998 podStartE2EDuration="1.661244675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:33:21.658514341 +0000 UTC m=+1882.485211814" watchObservedRunningTime="2026-08-04 16:33:21.661244675 +0000 UTC m=+1882.487942188"
Aug 04 16:33:21.718003 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.717965    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8" path="/var/lib/kubelet/pods/0dc28343-ef50-4dbc-afd7-9e4f2c1d68f8/volumes"
Aug 04 16:33:21.718349 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.718336    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04" path="/var/lib/kubelet/pods/147bfcc8-7d0d-4ce1-8a6e-8e6e0e898f04/volumes"
Aug 04 16:33:21.718644 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:21.718633    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="467f8f23-84de-4d36-a3cf-e215c4a3f38b" path="/var/lib/kubelet/pods/467f8f23-84de-4d36-a3cf-e215c4a3f38b/volumes"
Aug 04 16:33:22.249945 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:22.249893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:22.254816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:22.254793    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:22.646292 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:22.646212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:22.647210 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:22.647194    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:23.006630 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:23.006593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:23.106196 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:23.106165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:24.099420 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.099384    2563 patch_prober.go:28] interesting pod/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 04 16:33:24.099801 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.099472    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 16:33:24.235093 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.235055    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"]
Aug 04 16:33:24.235537 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.235523    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy"
Aug 04 16:33:24.235614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.235539    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3b0d96-a122-4de2-9901-326dd403b172" containerName="istio-proxy"
Aug 04 16:33:24.238925 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.238893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.240818 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.240795    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-160e6699-serving-cert\""
Aug 04 16:33:24.250172 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.250146    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"]
Aug 04 16:33:24.267884 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.267856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:24.301848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.301814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmfs\" (UniqueName: \"kubernetes.io/projected/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-kube-api-access-zdmfs\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.302040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.301856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-openshift-service-ca\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.302040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.301880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.402631 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.402553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-openshift-service-ca\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.402631 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.402594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.402817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.402688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmfs\" (UniqueName: \"kubernetes.io/projected/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-kube-api-access-zdmfs\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.402817 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:24.402774    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-serving-cert: secret "maas-api-e2e-ait-160e6699-serving-cert" not found
Aug 04 16:33:24.402884 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:24.402837    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls podName:91dc1b8c-384f-45cd-a0e0-8a5f9fed149e nodeName:}" failed. No retries permitted until 2026-08-04 16:33:24.902821658 +0000 UTC m=+1885.729519109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls") pod "maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw" (UID: "91dc1b8c-384f-45cd-a0e0-8a5f9fed149e") : secret "maas-api-e2e-ait-160e6699-serving-cert" not found
Aug 04 16:33:24.403213 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.403195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-openshift-service-ca\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.414026 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.414005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmfs\" (UniqueName: \"kubernetes.io/projected/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-kube-api-access-zdmfs\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.476118 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.476087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:24.737658 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.737576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:24.848658 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.848624    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"]
Aug 04 16:33:24.851504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.851483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:24.853679 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.853656    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-160e6699\""
Aug 04 16:33:24.853877 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.853855    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-160e6699-dockercfg-q5lp9\""
Aug 04 16:33:24.864548 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.864524    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"]
Aug 04 16:33:24.891620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.891586    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"]
Aug 04 16:33:24.894132 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.894116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:24.906585 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.906560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"]
Aug 04 16:33:24.908311 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.908286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96544e27-a5e2-441c-9a4e-00473d75ac63-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w\" (UID: \"96544e27-a5e2-441c-9a4e-00473d75ac63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:24.908442 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.908325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92rsx\" (UniqueName: \"kubernetes.io/projected/96544e27-a5e2-441c-9a4e-00473d75ac63-kube-api-access-92rsx\") pod \"payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w\" (UID: \"96544e27-a5e2-441c-9a4e-00473d75ac63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:24.908442 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.908413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-plugins-config-volume\") pod \"payload-processing-e2e-ait-160e6699-667d78b548-x6fpq\" (UID: \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\") " pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:24.908570 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.908499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:24.908570 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.908525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhmwg\" (UniqueName: \"kubernetes.io/projected/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-kube-api-access-nhmwg\") pod \"payload-processing-e2e-ait-160e6699-667d78b548-x6fpq\" (UID: \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\") " pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:24.911652 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:24.911631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls\") pod \"maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:25.009614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.009339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhmwg\" (UniqueName: \"kubernetes.io/projected/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-kube-api-access-nhmwg\") pod \"payload-processing-e2e-ait-160e6699-667d78b548-x6fpq\" (UID: \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\") " pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:25.009614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.009408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96544e27-a5e2-441c-9a4e-00473d75ac63-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w\" (UID: \"96544e27-a5e2-441c-9a4e-00473d75ac63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:25.009614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.009450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92rsx\" (UniqueName: \"kubernetes.io/projected/96544e27-a5e2-441c-9a4e-00473d75ac63-kube-api-access-92rsx\") pod \"payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w\" (UID: \"96544e27-a5e2-441c-9a4e-00473d75ac63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:25.009614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.009528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-plugins-config-volume\") pod \"payload-processing-e2e-ait-160e6699-667d78b548-x6fpq\" (UID: \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\") " pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:25.010396 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.010368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96544e27-a5e2-441c-9a4e-00473d75ac63-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w\" (UID: \"96544e27-a5e2-441c-9a4e-00473d75ac63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:25.010522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.010403    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-plugins-config-volume\") pod \"payload-processing-e2e-ait-160e6699-667d78b548-x6fpq\" (UID: \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\") " pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:25.018933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.018887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhmwg\" (UniqueName: \"kubernetes.io/projected/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-kube-api-access-nhmwg\") pod \"payload-processing-e2e-ait-160e6699-667d78b548-x6fpq\" (UID: \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\") " pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:25.019702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.019679    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92rsx\" (UniqueName: \"kubernetes.io/projected/96544e27-a5e2-441c-9a4e-00473d75ac63-kube-api-access-92rsx\") pod \"payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w\" (UID: \"96544e27-a5e2-441c-9a4e-00473d75ac63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:25.154687 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.154650    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:25.163196 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.163175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:25.205530 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.205492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:25.359688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.359655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"]
Aug 04 16:33:25.361987 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:33:25.361955    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91dc1b8c_384f_45cd_a0e0_8a5f9fed149e.slice/crio-70029a715ed14111c6bd6f8280c0a61a98e7dc0750beaff9e5a01df71d8c23f2 WatchSource:0}: Error finding container 70029a715ed14111c6bd6f8280c0a61a98e7dc0750beaff9e5a01df71d8c23f2: Status 404 returned error can't find the container with id 70029a715ed14111c6bd6f8280c0a61a98e7dc0750beaff9e5a01df71d8c23f2
Aug 04 16:33:25.416279 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.416251    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:33:25.514033 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.513950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-certs\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514033 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-socket\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514059    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pztjw\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-kube-api-access-pztjw\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514092    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-envoy\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-credential-socket\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514196    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-token\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514252    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:33:25.514475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514300    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istiod-ca-cert\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514331    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-podinfo\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514347    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:33:25.514668 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-data\") pod \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\" (UID: \"c2982df2-fc7a-42b7-ab0d-f71437b7cb32\") "
Aug 04 16:33:25.514944 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514738    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:33:25.514944 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.514830    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:33:25.515182 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.515031    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:33:25.515338 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.515244    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.515381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.515345    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.515381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.515359    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.516656 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.516634    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-kube-api-access-pztjw" (OuterVolumeSpecName: "kube-api-access-pztjw") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "kube-api-access-pztjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:33:25.517408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.517228    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:33:25.517408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.517372    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:33:25.519140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.519119    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2982df2-fc7a-42b7-ab0d-f71437b7cb32" (UID: "c2982df2-fc7a-42b7-ab0d-f71437b7cb32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:33:25.535830 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.535805    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"]
Aug 04 16:33:25.536545 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:33:25.536524    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96544e27_a5e2_441c_9a4e_00473d75ac63.slice/crio-8eb572bf39715b9f20f267ecea2727edb4747ece8536e9370af07b0358009bf7 WatchSource:0}: Error finding container 8eb572bf39715b9f20f267ecea2727edb4747ece8536e9370af07b0358009bf7: Status 404 returned error can't find the container with id 8eb572bf39715b9f20f267ecea2727edb4747ece8536e9370af07b0358009bf7
Aug 04 16:33:25.598601 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.598574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"]
Aug 04 16:33:25.600173 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:33:25.600142    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0253b0_51b9_4129_a16b_c60dbfb25d1c.slice/crio-60d6d14c1c347022d184e918e10d10fa95b11a5f4dc9f2d0a2dbb50cea1bad38 WatchSource:0}: Error finding container 60d6d14c1c347022d184e918e10d10fa95b11a5f4dc9f2d0a2dbb50cea1bad38: Status 404 returned error can't find the container with id 60d6d14c1c347022d184e918e10d10fa95b11a5f4dc9f2d0a2dbb50cea1bad38
Aug 04 16:33:25.616306 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.616278    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.616386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.616314    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pztjw\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-kube-api-access-pztjw\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.616386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.616330    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.616386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.616344    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.616386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.616358    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.616386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.616369    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2982df2-fc7a-42b7-ab0d-f71437b7cb32-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:25.664606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.664578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw" event={"ID":"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e","Type":"ContainerStarted","Data":"70029a715ed14111c6bd6f8280c0a61a98e7dc0750beaff9e5a01df71d8c23f2"}
Aug 04 16:33:25.666355 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.666322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq" event={"ID":"2b0253b0-51b9-4129-a16b-c60dbfb25d1c","Type":"ContainerStarted","Data":"a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266"}
Aug 04 16:33:25.666469 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.666375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq" event={"ID":"2b0253b0-51b9-4129-a16b-c60dbfb25d1c","Type":"ContainerStarted","Data":"60d6d14c1c347022d184e918e10d10fa95b11a5f4dc9f2d0a2dbb50cea1bad38"}
Aug 04 16:33:25.666542 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.666480    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:25.668277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.668254    2563 generic.go:356] "Generic (PLEG): container finished" podID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerID="c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64" exitCode=0
Aug 04 16:33:25.668368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.668307    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"
Aug 04 16:33:25.668368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.668335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" event={"ID":"c2982df2-fc7a-42b7-ab0d-f71437b7cb32","Type":"ContainerDied","Data":"c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64"}
Aug 04 16:33:25.668473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.668375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk" event={"ID":"c2982df2-fc7a-42b7-ab0d-f71437b7cb32","Type":"ContainerDied","Data":"3a169c50c85a65f0182b1ee0b9c6dfbcd86ab72e54f3b92e6e6e1e52420c1b07"}
Aug 04 16:33:25.668473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.668399    2563 scope.go:117] "RemoveContainer" containerID="c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64"
Aug 04 16:33:25.670191 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.670169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w" event={"ID":"96544e27-a5e2-441c-9a4e-00473d75ac63","Type":"ContainerStarted","Data":"ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc"}
Aug 04 16:33:25.670312 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.670210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w" event={"ID":"96544e27-a5e2-441c-9a4e-00473d75ac63","Type":"ContainerStarted","Data":"8eb572bf39715b9f20f267ecea2727edb4747ece8536e9370af07b0358009bf7"}
Aug 04 16:33:25.670379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.670364    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:25.679297 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.679278    2563 scope.go:117] "RemoveContainer" containerID="1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496"
Aug 04 16:33:25.684120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.684072    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq" podStartSLOduration=1.684053628 podStartE2EDuration="1.684053628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:33:25.683166038 +0000 UTC m=+1886.509863525" watchObservedRunningTime="2026-08-04 16:33:25.684053628 +0000 UTC m=+1886.510751101"
Aug 04 16:33:25.689817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.689795    2563 scope.go:117] "RemoveContainer" containerID="c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64"
Aug 04 16:33:25.690168 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:25.690147    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64\": container with ID starting with c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64 not found: ID does not exist" containerID="c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64"
Aug 04 16:33:25.690252 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.690176    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64"} err="failed to get container status \"c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64\": rpc error: code = NotFound desc = could not find container \"c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64\": container with ID starting with c864c08ddea5dc26ce463ab57e6af2c77d4d2f893f27109af291bac4744f7a64 not found: ID does not exist"
Aug 04 16:33:25.690252 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.690194    2563 scope.go:117] "RemoveContainer" containerID="1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496"
Aug 04 16:33:25.690483 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:25.690457    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496\": container with ID starting with 1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496 not found: ID does not exist" containerID="1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496"
Aug 04 16:33:25.690549 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.690492    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496"} err="failed to get container status \"1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496\": rpc error: code = NotFound desc = could not find container \"1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496\": container with ID starting with 1bae100c7d87f507a9c9288ddd24a6e5dc3bc50fc66d2f4493021a7113ffb496 not found: ID does not exist"
Aug 04 16:33:25.701556 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.701516    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w" podStartSLOduration=1.701502197 podStartE2EDuration="1.701502197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:33:25.697826327 +0000 UTC m=+1886.524523801" watchObservedRunningTime="2026-08-04 16:33:25.701502197 +0000 UTC m=+1886.528199699"
Aug 04 16:33:25.720020 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.719993    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"]
Aug 04 16:33:25.721378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:25.721354    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-57d47eb1-gw-openshift-default-5d8d8958d8-msjjk"]
Aug 04 16:33:26.678672 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:26.678622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw" event={"ID":"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e","Type":"ContainerStarted","Data":"c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398"}
Aug 04 16:33:26.698919 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:26.698850    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw" podStartSLOduration=2.26441864 podStartE2EDuration="2.698830421s" totalImagesPullingTime="434.411781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:33:26.695632524 +0000 UTC m=+1887.522329996" watchObservedRunningTime="2026-08-04 16:33:26.698830421 +0000 UTC m=+1887.525527896"
Aug 04 16:33:27.620587 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:27.620546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:27.685542 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:27.685512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:27.719404 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:27.719368    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" path="/var/lib/kubelet/pods/c2982df2-fc7a-42b7-ab0d-f71437b7cb32/volumes"
Aug 04 16:33:33.701776 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:33.701742    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:36.681179 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:36.681146    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:36.681615 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:36.681233    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:37.662791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:37.662232    2563 patch_prober.go:28] interesting pod/e2e-ait-160e6699-openshift-default-656db678f6-lghnk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:51500->10.134.0.56:15021: read: connection reset by peer" start-of-body=
Aug 04 16:33:37.662791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:37.662301    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:51500->10.134.0.56:15021: read: connection reset by peer"
Aug 04 16:33:37.757352 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:37.757320    2563 generic.go:356] "Generic (PLEG): container finished" podID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerID="e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874" exitCode=0
Aug 04 16:33:37.757725 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:37.757378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" event={"ID":"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca","Type":"ContainerDied","Data":"e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874"}
Aug 04 16:33:37.757773 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:37.757763    2563 scope.go:117] "RemoveContainer" containerID="e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874"
Aug 04 16:33:37.758896 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:37.758864    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:37.759013 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:37.758991    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:37.759057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:37.759044    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:38.765083 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:38.765048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" event={"ID":"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca","Type":"ContainerStarted","Data":"4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab"}
Aug 04 16:33:39.249541 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:39.249504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:39.249800 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:39.249778    2563 patch_prober.go:28] interesting pod/e2e-ait-160e6699-openshift-default-656db678f6-lghnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 16:33:39.249866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:39.249845    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 16:33:40.250068 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:40.250033    2563 patch_prober.go:28] interesting pod/e2e-ait-160e6699-openshift-default-656db678f6-lghnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 16:33:40.250482 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:40.250089    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 16:33:41.250405 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:41.250369    2563 patch_prober.go:28] interesting pod/e2e-ait-160e6699-openshift-default-656db678f6-lghnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 16:33:41.250821 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:41.250422    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 16:33:42.250211 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:42.250174    2563 patch_prober.go:28] interesting pod/e2e-ait-160e6699-openshift-default-656db678f6-lghnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 16:33:42.250387 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:42.250233    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 16:33:43.250136 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:43.250100    2563 patch_prober.go:28] interesting pod/e2e-ait-160e6699-openshift-default-656db678f6-lghnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 16:33:43.250559 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:43.250160    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 16:33:44.250201 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:44.250163    2563 patch_prober.go:28] interesting pod/e2e-ait-160e6699-openshift-default-656db678f6-lghnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 16:33:44.250605 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:44.250234    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 16:33:45.252712 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:45.252684    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:45.253198 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:45.253160    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:45.253866 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:45.253849    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:33:54.761803 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.761769    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"]
Aug 04 16:33:54.762751 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.762702    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw" podUID="91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" containerName="maas-api" containerID="cri-o://c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398" gracePeriod=30
Aug 04 16:33:54.783868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.783837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:54.818272 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.818243    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"]
Aug 04 16:33:54.818499 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.818474    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq" podUID="2b0253b0-51b9-4129-a16b-c60dbfb25d1c" containerName="payload-processing" containerID="cri-o://a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266" gracePeriod=30
Aug 04 16:33:54.829297 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.829267    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"]
Aug 04 16:33:54.829597 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.829531    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w" podUID="96544e27-a5e2-441c-9a4e-00473d75ac63" containerName="payload-pre-processing" containerID="cri-o://ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc" gracePeriod=30
Aug 04 16:33:54.875023 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.874982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:54.947867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:54.947829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:55.013763 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.010007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:55.128124 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.128095    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:55.132161 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.132126    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:55.144824 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.144794    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:55.305639 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.305559    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhmwg\" (UniqueName: \"kubernetes.io/projected/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-kube-api-access-nhmwg\") pod \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\" (UID: \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\") "
Aug 04 16:33:55.305639 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.305604    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96544e27-a5e2-441c-9a4e-00473d75ac63-plugins-config-volume\") pod \"96544e27-a5e2-441c-9a4e-00473d75ac63\" (UID: \"96544e27-a5e2-441c-9a4e-00473d75ac63\") "
Aug 04 16:33:55.305853 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.305664    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdmfs\" (UniqueName: \"kubernetes.io/projected/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-kube-api-access-zdmfs\") pod \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") "
Aug 04 16:33:55.305853 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.305690    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls\") pod \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") "
Aug 04 16:33:55.305853 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.305733    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-openshift-service-ca\") pod \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\" (UID: \"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e\") "
Aug 04 16:33:55.305853 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.305768    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-plugins-config-volume\") pod \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\" (UID: \"2b0253b0-51b9-4129-a16b-c60dbfb25d1c\") "
Aug 04 16:33:55.305853 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.305827    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92rsx\" (UniqueName: \"kubernetes.io/projected/96544e27-a5e2-441c-9a4e-00473d75ac63-kube-api-access-92rsx\") pod \"96544e27-a5e2-441c-9a4e-00473d75ac63\" (UID: \"96544e27-a5e2-441c-9a4e-00473d75ac63\") "
Aug 04 16:33:55.306192 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.306156    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96544e27-a5e2-441c-9a4e-00473d75ac63-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96544e27-a5e2-441c-9a4e-00473d75ac63" (UID: "96544e27-a5e2-441c-9a4e-00473d75ac63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:33:55.306258 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.306193    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b0253b0-51b9-4129-a16b-c60dbfb25d1c" (UID: "2b0253b0-51b9-4129-a16b-c60dbfb25d1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:33:55.306258 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.306200    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" (UID: "91dc1b8c-384f-45cd-a0e0-8a5f9fed149e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:33:55.308077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.308044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" (UID: "91dc1b8c-384f-45cd-a0e0-8a5f9fed149e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:33:55.308077 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.308044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-kube-api-access-nhmwg" (OuterVolumeSpecName: "kube-api-access-nhmwg") pod "2b0253b0-51b9-4129-a16b-c60dbfb25d1c" (UID: "2b0253b0-51b9-4129-a16b-c60dbfb25d1c"). InnerVolumeSpecName "kube-api-access-nhmwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:33:55.308234 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.308139    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-kube-api-access-zdmfs" (OuterVolumeSpecName: "kube-api-access-zdmfs") pod "91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" (UID: "91dc1b8c-384f-45cd-a0e0-8a5f9fed149e"). InnerVolumeSpecName "kube-api-access-zdmfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:33:55.308279 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.308249    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96544e27-a5e2-441c-9a4e-00473d75ac63-kube-api-access-92rsx" (OuterVolumeSpecName: "kube-api-access-92rsx") pod "96544e27-a5e2-441c-9a4e-00473d75ac63" (UID: "96544e27-a5e2-441c-9a4e-00473d75ac63"). InnerVolumeSpecName "kube-api-access-92rsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:33:55.407441 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.407405    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdmfs\" (UniqueName: \"kubernetes.io/projected/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-kube-api-access-zdmfs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:55.407441 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.407434    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:55.407441 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.407443    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:55.407654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.407452    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:55.407654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.407461    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92rsx\" (UniqueName: \"kubernetes.io/projected/96544e27-a5e2-441c-9a4e-00473d75ac63-kube-api-access-92rsx\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:55.407654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.407470    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhmwg\" (UniqueName: \"kubernetes.io/projected/2b0253b0-51b9-4129-a16b-c60dbfb25d1c-kube-api-access-nhmwg\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:55.407654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.407477    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96544e27-a5e2-441c-9a4e-00473d75ac63-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:33:55.879557 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.879519    2563 generic.go:356] "Generic (PLEG): container finished" podID="96544e27-a5e2-441c-9a4e-00473d75ac63" containerID="ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc" exitCode=0
Aug 04 16:33:55.880017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.879565    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"
Aug 04 16:33:55.880017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.879608    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w" event={"ID":"96544e27-a5e2-441c-9a4e-00473d75ac63","Type":"ContainerDied","Data":"ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc"}
Aug 04 16:33:55.880017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.879672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w" event={"ID":"96544e27-a5e2-441c-9a4e-00473d75ac63","Type":"ContainerDied","Data":"8eb572bf39715b9f20f267ecea2727edb4747ece8536e9370af07b0358009bf7"}
Aug 04 16:33:55.880017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.879702    2563 scope.go:117] "RemoveContainer" containerID="ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc"
Aug 04 16:33:55.881110 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.881061    2563 generic.go:356] "Generic (PLEG): container finished" podID="91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" containerID="c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398" exitCode=0
Aug 04 16:33:55.881173 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.881111    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"
Aug 04 16:33:55.881173 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.881145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw" event={"ID":"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e","Type":"ContainerDied","Data":"c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398"}
Aug 04 16:33:55.881301 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.881183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw" event={"ID":"91dc1b8c-384f-45cd-a0e0-8a5f9fed149e","Type":"ContainerDied","Data":"70029a715ed14111c6bd6f8280c0a61a98e7dc0750beaff9e5a01df71d8c23f2"}
Aug 04 16:33:55.882781 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.882758    2563 generic.go:356] "Generic (PLEG): container finished" podID="2b0253b0-51b9-4129-a16b-c60dbfb25d1c" containerID="a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266" exitCode=0
Aug 04 16:33:55.882948 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.882933    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"
Aug 04 16:33:55.883017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.882957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq" event={"ID":"2b0253b0-51b9-4129-a16b-c60dbfb25d1c","Type":"ContainerDied","Data":"a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266"}
Aug 04 16:33:55.883017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.882995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq" event={"ID":"2b0253b0-51b9-4129-a16b-c60dbfb25d1c","Type":"ContainerDied","Data":"60d6d14c1c347022d184e918e10d10fa95b11a5f4dc9f2d0a2dbb50cea1bad38"}
Aug 04 16:33:55.890372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.890352    2563 scope.go:117] "RemoveContainer" containerID="ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc"
Aug 04 16:33:55.890668 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:55.890650    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc\": container with ID starting with ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc not found: ID does not exist" containerID="ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc"
Aug 04 16:33:55.890737 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.890676    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc"} err="failed to get container status \"ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc\": rpc error: code = NotFound desc = could not find container \"ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc\": container with ID starting with ac217b0c2aff1a139a8f75312b502191df343914c4e42d2abb8e634f857161fc not found: ID does not exist"
Aug 04 16:33:55.890737 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.890693    2563 scope.go:117] "RemoveContainer" containerID="c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398"
Aug 04 16:33:55.898043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.898022    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"]
Aug 04 16:33:55.898954 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.898939    2563 scope.go:117] "RemoveContainer" containerID="c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398"
Aug 04 16:33:55.899179 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:55.899162    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398\": container with ID starting with c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398 not found: ID does not exist" containerID="c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398"
Aug 04 16:33:55.899229 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.899187    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398"} err="failed to get container status \"c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398\": rpc error: code = NotFound desc = could not find container \"c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398\": container with ID starting with c68bc4612137c3392c7fa7c2c8181ff02ab1eb00f6ffa41f197f1d646b5cd398 not found: ID does not exist"
Aug 04 16:33:55.899229 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.899202    2563 scope.go:117] "RemoveContainer" containerID="a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266"
Aug 04 16:33:55.904168 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.904150    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-160e6699-68dc54bbc6-4f66w"]
Aug 04 16:33:55.907747 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.907724    2563 scope.go:117] "RemoveContainer" containerID="a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266"
Aug 04 16:33:55.908005 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:33:55.907988    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266\": container with ID starting with a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266 not found: ID does not exist" containerID="a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266"
Aug 04 16:33:55.908057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.908012    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266"} err="failed to get container status \"a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266\": rpc error: code = NotFound desc = could not find container \"a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266\": container with ID starting with a3ba59b30f642173d3272ffd391b1605b17d1e4482a9819758eb3395b88b2266 not found: ID does not exist"
Aug 04 16:33:55.916413 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.916390    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"]
Aug 04 16:33:55.922727 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.922709    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-160e6699-6dc59c6678-2n2gw"]
Aug 04 16:33:55.932128 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.932110    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"]
Aug 04 16:33:55.936284 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:55.936263    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-160e6699-667d78b548-x6fpq"]
Aug 04 16:33:56.253281 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:56.253250    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"]
Aug 04 16:33:56.253524 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:56.253497    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" containerID="cri-o://4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab" gracePeriod=30
Aug 04 16:33:56.277432 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:56.277392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:56.526756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:56.526671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:56.766881 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:56.766849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:57.071682 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.071647    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"]
Aug 04 16:33:57.072543 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072520    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy"
Aug 04 16:33:57.072543 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072542    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072557    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96544e27-a5e2-441c-9a4e-00473d75ac63" containerName="payload-pre-processing"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072564    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="96544e27-a5e2-441c-9a4e-00473d75ac63" containerName="payload-pre-processing"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072574    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072581    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072588    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0253b0-51b9-4129-a16b-c60dbfb25d1c" containerName="payload-processing"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072593    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0253b0-51b9-4129-a16b-c60dbfb25d1c" containerName="payload-processing"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072607    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" containerName="maas-api"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072611    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" containerName="maas-api"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072669    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="96544e27-a5e2-441c-9a4e-00473d75ac63" containerName="payload-pre-processing"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072678    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" containerName="maas-api"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072687    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072693    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2982df2-fc7a-42b7-ab0d-f71437b7cb32" containerName="istio-proxy"
Aug 04 16:33:57.072698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.072699    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b0253b0-51b9-4129-a16b-c60dbfb25d1c" containerName="payload-processing"
Aug 04 16:33:57.077783 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.077760    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.079876 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.079850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-75b82354-openshift-default-dockercfg-r959j\""
Aug 04 16:33:57.088663 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.088637    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"]
Aug 04 16:33:57.101473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.101404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:57.223848 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.223820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-certs\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.224036 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.223856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-token\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.224036 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.223877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-data\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.224036 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.223896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-podinfo\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.224036 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.223985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqsfg\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-kube-api-access-hqsfg\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.224181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.224045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-credential-socket\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.224181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.224076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed14ee-5a75-4eab-bff7-e6955e13221a-istiod-ca-cert\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.224181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.224120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-envoy\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.224181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.224172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-socket\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.325715 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.325626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-envoy\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.325715 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.325670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-socket\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.325980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.325803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-certs\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.325980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.325846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-token\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.325980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.325877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-data\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.325980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.325937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-podinfo\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.325980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.325969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqsfg\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-kube-api-access-hqsfg\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.326248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.326063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-socket\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.326248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.326156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-certs\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.326248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.326222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-credential-socket\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.326401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.326255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-data\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.326401 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.326263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed14ee-5a75-4eab-bff7-e6955e13221a-istiod-ca-cert\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.326670 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.326476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-credential-socket\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.326781 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.326760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed14ee-5a75-4eab-bff7-e6955e13221a-istiod-ca-cert\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.328166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.328140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-envoy\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.328380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.328361    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-podinfo\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.333408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.333380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-token\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.333512 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.333434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqsfg\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-kube-api-access-hqsfg\") pod \"e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") " pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.387504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.387471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:57.391006 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.390985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:57.537408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.537373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"]
Aug 04 16:33:57.538569 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:33:57.538547    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ed14ee_5a75_4eab_bff7_e6955e13221a.slice/crio-c1dffb62e2cba5cfd25676b1348e39c2ce271d86c91d9c35932af487d3ca350e WatchSource:0}: Error finding container c1dffb62e2cba5cfd25676b1348e39c2ce271d86c91d9c35932af487d3ca350e: Status 404 returned error can't find the container with id c1dffb62e2cba5cfd25676b1348e39c2ce271d86c91d9c35932af487d3ca350e
Aug 04 16:33:57.540713 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.540685    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:57.540771 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.540748    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:57.540807 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.540774    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:33:57.720723 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.720684    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0253b0-51b9-4129-a16b-c60dbfb25d1c" path="/var/lib/kubelet/pods/2b0253b0-51b9-4129-a16b-c60dbfb25d1c/volumes"
Aug 04 16:33:57.721298 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.721281    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91dc1b8c-384f-45cd-a0e0-8a5f9fed149e" path="/var/lib/kubelet/pods/91dc1b8c-384f-45cd-a0e0-8a5f9fed149e/volumes"
Aug 04 16:33:57.721753 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.721737    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96544e27-a5e2-441c-9a4e-00473d75ac63" path="/var/lib/kubelet/pods/96544e27-a5e2-441c-9a4e-00473d75ac63/volumes"
Aug 04 16:33:57.903868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.901560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj" event={"ID":"09ed14ee-5a75-4eab-bff7-e6955e13221a","Type":"ContainerStarted","Data":"0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70"}
Aug 04 16:33:57.903868 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.901627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj" event={"ID":"09ed14ee-5a75-4eab-bff7-e6955e13221a","Type":"ContainerStarted","Data":"c1dffb62e2cba5cfd25676b1348e39c2ce271d86c91d9c35932af487d3ca350e"}
Aug 04 16:33:57.926179 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:57.926042    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj" podStartSLOduration=0.926021906 podStartE2EDuration="926.021906ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:33:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:33:57.924990688 +0000 UTC m=+1918.751688154" watchObservedRunningTime="2026-08-04 16:33:57.926021906 +0000 UTC m=+1918.752719384"
Aug 04 16:33:58.391396 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:58.391359    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:58.396350 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:58.396328    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:58.908350 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:58.908321    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:58.909436 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:58.909412    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:33:59.288534 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:59.288495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:33:59.381921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:33:59.381878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:00.254995 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.254958    2563 patch_prober.go:28] interesting pod/e2e-ait-160e6699-openshift-default-656db678f6-lghnk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 16:34:00.255391 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.255034    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 16:34:00.397031 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.396997    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"]
Aug 04 16:34:00.401092 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.401076    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.403680 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.403655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-75b82354-serving-cert\""
Aug 04 16:34:00.411094 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.410998    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"]
Aug 04 16:34:00.441921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.441881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:00.544403 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.544323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:00.558320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.558293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kcdd\" (UniqueName: \"kubernetes.io/projected/604af4e4-433a-4fae-872c-47af344281b0-kube-api-access-7kcdd\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.558432 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.558331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604af4e4-433a-4fae-872c-47af344281b0-openshift-service-ca\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.558432 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.558396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604af4e4-433a-4fae-872c-47af344281b0-maas-api-tls\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.658959 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.658897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604af4e4-433a-4fae-872c-47af344281b0-maas-api-tls\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.659122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.659038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kcdd\" (UniqueName: \"kubernetes.io/projected/604af4e4-433a-4fae-872c-47af344281b0-kube-api-access-7kcdd\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.659122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.659077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604af4e4-433a-4fae-872c-47af344281b0-openshift-service-ca\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.659728 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.659705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604af4e4-433a-4fae-872c-47af344281b0-openshift-service-ca\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.661478 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.661456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604af4e4-433a-4fae-872c-47af344281b0-maas-api-tls\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.669732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.669709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kcdd\" (UniqueName: \"kubernetes.io/projected/604af4e4-433a-4fae-872c-47af344281b0-kube-api-access-7kcdd\") pod \"maas-api-e2e-derive-75b82354-756d74d78f-sfg2m\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.714993 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.714968    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:00.863891 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.863865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"]
Aug 04 16:34:00.865476 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:34:00.865447    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604af4e4_433a_4fae_872c_47af344281b0.slice/crio-a66895d8f391c6523f6316da2d319aaa580493ed7c9302a34722f411c7cb6b92 WatchSource:0}: Error finding container a66895d8f391c6523f6316da2d319aaa580493ed7c9302a34722f411c7cb6b92: Status 404 returned error can't find the container with id a66895d8f391c6523f6316da2d319aaa580493ed7c9302a34722f411c7cb6b92
Aug 04 16:34:00.920336 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.920271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m" event={"ID":"604af4e4-433a-4fae-872c-47af344281b0","Type":"ContainerStarted","Data":"a66895d8f391c6523f6316da2d319aaa580493ed7c9302a34722f411c7cb6b92"}
Aug 04 16:34:00.979395 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:00.979359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:01.073146 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.073055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:01.110614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.110583    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"]
Aug 04 16:34:01.115090 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.115065    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.117285 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.117266    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-75b82354\""
Aug 04 16:34:01.117403 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.117365    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-75b82354-dockercfg-ffxrc\""
Aug 04 16:34:01.125876 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.125850    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"]
Aug 04 16:34:01.165155 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.165130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9dh\" (UniqueName: \"kubernetes.io/projected/014ca803-89a9-485a-a215-8fc6e371604e-kube-api-access-mv9dh\") pod \"payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm\" (UID: \"014ca803-89a9-485a-a215-8fc6e371604e\") " pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.165283 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.165175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/014ca803-89a9-485a-a215-8fc6e371604e-plugins-config-volume\") pod \"payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm\" (UID: \"014ca803-89a9-485a-a215-8fc6e371604e\") " pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.170439 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.170411    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"]
Aug 04 16:34:01.173849 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.173830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.185235 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.185215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"]
Aug 04 16:34:01.265891 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.265861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fbdr\" (UniqueName: \"kubernetes.io/projected/8c59220b-584b-4a9c-8363-0a07ba5cd926-kube-api-access-9fbdr\") pod \"payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh\" (UID: \"8c59220b-584b-4a9c-8363-0a07ba5cd926\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.266314 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.265948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c59220b-584b-4a9c-8363-0a07ba5cd926-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh\" (UID: \"8c59220b-584b-4a9c-8363-0a07ba5cd926\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.266314 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.266031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9dh\" (UniqueName: \"kubernetes.io/projected/014ca803-89a9-485a-a215-8fc6e371604e-kube-api-access-mv9dh\") pod \"payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm\" (UID: \"014ca803-89a9-485a-a215-8fc6e371604e\") " pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.266314 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.266077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/014ca803-89a9-485a-a215-8fc6e371604e-plugins-config-volume\") pod \"payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm\" (UID: \"014ca803-89a9-485a-a215-8fc6e371604e\") " pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.266700 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.266675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/014ca803-89a9-485a-a215-8fc6e371604e-plugins-config-volume\") pod \"payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm\" (UID: \"014ca803-89a9-485a-a215-8fc6e371604e\") " pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.275282 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.275260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9dh\" (UniqueName: \"kubernetes.io/projected/014ca803-89a9-485a-a215-8fc6e371604e-kube-api-access-mv9dh\") pod \"payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm\" (UID: \"014ca803-89a9-485a-a215-8fc6e371604e\") " pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.367365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.367201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fbdr\" (UniqueName: \"kubernetes.io/projected/8c59220b-584b-4a9c-8363-0a07ba5cd926-kube-api-access-9fbdr\") pod \"payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh\" (UID: \"8c59220b-584b-4a9c-8363-0a07ba5cd926\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.367365 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.367252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c59220b-584b-4a9c-8363-0a07ba5cd926-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh\" (UID: \"8c59220b-584b-4a9c-8363-0a07ba5cd926\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.368092 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.368070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c59220b-584b-4a9c-8363-0a07ba5cd926-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh\" (UID: \"8c59220b-584b-4a9c-8363-0a07ba5cd926\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.377678 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.377653    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fbdr\" (UniqueName: \"kubernetes.io/projected/8c59220b-584b-4a9c-8363-0a07ba5cd926-kube-api-access-9fbdr\") pod \"payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh\" (UID: \"8c59220b-584b-4a9c-8363-0a07ba5cd926\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.427291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.427265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.484502 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.484473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.536857 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.536834    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:34:01.624559 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:34:01.624517    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod014ca803_89a9_485a_a215_8fc6e371604e.slice/crio-c274db1ade3c04b35a9d6c700522eb6014c177d215b424cf256128cb1cee40c7 WatchSource:0}: Error finding container c274db1ade3c04b35a9d6c700522eb6014c177d215b424cf256128cb1cee40c7: Status 404 returned error can't find the container with id c274db1ade3c04b35a9d6c700522eb6014c177d215b424cf256128cb1cee40c7
Aug 04 16:34:01.625082 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.625053    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"]
Aug 04 16:34:01.668498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.668471    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"]
Aug 04 16:34:01.669566 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:34:01.669542    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c59220b_584b_4a9c_8363_0a07ba5cd926.slice/crio-22cd47a5d8598edeaf82e5b384fe283a14a21a6eb4b2a8c046e4eab554d98621 WatchSource:0}: Error finding container 22cd47a5d8598edeaf82e5b384fe283a14a21a6eb4b2a8c046e4eab554d98621: Status 404 returned error can't find the container with id 22cd47a5d8598edeaf82e5b384fe283a14a21a6eb4b2a8c046e4eab554d98621
Aug 04 16:34:01.669791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.669773    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-token\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.669858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.669827    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-certs\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.669939 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.669860    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkpd8\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-kube-api-access-fkpd8\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.670002 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.669957    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-envoy\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.670002 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.669991    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-credential-socket\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.670100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670019    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-data\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.670100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670084    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istiod-ca-cert\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.670200 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670118    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-podinfo\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.670200 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670145    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-socket\") pod \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\" (UID: \"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca\") "
Aug 04 16:34:01.670351 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670309    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:01.670416 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:01.670556 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670514    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:01.670556 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670545    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:01.670849 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.670814    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:34:01.671209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.671174    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.671414 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.671388    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.671414 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.671412    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.671544 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.671426    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.671544 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.671464    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.672457 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.672431    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:34:01.672648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.672619    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-kube-api-access-fkpd8" (OuterVolumeSpecName: "kube-api-access-fkpd8") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "kube-api-access-fkpd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:34:01.672712 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.672657    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:01.673787 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.673751    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" (UID: "c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:34:01.772361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.772332    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.772361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.772363    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.772590 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.772377    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkpd8\" (UniqueName: \"kubernetes.io/projected/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-kube-api-access-fkpd8\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.772590 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.772391    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:01.928374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.928299    2563 generic.go:356] "Generic (PLEG): container finished" podID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerID="4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab" exitCode=0
Aug 04 16:34:01.928374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.928349    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"
Aug 04 16:34:01.928568 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.928387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" event={"ID":"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca","Type":"ContainerDied","Data":"4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab"}
Aug 04 16:34:01.928568 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.928441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk" event={"ID":"c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca","Type":"ContainerDied","Data":"9155f84ca41baa36f104fea649df8d65bd6ac662fdf322e9b55b52ca9248028a"}
Aug 04 16:34:01.928568 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.928470    2563 scope.go:117] "RemoveContainer" containerID="4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab"
Aug 04 16:34:01.930204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.930177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm" event={"ID":"014ca803-89a9-485a-a215-8fc6e371604e","Type":"ContainerStarted","Data":"c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060"}
Aug 04 16:34:01.930313 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.930232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm" event={"ID":"014ca803-89a9-485a-a215-8fc6e371604e","Type":"ContainerStarted","Data":"c274db1ade3c04b35a9d6c700522eb6014c177d215b424cf256128cb1cee40c7"}
Aug 04 16:34:01.930313 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.930256    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:01.932241 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.932218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh" event={"ID":"8c59220b-584b-4a9c-8363-0a07ba5cd926","Type":"ContainerStarted","Data":"22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580"}
Aug 04 16:34:01.932348 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.932265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh" event={"ID":"8c59220b-584b-4a9c-8363-0a07ba5cd926","Type":"ContainerStarted","Data":"22cd47a5d8598edeaf82e5b384fe283a14a21a6eb4b2a8c046e4eab554d98621"}
Aug 04 16:34:01.932348 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.932296    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:01.933894 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.933869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m" event={"ID":"604af4e4-433a-4fae-872c-47af344281b0","Type":"ContainerStarted","Data":"63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98"}
Aug 04 16:34:01.934021 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.933939    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:01.938479 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.938465    2563 scope.go:117] "RemoveContainer" containerID="e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874"
Aug 04 16:34:01.946629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.946603    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"]
Aug 04 16:34:01.948787 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.948769    2563 scope.go:117] "RemoveContainer" containerID="4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab"
Aug 04 16:34:01.949093 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:34:01.949072    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab\": container with ID starting with 4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab not found: ID does not exist" containerID="4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab"
Aug 04 16:34:01.949148 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.949101    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab"} err="failed to get container status \"4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab\": rpc error: code = NotFound desc = could not find container \"4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab\": container with ID starting with 4b80c929d02b160b31db98d91506e13c7982fad0d59ee80aa9d8e5c8df54fbab not found: ID does not exist"
Aug 04 16:34:01.949148 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.949117    2563 scope.go:117] "RemoveContainer" containerID="e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874"
Aug 04 16:34:01.949278 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.949260    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-160e6699-openshift-default-656db678f6-lghnk"]
Aug 04 16:34:01.949368 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:34:01.949353    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874\": container with ID starting with e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874 not found: ID does not exist" containerID="e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874"
Aug 04 16:34:01.949408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.949376    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874"} err="failed to get container status \"e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874\": rpc error: code = NotFound desc = could not find container \"e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874\": container with ID starting with e709e5e8bb9c09c0d2eefaf4147b4d34b030b71d6f8d48c60b5037124cda8874 not found: ID does not exist"
Aug 04 16:34:01.964542 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:01.964501    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm" podStartSLOduration=0.964489241 podStartE2EDuration="964.489241ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:34:01.963643107 +0000 UTC m=+1922.790340578" watchObservedRunningTime="2026-08-04 16:34:01.964489241 +0000 UTC m=+1922.791186712"
Aug 04 16:34:02.005529 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:02.005482    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh" podStartSLOduration=1.005469473 podStartE2EDuration="1.005469473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:34:02.002740702 +0000 UTC m=+1922.829438186" watchObservedRunningTime="2026-08-04 16:34:02.005469473 +0000 UTC m=+1922.832166944"
Aug 04 16:34:02.024132 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:02.024088    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m" podStartSLOduration=1.616760403 podStartE2EDuration="2.024075211s" totalImagesPullingTime="407.314808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:34:02.022485148 +0000 UTC m=+1922.849182621" watchObservedRunningTime="2026-08-04 16:34:02.024075211 +0000 UTC m=+1922.850772724"
Aug 04 16:34:03.718400 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:03.718366    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" path="/var/lib/kubelet/pods/c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca/volumes"
Aug 04 16:34:07.947359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:07.947324    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:12.943631 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:12.943599    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:12.944007 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:12.943671    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:31.048971 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.048938    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"]
Aug 04 16:34:31.049581 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.049149    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m" podUID="604af4e4-433a-4fae-872c-47af344281b0" containerName="maas-api" containerID="cri-o://63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98" gracePeriod=30
Aug 04 16:34:31.085128 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.085099    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:31.112759 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.112731    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"]
Aug 04 16:34:31.113205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.112986    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm" podUID="014ca803-89a9-485a-a215-8fc6e371604e" containerName="payload-processing" containerID="cri-o://c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060" gracePeriod=30
Aug 04 16:34:31.122386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.121390    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"]
Aug 04 16:34:31.123014 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.122810    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh" podUID="8c59220b-584b-4a9c-8363-0a07ba5cd926" containerName="payload-pre-processing" containerID="cri-o://22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580" gracePeriod=30
Aug 04 16:34:31.392662 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.392630    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:31.421378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.421344    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:31.425889 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.425857    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"]
Aug 04 16:34:31.426105 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.426077    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj" podUID="09ed14ee-5a75-4eab-bff7-e6955e13221a" containerName="istio-proxy" containerID="cri-o://0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70" gracePeriod=30
Aug 04 16:34:31.483478 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.483201    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:31.562572 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.562539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kcdd\" (UniqueName: \"kubernetes.io/projected/604af4e4-433a-4fae-872c-47af344281b0-kube-api-access-7kcdd\") pod \"604af4e4-433a-4fae-872c-47af344281b0\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") "
Aug 04 16:34:31.562572 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.562577    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604af4e4-433a-4fae-872c-47af344281b0-openshift-service-ca\") pod \"604af4e4-433a-4fae-872c-47af344281b0\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") "
Aug 04 16:34:31.562821 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.562611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/014ca803-89a9-485a-a215-8fc6e371604e-plugins-config-volume\") pod \"014ca803-89a9-485a-a215-8fc6e371604e\" (UID: \"014ca803-89a9-485a-a215-8fc6e371604e\") "
Aug 04 16:34:31.562821 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.562692    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604af4e4-433a-4fae-872c-47af344281b0-maas-api-tls\") pod \"604af4e4-433a-4fae-872c-47af344281b0\" (UID: \"604af4e4-433a-4fae-872c-47af344281b0\") "
Aug 04 16:34:31.562821 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.562813    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv9dh\" (UniqueName: \"kubernetes.io/projected/014ca803-89a9-485a-a215-8fc6e371604e-kube-api-access-mv9dh\") pod \"014ca803-89a9-485a-a215-8fc6e371604e\" (UID: \"014ca803-89a9-485a-a215-8fc6e371604e\") "
Aug 04 16:34:31.563024 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.562988    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604af4e4-433a-4fae-872c-47af344281b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "604af4e4-433a-4fae-872c-47af344281b0" (UID: "604af4e4-433a-4fae-872c-47af344281b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:34:31.563086 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.563045    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/014ca803-89a9-485a-a215-8fc6e371604e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "014ca803-89a9-485a-a215-8fc6e371604e" (UID: "014ca803-89a9-485a-a215-8fc6e371604e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:34:31.563259 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.563223    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/604af4e4-433a-4fae-872c-47af344281b0-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:31.563259 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.563244    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/014ca803-89a9-485a-a215-8fc6e371604e-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:31.564940 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.564898    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604af4e4-433a-4fae-872c-47af344281b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "604af4e4-433a-4fae-872c-47af344281b0" (UID: "604af4e4-433a-4fae-872c-47af344281b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:34:31.565020 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.564988    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604af4e4-433a-4fae-872c-47af344281b0-kube-api-access-7kcdd" (OuterVolumeSpecName: "kube-api-access-7kcdd") pod "604af4e4-433a-4fae-872c-47af344281b0" (UID: "604af4e4-433a-4fae-872c-47af344281b0"). InnerVolumeSpecName "kube-api-access-7kcdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:34:31.565065 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.565017    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/014ca803-89a9-485a-a215-8fc6e371604e-kube-api-access-mv9dh" (OuterVolumeSpecName: "kube-api-access-mv9dh") pod "014ca803-89a9-485a-a215-8fc6e371604e" (UID: "014ca803-89a9-485a-a215-8fc6e371604e"). InnerVolumeSpecName "kube-api-access-mv9dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:34:31.663832 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.663754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fbdr\" (UniqueName: \"kubernetes.io/projected/8c59220b-584b-4a9c-8363-0a07ba5cd926-kube-api-access-9fbdr\") pod \"8c59220b-584b-4a9c-8363-0a07ba5cd926\" (UID: \"8c59220b-584b-4a9c-8363-0a07ba5cd926\") "
Aug 04 16:34:31.663832 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.663832    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c59220b-584b-4a9c-8363-0a07ba5cd926-plugins-config-volume\") pod \"8c59220b-584b-4a9c-8363-0a07ba5cd926\" (UID: \"8c59220b-584b-4a9c-8363-0a07ba5cd926\") "
Aug 04 16:34:31.664109 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.664095    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/604af4e4-433a-4fae-872c-47af344281b0-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:31.664147 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.664115    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv9dh\" (UniqueName: \"kubernetes.io/projected/014ca803-89a9-485a-a215-8fc6e371604e-kube-api-access-mv9dh\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:31.664147 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.664132    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kcdd\" (UniqueName: \"kubernetes.io/projected/604af4e4-433a-4fae-872c-47af344281b0-kube-api-access-7kcdd\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:31.665204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.665181    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c59220b-584b-4a9c-8363-0a07ba5cd926-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8c59220b-584b-4a9c-8363-0a07ba5cd926" (UID: "8c59220b-584b-4a9c-8363-0a07ba5cd926"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:34:31.666056 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.666037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c59220b-584b-4a9c-8363-0a07ba5cd926-kube-api-access-9fbdr" (OuterVolumeSpecName: "kube-api-access-9fbdr") pod "8c59220b-584b-4a9c-8363-0a07ba5cd926" (UID: "8c59220b-584b-4a9c-8363-0a07ba5cd926"). InnerVolumeSpecName "kube-api-access-9fbdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:34:31.765193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.765167    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c59220b-584b-4a9c-8363-0a07ba5cd926-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:31.765193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:31.765192    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fbdr\" (UniqueName: \"kubernetes.io/projected/8c59220b-584b-4a9c-8363-0a07ba5cd926-kube-api-access-9fbdr\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:32.112547 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.112511    2563 generic.go:356] "Generic (PLEG): container finished" podID="014ca803-89a9-485a-a215-8fc6e371604e" containerID="c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060" exitCode=0
Aug 04 16:34:32.113089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.112561    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"
Aug 04 16:34:32.113089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.112587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm" event={"ID":"014ca803-89a9-485a-a215-8fc6e371604e","Type":"ContainerDied","Data":"c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060"}
Aug 04 16:34:32.113089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.112637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm" event={"ID":"014ca803-89a9-485a-a215-8fc6e371604e","Type":"ContainerDied","Data":"c274db1ade3c04b35a9d6c700522eb6014c177d215b424cf256128cb1cee40c7"}
Aug 04 16:34:32.113089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.112663    2563 scope.go:117] "RemoveContainer" containerID="c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060"
Aug 04 16:34:32.114057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.114040    2563 generic.go:356] "Generic (PLEG): container finished" podID="8c59220b-584b-4a9c-8363-0a07ba5cd926" containerID="22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580" exitCode=0
Aug 04 16:34:32.114150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.114100    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"
Aug 04 16:34:32.114150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.114117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh" event={"ID":"8c59220b-584b-4a9c-8363-0a07ba5cd926","Type":"ContainerDied","Data":"22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580"}
Aug 04 16:34:32.114277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.114153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh" event={"ID":"8c59220b-584b-4a9c-8363-0a07ba5cd926","Type":"ContainerDied","Data":"22cd47a5d8598edeaf82e5b384fe283a14a21a6eb4b2a8c046e4eab554d98621"}
Aug 04 16:34:32.115747 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.115722    2563 generic.go:356] "Generic (PLEG): container finished" podID="604af4e4-433a-4fae-872c-47af344281b0" containerID="63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98" exitCode=0
Aug 04 16:34:32.115867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.115757    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"
Aug 04 16:34:32.115867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.115809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m" event={"ID":"604af4e4-433a-4fae-872c-47af344281b0","Type":"ContainerDied","Data":"63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98"}
Aug 04 16:34:32.115867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.115851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m" event={"ID":"604af4e4-433a-4fae-872c-47af344281b0","Type":"ContainerDied","Data":"a66895d8f391c6523f6316da2d319aaa580493ed7c9302a34722f411c7cb6b92"}
Aug 04 16:34:32.122661 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.122645    2563 scope.go:117] "RemoveContainer" containerID="c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060"
Aug 04 16:34:32.122901 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:34:32.122883    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060\": container with ID starting with c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060 not found: ID does not exist" containerID="c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060"
Aug 04 16:34:32.122978 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.122944    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060"} err="failed to get container status \"c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060\": rpc error: code = NotFound desc = could not find container \"c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060\": container with ID starting with c99cabe9b5ed4ee82ce9db9c54d97a04750c1f3d3e3f2975fd13e0d775d53060 not found: ID does not exist"
Aug 04 16:34:32.122978 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.122964    2563 scope.go:117] "RemoveContainer" containerID="22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580"
Aug 04 16:34:32.131603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.131585    2563 scope.go:117] "RemoveContainer" containerID="22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580"
Aug 04 16:34:32.131847 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:34:32.131829    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580\": container with ID starting with 22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580 not found: ID does not exist" containerID="22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580"
Aug 04 16:34:32.131890 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.131854    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580"} err="failed to get container status \"22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580\": rpc error: code = NotFound desc = could not find container \"22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580\": container with ID starting with 22fe2640edd639ee63a8de154be1277c58cadb7c21d11ac4494d398ad425f580 not found: ID does not exist"
Aug 04 16:34:32.131890 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.131873    2563 scope.go:117] "RemoveContainer" containerID="63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98"
Aug 04 16:34:32.139993 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.139971    2563 scope.go:117] "RemoveContainer" containerID="63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98"
Aug 04 16:34:32.140283 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:34:32.140263    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98\": container with ID starting with 63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98 not found: ID does not exist" containerID="63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98"
Aug 04 16:34:32.140344 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.140291    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98"} err="failed to get container status \"63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98\": rpc error: code = NotFound desc = could not find container \"63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98\": container with ID starting with 63c5d3e9b9170c560105f40912564f1c37885c5ef782a21ee9597a317c0ddb98 not found: ID does not exist"
Aug 04 16:34:32.147547 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.144329    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"]
Aug 04 16:34:32.150443 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.150421    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75b82354-756d74d78f-sfg2m"]
Aug 04 16:34:32.161214 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.161191    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"]
Aug 04 16:34:32.172762 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.172744    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b82354-567c8c896b-fqvgm"]
Aug 04 16:34:32.189064 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.189026    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"]
Aug 04 16:34:32.201732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:32.201692    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b82354-f8f78df96-rpclh"]
Aug 04 16:34:33.719232 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:33.719198    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="014ca803-89a9-485a-a215-8fc6e371604e" path="/var/lib/kubelet/pods/014ca803-89a9-485a-a215-8fc6e371604e/volumes"
Aug 04 16:34:33.719603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:33.719571    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604af4e4-433a-4fae-872c-47af344281b0" path="/var/lib/kubelet/pods/604af4e4-433a-4fae-872c-47af344281b0/volumes"
Aug 04 16:34:33.719879 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:33.719865    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c59220b-584b-4a9c-8363-0a07ba5cd926" path="/var/lib/kubelet/pods/8c59220b-584b-4a9c-8363-0a07ba5cd926/volumes"
Aug 04 16:34:35.848601 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:35.848547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:39.897472 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.897410    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:34:39.940892 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.940862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed14ee-5a75-4eab-bff7-e6955e13221a-istiod-ca-cert\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941061 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.940899    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-socket\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941061 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.940963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-credential-socket\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941061 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.940983    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-envoy\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941061 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-podinfo\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941061 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941063    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-data\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941322 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-token\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941322 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941134    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqsfg\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-kube-api-access-hqsfg\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941322 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941168    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-certs\") pod \"09ed14ee-5a75-4eab-bff7-e6955e13221a\" (UID: \"09ed14ee-5a75-4eab-bff7-e6955e13221a\") "
Aug 04 16:34:39.941322 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941210    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:39.941322 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941292    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:39.941592 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941329    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ed14ee-5a75-4eab-bff7-e6955e13221a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:34:39.941592 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941544    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed14ee-5a75-4eab-bff7-e6955e13221a-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:39.941592 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941565    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:39.941592 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941580    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:39.941592 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941545    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:39.941858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.941558    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-data" (OuterVolumeSpecName: "istio-data") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:39.943451 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.943422    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-token" (OuterVolumeSpecName: "istio-token") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:34:39.943803 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.943775    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:34:39.944085 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.944063    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-kube-api-access-hqsfg" (OuterVolumeSpecName: "kube-api-access-hqsfg") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "kube-api-access-hqsfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:34:39.944156 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:39.944123    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09ed14ee-5a75-4eab-bff7-e6955e13221a" (UID: "09ed14ee-5a75-4eab-bff7-e6955e13221a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:34:40.042120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.042090    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:40.042120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.042115    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:40.042120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.042124    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqsfg\" (UniqueName: \"kubernetes.io/projected/09ed14ee-5a75-4eab-bff7-e6955e13221a-kube-api-access-hqsfg\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:40.042335 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.042134    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:40.042335 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.042142    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:40.042335 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.042149    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed14ee-5a75-4eab-bff7-e6955e13221a-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:34:40.167522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.167483    2563 generic.go:356] "Generic (PLEG): container finished" podID="09ed14ee-5a75-4eab-bff7-e6955e13221a" containerID="0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70" exitCode=0
Aug 04 16:34:40.167704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.167534    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"
Aug 04 16:34:40.167704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.167582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj" event={"ID":"09ed14ee-5a75-4eab-bff7-e6955e13221a","Type":"ContainerDied","Data":"0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70"}
Aug 04 16:34:40.167704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.167649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj" event={"ID":"09ed14ee-5a75-4eab-bff7-e6955e13221a","Type":"ContainerDied","Data":"c1dffb62e2cba5cfd25676b1348e39c2ce271d86c91d9c35932af487d3ca350e"}
Aug 04 16:34:40.167704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.167679    2563 scope.go:117] "RemoveContainer" containerID="0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70"
Aug 04 16:34:40.177864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.177845    2563 scope.go:117] "RemoveContainer" containerID="0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70"
Aug 04 16:34:40.178150 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:34:40.178131    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70\": container with ID starting with 0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70 not found: ID does not exist" containerID="0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70"
Aug 04 16:34:40.178206 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.178160    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70"} err="failed to get container status \"0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70\": rpc error: code = NotFound desc = could not find container \"0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70\": container with ID starting with 0531576b9f776ebdd48d2b6d1e8279ee344e1155f272dc43ad672538bde3df70 not found: ID does not exist"
Aug 04 16:34:40.189291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.189263    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"]
Aug 04 16:34:40.193499 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:40.193476    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-75b82354-openshift-default-5dd668b5b4-b9jpj"]
Aug 04 16:34:41.724919 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:41.724879    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ed14ee-5a75-4eab-bff7-e6955e13221a" path="/var/lib/kubelet/pods/09ed14ee-5a75-4eab-bff7-e6955e13221a/volumes"
Aug 04 16:34:43.707236 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:43.707204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:44.657827 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:44.657789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:51.079795 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:51.079701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:51.179321 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:51.179283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:51.279450 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:51.279412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:51.382707 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:51.382612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:51.479682 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:51.479648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:34:51.932941 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:34:51.932895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:17.953671 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:17.953626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:23.832599 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:23.832564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:23.897800 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:23.897758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:23.967975 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:23.967938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:24.066436 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:24.066403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:40.014257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:40.014209    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:45.927083 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:45.927045    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:46.267188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:46.267152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:46.802965 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:46.802931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:56.703151 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:56.703110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:58.383707 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:58.383672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:35:58.483741 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:35:58.483709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:05.792271 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:05.792228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:05.851537 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:05.851498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:07.825611 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:07.825573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:14.589407 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:14.589338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:14.741754 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:14.741721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:15.263940 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:15.263887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:15.361955 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:15.361899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:15.915206 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:15.915170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:17.099303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:17.099270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:23.289982 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:23.289862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:23.378083 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:23.378048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:24.028037 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:24.028002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:30.247846 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:30.247810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:30.420273 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:30.420234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:30.519989 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:30.519891    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:30.638720 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:30.638693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:31.029520 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029485    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"]
Aug 04 16:36:31.029890 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029877    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy"
Aug 04 16:36:31.029958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029891    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy"
Aug 04 16:36:31.029958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029922    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="604af4e4-433a-4fae-872c-47af344281b0" containerName="maas-api"
Aug 04 16:36:31.029958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029929    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="604af4e4-433a-4fae-872c-47af344281b0" containerName="maas-api"
Aug 04 16:36:31.029958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029938    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy"
Aug 04 16:36:31.029958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029944    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy"
Aug 04 16:36:31.029958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029950    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="014ca803-89a9-485a-a215-8fc6e371604e" containerName="payload-processing"
Aug 04 16:36:31.029958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029957    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="014ca803-89a9-485a-a215-8fc6e371604e" containerName="payload-processing"
Aug 04 16:36:31.029958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029962    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c59220b-584b-4a9c-8363-0a07ba5cd926" containerName="payload-pre-processing"
Aug 04 16:36:31.030257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029967    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c59220b-584b-4a9c-8363-0a07ba5cd926" containerName="payload-pre-processing"
Aug 04 16:36:31.030257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029986    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ed14ee-5a75-4eab-bff7-e6955e13221a" containerName="istio-proxy"
Aug 04 16:36:31.030257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.029991    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ed14ee-5a75-4eab-bff7-e6955e13221a" containerName="istio-proxy"
Aug 04 16:36:31.030257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.030048    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c59220b-584b-4a9c-8363-0a07ba5cd926" containerName="payload-pre-processing"
Aug 04 16:36:31.030257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.030054    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy"
Aug 04 16:36:31.030257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.030065    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="014ca803-89a9-485a-a215-8fc6e371604e" containerName="payload-processing"
Aug 04 16:36:31.030257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.030074    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ed14ee-5a75-4eab-bff7-e6955e13221a" containerName="istio-proxy"
Aug 04 16:36:31.030257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.030083    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="604af4e4-433a-4fae-872c-47af344281b0" containerName="maas-api"
Aug 04 16:36:31.032919 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.032889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.035213 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.035192    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9f3e00e1-openshift-default-dockercfg-qw6vj\""
Aug 04 16:36:31.048250 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.048226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:31.054180 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.054159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"]
Aug 04 16:36:31.085641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-podinfo\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.085796 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-envoy\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.085796 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-token\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.085796 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istiod-ca-cert\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.085796 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-certs\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.086070 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxln8\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-kube-api-access-rxln8\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.086070 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-credential-socket\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.086070 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-socket\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.086070 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.085881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-data\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187075 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-envoy\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187075 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-token\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istiod-ca-cert\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-certs\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxln8\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-kube-api-access-rxln8\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-credential-socket\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-socket\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-data\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-podinfo\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187678 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-certs\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187764 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187741    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-data\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187825 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-socket\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.187825 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-credential-socket\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.188013 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.187992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istiod-ca-cert\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.189532 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.189507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-envoy\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.189841 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.189825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-podinfo\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.195375 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.195357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-token\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.195793 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.195771    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxln8\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-kube-api-access-rxln8\") pod \"e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") " pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.325029 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.324935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:31.343822 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.343797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:31.489603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.489574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"]
Aug 04 16:36:31.491321 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:36:31.491292    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a31a39_eca7_4ada_b24a_39cf6b961a70.slice/crio-159ac2efff7558ebacc0ae5a35177261e06ea8f70505bc62cc05cfb414c9a7e1 WatchSource:0}: Error finding container 159ac2efff7558ebacc0ae5a35177261e06ea8f70505bc62cc05cfb414c9a7e1: Status 404 returned error can't find the container with id 159ac2efff7558ebacc0ae5a35177261e06ea8f70505bc62cc05cfb414c9a7e1
Aug 04 16:36:31.493425 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.493377    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:36:31.493513 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.493478    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:36:31.493553 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.493525    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:36:31.793987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.793933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" event={"ID":"e1a31a39-eca7-4ada-b24a-39cf6b961a70","Type":"ContainerStarted","Data":"6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7"}
Aug 04 16:36:31.794176 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.793998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" event={"ID":"e1a31a39-eca7-4ada-b24a-39cf6b961a70","Type":"ContainerStarted","Data":"159ac2efff7558ebacc0ae5a35177261e06ea8f70505bc62cc05cfb414c9a7e1"}
Aug 04 16:36:31.817023 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:31.816967    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" podStartSLOduration=0.816951921 podStartE2EDuration="816.951921ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:36:31.814492136 +0000 UTC m=+2072.641189634" watchObservedRunningTime="2026-08-04 16:36:31.816951921 +0000 UTC m=+2072.643649392"
Aug 04 16:36:32.344721 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:32.344692    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:32.349691 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:32.349669    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:32.800199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:32.800171    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:32.801004 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:32.800988    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:33.956475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:33.956440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:34.056123 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:34.056093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:35.053358 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.053305    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"]
Aug 04 16:36:35.054218 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.054188    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c4ba98-c6f5-4c3f-8124-b9170e4bd9ca" containerName="istio-proxy"
Aug 04 16:36:35.057518 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.057501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.059541 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.059523    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9f3e00e1-serving-cert\""
Aug 04 16:36:35.069970 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.069949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"]
Aug 04 16:36:35.123268 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.123234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp86m\" (UniqueName: \"kubernetes.io/projected/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-kube-api-access-rp86m\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.123427 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.123279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-openshift-service-ca\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.123427 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.123409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-maas-api-tls\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.224545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.224511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp86m\" (UniqueName: \"kubernetes.io/projected/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-kube-api-access-rp86m\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.224731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.224551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-openshift-service-ca\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.224731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.224614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-maas-api-tls\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.225311 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.225286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-openshift-service-ca\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.227239 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.227219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-maas-api-tls\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.233336 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.233309    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp86m\" (UniqueName: \"kubernetes.io/projected/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-kube-api-access-rp86m\") pod \"maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.261341 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.261291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:35.362351 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.362265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:35.369387 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.369363    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:35.518238 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.518212    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"]
Aug 04 16:36:35.519636 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:36:35.519608    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05580431_3c4b_4ab5_9fda_cdfce5cdfb4f.slice/crio-0526fefaf2044c4e4616b745bb39f441ee265470bed686a856ef2b20b1f92057 WatchSource:0}: Error finding container 0526fefaf2044c4e4616b745bb39f441ee265470bed686a856ef2b20b1f92057: Status 404 returned error can't find the container with id 0526fefaf2044c4e4616b745bb39f441ee265470bed686a856ef2b20b1f92057
Aug 04 16:36:35.631877 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.631783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:35.720474 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.720447    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"]
Aug 04 16:36:35.721685 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.721643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:35.725040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.725023    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:35.727884 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.727853    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9f3e00e1\""
Aug 04 16:36:35.736834 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.736812    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"]
Aug 04 16:36:35.743715 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.743694    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"]
Aug 04 16:36:35.747076 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.747061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:35.751074 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.751056    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-9f3e00e1-dockercfg-qz8b5\""
Aug 04 16:36:35.764059 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.764038    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"]
Aug 04 16:36:35.819770 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.819740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f" event={"ID":"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f","Type":"ContainerStarted","Data":"0526fefaf2044c4e4616b745bb39f441ee265470bed686a856ef2b20b1f92057"}
Aug 04 16:36:35.831116 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.831088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdh6j\" (UniqueName: \"kubernetes.io/projected/85b85b7c-97f5-47bf-9990-9ce059b6540e-kube-api-access-gdh6j\") pod \"payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt\" (UID: \"85b85b7c-97f5-47bf-9990-9ce059b6540e\") " pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:35.831256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.831120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb\" (UID: \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:35.831256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.831191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85b85b7c-97f5-47bf-9990-9ce059b6540e-plugins-config-volume\") pod \"payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt\" (UID: \"85b85b7c-97f5-47bf-9990-9ce059b6540e\") " pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:35.831256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.831238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nwr6\" (UniqueName: \"kubernetes.io/projected/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-kube-api-access-6nwr6\") pod \"payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb\" (UID: \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:35.932715 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.932636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85b85b7c-97f5-47bf-9990-9ce059b6540e-plugins-config-volume\") pod \"payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt\" (UID: \"85b85b7c-97f5-47bf-9990-9ce059b6540e\") " pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:35.932715 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.932671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nwr6\" (UniqueName: \"kubernetes.io/projected/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-kube-api-access-6nwr6\") pod \"payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb\" (UID: \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:35.932898 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.932717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdh6j\" (UniqueName: \"kubernetes.io/projected/85b85b7c-97f5-47bf-9990-9ce059b6540e-kube-api-access-gdh6j\") pod \"payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt\" (UID: \"85b85b7c-97f5-47bf-9990-9ce059b6540e\") " pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:35.932898 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.932734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb\" (UID: \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:35.933465 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.933436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85b85b7c-97f5-47bf-9990-9ce059b6540e-plugins-config-volume\") pod \"payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt\" (UID: \"85b85b7c-97f5-47bf-9990-9ce059b6540e\") " pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:35.933560 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.933498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb\" (UID: \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:35.940479 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.940456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdh6j\" (UniqueName: \"kubernetes.io/projected/85b85b7c-97f5-47bf-9990-9ce059b6540e-kube-api-access-gdh6j\") pod \"payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt\" (UID: \"85b85b7c-97f5-47bf-9990-9ce059b6540e\") " pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:35.940562 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:35.940467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nwr6\" (UniqueName: \"kubernetes.io/projected/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-kube-api-access-6nwr6\") pod \"payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb\" (UID: \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:36.037107 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.037072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:36.057896 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.057869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:36.191253 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.191223    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"]
Aug 04 16:36:36.192464 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:36:36.192420    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50febf5d_0eab_492b_98c1_5e0a0fbfda3a.slice/crio-3de32af0d7d23b9698f435d8cfae75854c2e077c8a89aedde8640aa13819a38c WatchSource:0}: Error finding container 3de32af0d7d23b9698f435d8cfae75854c2e077c8a89aedde8640aa13819a38c: Status 404 returned error can't find the container with id 3de32af0d7d23b9698f435d8cfae75854c2e077c8a89aedde8640aa13819a38c
Aug 04 16:36:36.224892 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.224864    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"]
Aug 04 16:36:36.225314 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:36:36.225293    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b85b7c_97f5_47bf_9990_9ce059b6540e.slice/crio-7ca730d492c493f4e65d22a81b168231d6773c05b4e696b206da74262eb5c1a5 WatchSource:0}: Error finding container 7ca730d492c493f4e65d22a81b168231d6773c05b4e696b206da74262eb5c1a5: Status 404 returned error can't find the container with id 7ca730d492c493f4e65d22a81b168231d6773c05b4e696b206da74262eb5c1a5
Aug 04 16:36:36.826738 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.826703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt" event={"ID":"85b85b7c-97f5-47bf-9990-9ce059b6540e","Type":"ContainerStarted","Data":"e8bbaada557b4fe518331d8642c0581bcf5187473fc9fc40fce497048f4e5217"}
Aug 04 16:36:36.826950 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.826770    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:36.826950 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.826799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt" event={"ID":"85b85b7c-97f5-47bf-9990-9ce059b6540e","Type":"ContainerStarted","Data":"7ca730d492c493f4e65d22a81b168231d6773c05b4e696b206da74262eb5c1a5"}
Aug 04 16:36:36.828228 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.828201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb" event={"ID":"50febf5d-0eab-492b-98c1-5e0a0fbfda3a","Type":"ContainerStarted","Data":"a7023dd5b44aaf30123eda065a59ec4dad1a12ec562a080e4bcb1e5df0cc9f2b"}
Aug 04 16:36:36.828353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.828247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb" event={"ID":"50febf5d-0eab-492b-98c1-5e0a0fbfda3a","Type":"ContainerStarted","Data":"3de32af0d7d23b9698f435d8cfae75854c2e077c8a89aedde8640aa13819a38c"}
Aug 04 16:36:36.828353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.828283    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:36.845063 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.845017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt" podStartSLOduration=1.84500465 podStartE2EDuration="1.84500465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:36:36.842790324 +0000 UTC m=+2077.669487797" watchObservedRunningTime="2026-08-04 16:36:36.84500465 +0000 UTC m=+2077.671702123"
Aug 04 16:36:36.863572 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:36.863534    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb" podStartSLOduration=1.863520913 podStartE2EDuration="1.863520913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:36:36.862473455 +0000 UTC m=+2077.689170926" watchObservedRunningTime="2026-08-04 16:36:36.863520913 +0000 UTC m=+2077.690218384"
Aug 04 16:36:38.841336 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:38.841303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f" event={"ID":"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f","Type":"ContainerStarted","Data":"285f78f4573f360185c23679499d6c9a7d2ba2161155aa324d70b9e697fff9b1"}
Aug 04 16:36:38.841739 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:38.841435    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:38.859684 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:38.859636    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f" podStartSLOduration=1.5564452979999999 podStartE2EDuration="3.859621666s" totalImagesPullingTime="2.303176368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:36:38.858099313 +0000 UTC m=+2079.684796798" watchObservedRunningTime="2026-08-04 16:36:38.859621666 +0000 UTC m=+2079.686319137"
Aug 04 16:36:44.853959 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:44.853921    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:36:46.889362 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:46.889332    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerID="6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7" exitCode=0
Aug 04 16:36:46.889817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:46.889418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" event={"ID":"e1a31a39-eca7-4ada-b24a-39cf6b961a70","Type":"ContainerDied","Data":"6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7"}
Aug 04 16:36:46.889964 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:46.889947    2563 scope.go:117] "RemoveContainer" containerID="6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7"
Aug 04 16:36:46.890958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:46.890927    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:36:46.891056 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:46.891022    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:36:46.891118 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:46.891071    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:36:47.800816 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:47.800771    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:47.836767 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:47.836738    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:36:47.836970 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:47.836926    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:36:47.913810 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:47.913777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" event={"ID":"e1a31a39-eca7-4ada-b24a-39cf6b961a70","Type":"ContainerStarted","Data":"5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a"}
Aug 04 16:36:48.344767 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:48.344734    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:48.345926 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:48.345889    2563 patch_prober.go:28] interesting pod/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 16:36:48.345983 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:48.345965    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 16:36:49.344363 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:49.344327    2563 patch_prober.go:28] interesting pod/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 16:36:49.344746 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:49.344415    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 16:36:50.345118 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:50.345080    2563 patch_prober.go:28] interesting pod/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 16:36:50.345596 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:50.345139    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 16:36:51.344220 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:51.344186    2563 patch_prober.go:28] interesting pod/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 16:36:51.344411 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:51.344255    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 16:36:52.344388 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:52.344354    2563 patch_prober.go:28] interesting pod/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 16:36:52.344773 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:52.344409    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 16:36:53.348219 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:53.348186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:53.348657 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:53.348576    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:53.349203 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:53.349186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:36:59.069114 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:59.069075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:59.786337 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:59.786297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:36:59.818434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:59.818386    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:36:59.827052 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:59.827033    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:36:59.888345 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:36:59.888299    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:00.275891 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:00.275857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:06.036606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:06.036574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:06.094210 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:06.094176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:16.872584 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:16.872550    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"]
Aug 04 16:37:16.873111 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:16.872761    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f" podUID="05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" containerName="maas-api" containerID="cri-o://285f78f4573f360185c23679499d6c9a7d2ba2161155aa324d70b9e697fff9b1" gracePeriod=30
Aug 04 16:37:16.914789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:16.914752    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"]
Aug 04 16:37:16.915072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:16.915019    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt" podUID="85b85b7c-97f5-47bf-9990-9ce059b6540e" containerName="payload-processing" containerID="cri-o://e8bbaada557b4fe518331d8642c0581bcf5187473fc9fc40fce497048f4e5217" gracePeriod=30
Aug 04 16:37:16.923032 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:16.922944    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"]
Aug 04 16:37:16.923287 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:16.923179    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb" podUID="50febf5d-0eab-492b-98c1-5e0a0fbfda3a" containerName="payload-pre-processing" containerID="cri-o://a7023dd5b44aaf30123eda065a59ec4dad1a12ec562a080e4bcb1e5df0cc9f2b" gracePeriod=30
Aug 04 16:37:16.956147 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:16.956117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:17.070127 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.070083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:17.088759 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.087192    2563 generic.go:356] "Generic (PLEG): container finished" podID="05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" containerID="285f78f4573f360185c23679499d6c9a7d2ba2161155aa324d70b9e697fff9b1" exitCode=0
Aug 04 16:37:17.088759 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.087359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f" event={"ID":"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f","Type":"ContainerDied","Data":"285f78f4573f360185c23679499d6c9a7d2ba2161155aa324d70b9e697fff9b1"}
Aug 04 16:37:17.110479 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.106363    2563 generic.go:356] "Generic (PLEG): container finished" podID="50febf5d-0eab-492b-98c1-5e0a0fbfda3a" containerID="a7023dd5b44aaf30123eda065a59ec4dad1a12ec562a080e4bcb1e5df0cc9f2b" exitCode=0
Aug 04 16:37:17.110479 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.106629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb" event={"ID":"50febf5d-0eab-492b-98c1-5e0a0fbfda3a","Type":"ContainerDied","Data":"a7023dd5b44aaf30123eda065a59ec4dad1a12ec562a080e4bcb1e5df0cc9f2b"}
Aug 04 16:37:17.110479 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.110163    2563 generic.go:356] "Generic (PLEG): container finished" podID="85b85b7c-97f5-47bf-9990-9ce059b6540e" containerID="e8bbaada557b4fe518331d8642c0581bcf5187473fc9fc40fce497048f4e5217" exitCode=0
Aug 04 16:37:17.110479 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.110241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt" event={"ID":"85b85b7c-97f5-47bf-9990-9ce059b6540e","Type":"ContainerDied","Data":"e8bbaada557b4fe518331d8642c0581bcf5187473fc9fc40fce497048f4e5217"}
Aug 04 16:37:17.195373 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.195344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:17.201471 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.201442    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:37:17.233811 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.233770    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:37:17.244296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.244264    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:37:17.314847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.314817    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp86m\" (UniqueName: \"kubernetes.io/projected/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-kube-api-access-rp86m\") pod \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") "
Aug 04 16:37:17.315046 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.314856    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-openshift-service-ca\") pod \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") "
Aug 04 16:37:17.315046 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.314929    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-maas-api-tls\") pod \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\" (UID: \"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f\") "
Aug 04 16:37:17.315280 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.315250    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" (UID: "05580431-3c4b-4ab5-9fda-cdfce5cdfb4f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:37:17.317183 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.317154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-kube-api-access-rp86m" (OuterVolumeSpecName: "kube-api-access-rp86m") pod "05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" (UID: "05580431-3c4b-4ab5-9fda-cdfce5cdfb4f"). InnerVolumeSpecName "kube-api-access-rp86m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:37:17.317272 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.317221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" (UID: "05580431-3c4b-4ab5-9fda-cdfce5cdfb4f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:37:17.415565 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.415499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85b85b7c-97f5-47bf-9990-9ce059b6540e-plugins-config-volume\") pod \"85b85b7c-97f5-47bf-9990-9ce059b6540e\" (UID: \"85b85b7c-97f5-47bf-9990-9ce059b6540e\") "
Aug 04 16:37:17.415690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.415567    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdh6j\" (UniqueName: \"kubernetes.io/projected/85b85b7c-97f5-47bf-9990-9ce059b6540e-kube-api-access-gdh6j\") pod \"85b85b7c-97f5-47bf-9990-9ce059b6540e\" (UID: \"85b85b7c-97f5-47bf-9990-9ce059b6540e\") "
Aug 04 16:37:17.415690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.415604    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-plugins-config-volume\") pod \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\" (UID: \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\") "
Aug 04 16:37:17.415797 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.415714    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nwr6\" (UniqueName: \"kubernetes.io/projected/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-kube-api-access-6nwr6\") pod \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\" (UID: \"50febf5d-0eab-492b-98c1-5e0a0fbfda3a\") "
Aug 04 16:37:17.415955 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.415933    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b85b7c-97f5-47bf-9990-9ce059b6540e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85b85b7c-97f5-47bf-9990-9ce059b6540e" (UID: "85b85b7c-97f5-47bf-9990-9ce059b6540e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:37:17.416054 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.416030    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "50febf5d-0eab-492b-98c1-5e0a0fbfda3a" (UID: "50febf5d-0eab-492b-98c1-5e0a0fbfda3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:37:17.416115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.416051    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85b85b7c-97f5-47bf-9990-9ce059b6540e-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:17.416115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.416072    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp86m\" (UniqueName: \"kubernetes.io/projected/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-kube-api-access-rp86m\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:17.416115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.416087    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:17.416115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.416100    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:17.417656 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.417636    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b85b7c-97f5-47bf-9990-9ce059b6540e-kube-api-access-gdh6j" (OuterVolumeSpecName: "kube-api-access-gdh6j") pod "85b85b7c-97f5-47bf-9990-9ce059b6540e" (UID: "85b85b7c-97f5-47bf-9990-9ce059b6540e"). InnerVolumeSpecName "kube-api-access-gdh6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:37:17.417785 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.417767    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-kube-api-access-6nwr6" (OuterVolumeSpecName: "kube-api-access-6nwr6") pod "50febf5d-0eab-492b-98c1-5e0a0fbfda3a" (UID: "50febf5d-0eab-492b-98c1-5e0a0fbfda3a"). InnerVolumeSpecName "kube-api-access-6nwr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:37:17.517255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.517224    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdh6j\" (UniqueName: \"kubernetes.io/projected/85b85b7c-97f5-47bf-9990-9ce059b6540e-kube-api-access-gdh6j\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:17.517255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.517250    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:17.517255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.517259    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nwr6\" (UniqueName: \"kubernetes.io/projected/50febf5d-0eab-492b-98c1-5e0a0fbfda3a-kube-api-access-6nwr6\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:17.603358 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:17.603324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:18.118013 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.117984    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"
Aug 04 16:37:18.118433 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.118020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb" event={"ID":"50febf5d-0eab-492b-98c1-5e0a0fbfda3a","Type":"ContainerDied","Data":"3de32af0d7d23b9698f435d8cfae75854c2e077c8a89aedde8640aa13819a38c"}
Aug 04 16:37:18.118433 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.118085    2563 scope.go:117] "RemoveContainer" containerID="a7023dd5b44aaf30123eda065a59ec4dad1a12ec562a080e4bcb1e5df0cc9f2b"
Aug 04 16:37:18.119453 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.119438    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"
Aug 04 16:37:18.119529 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.119470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt" event={"ID":"85b85b7c-97f5-47bf-9990-9ce059b6540e","Type":"ContainerDied","Data":"7ca730d492c493f4e65d22a81b168231d6773c05b4e696b206da74262eb5c1a5"}
Aug 04 16:37:18.121206 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.121173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f" event={"ID":"05580431-3c4b-4ab5-9fda-cdfce5cdfb4f","Type":"ContainerDied","Data":"0526fefaf2044c4e4616b745bb39f441ee265470bed686a856ef2b20b1f92057"}
Aug 04 16:37:18.121309 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.121179    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"
Aug 04 16:37:18.128446 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.128432    2563 scope.go:117] "RemoveContainer" containerID="e8bbaada557b4fe518331d8642c0581bcf5187473fc9fc40fce497048f4e5217"
Aug 04 16:37:18.136610 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.136589    2563 scope.go:117] "RemoveContainer" containerID="285f78f4573f360185c23679499d6c9a7d2ba2161155aa324d70b9e697fff9b1"
Aug 04 16:37:18.139121 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.139101    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"]
Aug 04 16:37:18.142518 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.142496    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9f3e00e1-6cf4d65698-5wtqt"]
Aug 04 16:37:18.155245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.155225    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"]
Aug 04 16:37:18.159533 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.159508    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f3e00e1-5576f9fcdb-m7r6f"]
Aug 04 16:37:18.172999 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.172978    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"]
Aug 04 16:37:18.175992 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:18.175973    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9f3e00e1-576f5c6548-7hqcb"]
Aug 04 16:37:19.718392 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:19.718348    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" path="/var/lib/kubelet/pods/05580431-3c4b-4ab5-9fda-cdfce5cdfb4f/volumes"
Aug 04 16:37:19.718899 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:19.718878    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50febf5d-0eab-492b-98c1-5e0a0fbfda3a" path="/var/lib/kubelet/pods/50febf5d-0eab-492b-98c1-5e0a0fbfda3a/volumes"
Aug 04 16:37:19.719278 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:19.719259    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b85b7c-97f5-47bf-9990-9ce059b6540e" path="/var/lib/kubelet/pods/85b85b7c-97f5-47bf-9990-9ce059b6540e/volumes"
Aug 04 16:37:23.449368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:23.449334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:23.539845 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:23.539805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:23.812091 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:23.812057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:23.873300 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:23.873271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:24.072880 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:24.072801    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"]
Aug 04 16:37:24.073079 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:24.073053    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy" containerID="cri-o://5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a" gracePeriod=30
Aug 04 16:37:24.117040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:24.117011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:24.335664 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:24.335570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:24.478731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:24.478695    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:24.579804 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:24.579771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:24.742211 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:24.742175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:29.339864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.339802    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:37:29.415545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415516    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-credential-socket\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.415688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415570    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-socket\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.415688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415597    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-envoy\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.415688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istiod-ca-cert\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.415688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415668    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxln8\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-kube-api-access-rxln8\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.415886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415720    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-data\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.415886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415750    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-token\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.415886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415783    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-certs\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.415886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415819    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:37:29.415886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415843    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-podinfo\") pod \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\" (UID: \"e1a31a39-eca7-4ada-b24a-39cf6b961a70\") "
Aug 04 16:37:29.416185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.415932    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:37:29.416185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.416045    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:37:29.416295 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.416239    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:37:29.416406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.416299    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:37:29.416406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.416324    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:29.416406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.416355    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:29.416406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.416368    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:29.417972 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.417940    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-kube-api-access-rxln8" (OuterVolumeSpecName: "kube-api-access-rxln8") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "kube-api-access-rxln8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:37:29.418118 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.418101    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:37:29.418497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.418474    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:37:29.418558 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.418479    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1a31a39-eca7-4ada-b24a-39cf6b961a70" (UID: "e1a31a39-eca7-4ada-b24a-39cf6b961a70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:37:29.517506 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.517474    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:29.517506 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.517500    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:29.517680 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.517513    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:29.517680 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.517523    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:29.517680 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.517534    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxln8\" (UniqueName: \"kubernetes.io/projected/e1a31a39-eca7-4ada-b24a-39cf6b961a70-kube-api-access-rxln8\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:29.517680 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:29.517546    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1a31a39-eca7-4ada-b24a-39cf6b961a70-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:37:30.194899 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.194869    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerID="5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a" exitCode=0
Aug 04 16:37:30.195060 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.194944    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"
Aug 04 16:37:30.195060 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.194947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" event={"ID":"e1a31a39-eca7-4ada-b24a-39cf6b961a70","Type":"ContainerDied","Data":"5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a"}
Aug 04 16:37:30.195157 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.195064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb" event={"ID":"e1a31a39-eca7-4ada-b24a-39cf6b961a70","Type":"ContainerDied","Data":"159ac2efff7558ebacc0ae5a35177261e06ea8f70505bc62cc05cfb414c9a7e1"}
Aug 04 16:37:30.195157 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.195086    2563 scope.go:117] "RemoveContainer" containerID="5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a"
Aug 04 16:37:30.204187 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.204170    2563 scope.go:117] "RemoveContainer" containerID="6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7"
Aug 04 16:37:30.211582 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.211514    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"]
Aug 04 16:37:30.215137 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.215089    2563 scope.go:117] "RemoveContainer" containerID="5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a"
Aug 04 16:37:30.215676 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:37:30.215647    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a\": container with ID starting with 5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a not found: ID does not exist" containerID="5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a"
Aug 04 16:37:30.216088 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.215687    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a"} err="failed to get container status \"5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a\": rpc error: code = NotFound desc = could not find container \"5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a\": container with ID starting with 5b2019d92fb847180d826c5ba952dcffdd2a35a0c388d368f8e0cb52c4ba7c0a not found: ID does not exist"
Aug 04 16:37:30.216088 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.215712    2563 scope.go:117] "RemoveContainer" containerID="6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7"
Aug 04 16:37:30.216233 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:37:30.216120    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7\": container with ID starting with 6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7 not found: ID does not exist" containerID="6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7"
Aug 04 16:37:30.216233 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.216144    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7"} err="failed to get container status \"6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7\": rpc error: code = NotFound desc = could not find container \"6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7\": container with ID starting with 6c79d05e961994ae1efeb1be7c0cb52df083e2612b107704783edd5b05bda9b7 not found: ID does not exist"
Aug 04 16:37:30.218091 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.218068    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9f3e00e1-openshift-default-5ccbbf4984-cxmfb"]
Aug 04 16:37:30.871434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.871401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:30.934612 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:30.934584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:31.025243 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:31.025204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:31.113301 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:31.113265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:31.278276 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:31.278243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:31.717452 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:31.717373    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" path="/var/lib/kubelet/pods/e1a31a39-eca7-4ada-b24a-39cf6b961a70/volumes"
Aug 04 16:37:37.259773 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:37.259742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:37:37.320784 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:37:37.320755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:38:05.981595 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:05.981557    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"]
Aug 04 16:38:05.982204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:05.981821    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf" podUID="8b868276-d9e9-4545-9be7-938f4ce4a601" containerName="manager" containerID="cri-o://7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a" gracePeriod=10
Aug 04 16:38:06.230872 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.230849    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:38:06.324524 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.324492    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjbgd\" (UniqueName: \"kubernetes.io/projected/8b868276-d9e9-4545-9be7-938f4ce4a601-kube-api-access-wjbgd\") pod \"8b868276-d9e9-4545-9be7-938f4ce4a601\" (UID: \"8b868276-d9e9-4545-9be7-938f4ce4a601\") "
Aug 04 16:38:06.324719 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.324550    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b868276-d9e9-4545-9be7-938f4ce4a601-extensions-socket-volume\") pod \"8b868276-d9e9-4545-9be7-938f4ce4a601\" (UID: \"8b868276-d9e9-4545-9be7-938f4ce4a601\") "
Aug 04 16:38:06.324949 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.324902    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b868276-d9e9-4545-9be7-938f4ce4a601-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8b868276-d9e9-4545-9be7-938f4ce4a601" (UID: "8b868276-d9e9-4545-9be7-938f4ce4a601"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:38:06.326635 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.326615    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b868276-d9e9-4545-9be7-938f4ce4a601-kube-api-access-wjbgd" (OuterVolumeSpecName: "kube-api-access-wjbgd") pod "8b868276-d9e9-4545-9be7-938f4ce4a601" (UID: "8b868276-d9e9-4545-9be7-938f4ce4a601"). InnerVolumeSpecName "kube-api-access-wjbgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:38:06.403231 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.403200    2563 generic.go:356] "Generic (PLEG): container finished" podID="8b868276-d9e9-4545-9be7-938f4ce4a601" containerID="7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a" exitCode=0
Aug 04 16:38:06.403380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.403242    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"
Aug 04 16:38:06.403380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.403287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf" event={"ID":"8b868276-d9e9-4545-9be7-938f4ce4a601","Type":"ContainerDied","Data":"7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a"}
Aug 04 16:38:06.403380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.403335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf" event={"ID":"8b868276-d9e9-4545-9be7-938f4ce4a601","Type":"ContainerDied","Data":"401948f977aa0631c21eb699a8145eb635ae29212504e1fb558cf15a374a0c9e"}
Aug 04 16:38:06.403380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.403359    2563 scope.go:117] "RemoveContainer" containerID="7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a"
Aug 04 16:38:06.413245 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.413229    2563 scope.go:117] "RemoveContainer" containerID="7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a"
Aug 04 16:38:06.413502 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:38:06.413484    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a\": container with ID starting with 7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a not found: ID does not exist" containerID="7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a"
Aug 04 16:38:06.413548 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.413511    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a"} err="failed to get container status \"7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a\": rpc error: code = NotFound desc = could not find container \"7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a\": container with ID starting with 7654f6c2987ce370f55381b0346e523fb34a9137d4e73c17aa223e1f9afc4d7a not found: ID does not exist"
Aug 04 16:38:06.425155 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.425133    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjbgd\" (UniqueName: \"kubernetes.io/projected/8b868276-d9e9-4545-9be7-938f4ce4a601-kube-api-access-wjbgd\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:38:06.425253 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.425157    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b868276-d9e9-4545-9be7-938f4ce4a601-extensions-socket-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:38:06.426706 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.426693    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"]
Aug 04 16:38:06.435187 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:06.432479    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v9hvf"]
Aug 04 16:38:07.717461 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:38:07.717426    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b868276-d9e9-4545-9be7-938f4ce4a601" path="/var/lib/kubelet/pods/8b868276-d9e9-4545-9be7-938f4ce4a601/volumes"
Aug 04 16:39:15.493607 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:15.493571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:15.582225 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:15.582178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:21.655024 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.654952    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"]
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655329    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b85b7c-97f5-47bf-9990-9ce059b6540e" containerName="payload-processing"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655339    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b85b7c-97f5-47bf-9990-9ce059b6540e" containerName="payload-processing"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655349    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655356    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655364    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" containerName="maas-api"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655370    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" containerName="maas-api"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655383    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50febf5d-0eab-492b-98c1-5e0a0fbfda3a" containerName="payload-pre-processing"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655389    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="50febf5d-0eab-492b-98c1-5e0a0fbfda3a" containerName="payload-pre-processing"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655394    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655399    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655412    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b868276-d9e9-4545-9be7-938f4ce4a601" containerName="manager"
Aug 04 16:39:21.655459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655418    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b868276-d9e9-4545-9be7-938f4ce4a601" containerName="manager"
Aug 04 16:39:21.655823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655472    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="50febf5d-0eab-492b-98c1-5e0a0fbfda3a" containerName="payload-pre-processing"
Aug 04 16:39:21.655823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655480    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="05580431-3c4b-4ab5-9fda-cdfce5cdfb4f" containerName="maas-api"
Aug 04 16:39:21.655823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655487    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b868276-d9e9-4545-9be7-938f4ce4a601" containerName="manager"
Aug 04 16:39:21.655823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655492    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy"
Aug 04 16:39:21.655823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655497    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b85b7c-97f5-47bf-9990-9ce059b6540e" containerName="payload-processing"
Aug 04 16:39:21.655823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.655503    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1a31a39-eca7-4ada-b24a-39cf6b961a70" containerName="istio-proxy"
Aug 04 16:39:21.658621 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.658607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:21.662836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.662812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jzpbj\""
Aug 04 16:39:21.674449 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.674428    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"]
Aug 04 16:39:21.747015 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.746988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnq5w\" (UniqueName: \"kubernetes.io/projected/53371a5b-cf56-4451-81e1-e94c24ea2938-kube-api-access-lnq5w\") pod \"kuadrant-operator-controller-manager-68cf589589-zdwth\" (UID: \"53371a5b-cf56-4451-81e1-e94c24ea2938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:21.747132 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.747022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53371a5b-cf56-4451-81e1-e94c24ea2938-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zdwth\" (UID: \"53371a5b-cf56-4451-81e1-e94c24ea2938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:21.847721 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.847692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnq5w\" (UniqueName: \"kubernetes.io/projected/53371a5b-cf56-4451-81e1-e94c24ea2938-kube-api-access-lnq5w\") pod \"kuadrant-operator-controller-manager-68cf589589-zdwth\" (UID: \"53371a5b-cf56-4451-81e1-e94c24ea2938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:21.847828 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.847727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53371a5b-cf56-4451-81e1-e94c24ea2938-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zdwth\" (UID: \"53371a5b-cf56-4451-81e1-e94c24ea2938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:21.848092 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.848076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53371a5b-cf56-4451-81e1-e94c24ea2938-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zdwth\" (UID: \"53371a5b-cf56-4451-81e1-e94c24ea2938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:21.858735 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.858717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnq5w\" (UniqueName: \"kubernetes.io/projected/53371a5b-cf56-4451-81e1-e94c24ea2938-kube-api-access-lnq5w\") pod \"kuadrant-operator-controller-manager-68cf589589-zdwth\" (UID: \"53371a5b-cf56-4451-81e1-e94c24ea2938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:21.969089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:21.969029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:22.115838 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:22.115807    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"]
Aug 04 16:39:22.116349 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:39:22.116327    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53371a5b_cf56_4451_81e1_e94c24ea2938.slice/crio-8f5d1eab3252215be09267b2a153561cdbd81d93912c4ea7eee48842c5004f0f WatchSource:0}: Error finding container 8f5d1eab3252215be09267b2a153561cdbd81d93912c4ea7eee48842c5004f0f: Status 404 returned error can't find the container with id 8f5d1eab3252215be09267b2a153561cdbd81d93912c4ea7eee48842c5004f0f
Aug 04 16:39:22.821808 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:22.821768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth" event={"ID":"53371a5b-cf56-4451-81e1-e94c24ea2938","Type":"ContainerStarted","Data":"085dba7f3040201f600a9c3305fad07ccbe64c7947ead7474656c725b25fa5ed"}
Aug 04 16:39:22.822205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:22.821849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth" event={"ID":"53371a5b-cf56-4451-81e1-e94c24ea2938","Type":"ContainerStarted","Data":"8f5d1eab3252215be09267b2a153561cdbd81d93912c4ea7eee48842c5004f0f"}
Aug 04 16:39:22.822205 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:22.821871    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:22.846106 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:22.846064    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth" podStartSLOduration=1.846051012 podStartE2EDuration="1.846051012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:39:22.844884306 +0000 UTC m=+2243.671581817" watchObservedRunningTime="2026-08-04 16:39:22.846051012 +0000 UTC m=+2243.672748485"
Aug 04 16:39:33.829806 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:33.829773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zdwth"
Aug 04 16:39:40.522731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.522696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:40.820270 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.820197    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"]
Aug 04 16:39:40.824380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.824356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.826435 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.826415    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8101352f-openshift-default-dockercfg-mfs95\""
Aug 04 16:39:40.834974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.834952    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"]
Aug 04 16:39:40.904106 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w2sx\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-kube-api-access-5w2sx\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.904277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-socket\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.904277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb68a41-fcae-4138-807b-1f54281adc6d-istiod-ca-cert\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.904277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-podinfo\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.904277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-certs\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.904497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-data\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.904497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-credential-socket\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.904497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-token\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:40.904497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:40.904428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-envoy\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-certs\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005441 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-data\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005441 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-credential-socket\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005516 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-token\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005516 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-envoy\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w2sx\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-kube-api-access-5w2sx\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-socket\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005606 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb68a41-fcae-4138-807b-1f54281adc6d-istiod-ca-cert\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-podinfo\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005813 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-certs\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005871 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-credential-socket\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.005960 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-data\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.006029 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.005976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-socket\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.006339 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.006322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb68a41-fcae-4138-807b-1f54281adc6d-istiod-ca-cert\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.008122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.008090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-envoy\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.008228 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.008204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-podinfo\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.013358 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.013335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-token\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.013358 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.013346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w2sx\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-kube-api-access-5w2sx\") pod \"e2e-mt-8101352f-openshift-default-78566c788d-6xqgn\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") " pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.136802 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.136729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:41.277303 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.277270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"]
Aug 04 16:39:41.278167 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:39:41.278136    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb68a41_fcae_4138_807b_1f54281adc6d.slice/crio-2fc303f759dc275785eeba8be912d44a81e9f2be740b1113f99e658391790463 WatchSource:0}: Error finding container 2fc303f759dc275785eeba8be912d44a81e9f2be740b1113f99e658391790463: Status 404 returned error can't find the container with id 2fc303f759dc275785eeba8be912d44a81e9f2be740b1113f99e658391790463
Aug 04 16:39:41.280731 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.280687    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:39:41.280817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.280757    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:39:41.280817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.280784    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:39:41.853598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.853565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:41.929605 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.929577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" event={"ID":"6bb68a41-fcae-4138-807b-1f54281adc6d","Type":"ContainerStarted","Data":"aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73"}
Aug 04 16:39:41.936068 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.929626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" event={"ID":"6bb68a41-fcae-4138-807b-1f54281adc6d","Type":"ContainerStarted","Data":"2fc303f759dc275785eeba8be912d44a81e9f2be740b1113f99e658391790463"}
Aug 04 16:39:41.953987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:41.953937    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podStartSLOduration=1.9539185730000002 podStartE2EDuration="1.953918573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:39:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:39:41.952315797 +0000 UTC m=+2262.779013270" watchObservedRunningTime="2026-08-04 16:39:41.953918573 +0000 UTC m=+2262.780616035"
Aug 04 16:39:42.137586 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:42.137513    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:42.142367 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:42.142343    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:42.935582 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:42.935550    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:42.936478 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:42.936458    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:39:43.955258 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:43.955222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:44.053040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:44.053003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:45.071955 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.071920    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"]
Aug 04 16:39:45.075653 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.075634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.077516 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.077496    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8101352f-serving-cert\""
Aug 04 16:39:45.085282 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.085260    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"]
Aug 04 16:39:45.099620 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.099592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:45.141141 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.141107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-openshift-service-ca\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.141315 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.141152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64j7m\" (UniqueName: \"kubernetes.io/projected/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-kube-api-access-64j7m\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.141315 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.141186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.242256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.242227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64j7m\" (UniqueName: \"kubernetes.io/projected/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-kube-api-access-64j7m\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.242437 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.242262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.242437 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.242346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-openshift-service-ca\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.242541 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:39:45.242448    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-serving-cert: secret "maas-api-e2e-mt-8101352f-serving-cert" not found
Aug 04 16:39:45.242541 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:39:45.242507    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls podName:6ec9ef11-efa3-47f5-8277-072b84b2b1e0 nodeName:}" failed. No retries permitted until 2026-08-04 16:39:45.742491503 +0000 UTC m=+2266.569188954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls") pod "maas-api-e2e-mt-8101352f-7c54865859-7nwvx" (UID: "6ec9ef11-efa3-47f5-8277-072b84b2b1e0") : secret "maas-api-e2e-mt-8101352f-serving-cert" not found
Aug 04 16:39:45.242938 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.242922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-openshift-service-ca\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.251513 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.251489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64j7m\" (UniqueName: \"kubernetes.io/projected/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-kube-api-access-64j7m\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.651859 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.651827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:45.747325 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.747295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.749984 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.749956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls\") pod \"maas-api-e2e-mt-8101352f-7c54865859-7nwvx\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:45.752413 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.752390    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:45.851406 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.851334    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"]
Aug 04 16:39:45.852166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.852142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:39:45.855333 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.855318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:45.858256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.858236    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8101352f\""
Aug 04 16:39:45.858483 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.858463    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8101352f-dockercfg-k7ml2\""
Aug 04 16:39:45.867470 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.867448    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"]
Aug 04 16:39:45.894104 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.894077    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"]
Aug 04 16:39:45.897739 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.897720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:45.910879 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.910843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"]
Aug 04 16:39:45.949577 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.949507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glbf\" (UniqueName: \"kubernetes.io/projected/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-kube-api-access-5glbf\") pod \"payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4\" (UID: \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:45.949577 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.949578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ds56\" (UniqueName: \"kubernetes.io/projected/e54d43d2-1bd0-437c-9698-df7797c9f49a-kube-api-access-9ds56\") pod \"payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6\" (UID: \"e54d43d2-1bd0-437c-9698-df7797c9f49a\") " pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:45.950011 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.949646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4\" (UID: \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:45.950011 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.949683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54d43d2-1bd0-437c-9698-df7797c9f49a-plugins-config-volume\") pod \"payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6\" (UID: \"e54d43d2-1bd0-437c-9698-df7797c9f49a\") " pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:45.988221 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:45.988186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:46.051921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.051063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5glbf\" (UniqueName: \"kubernetes.io/projected/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-kube-api-access-5glbf\") pod \"payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4\" (UID: \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:46.051921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.051113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ds56\" (UniqueName: \"kubernetes.io/projected/e54d43d2-1bd0-437c-9698-df7797c9f49a-kube-api-access-9ds56\") pod \"payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6\" (UID: \"e54d43d2-1bd0-437c-9698-df7797c9f49a\") " pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:46.051921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.051154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4\" (UID: \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:46.051921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.051176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54d43d2-1bd0-437c-9698-df7797c9f49a-plugins-config-volume\") pod \"payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6\" (UID: \"e54d43d2-1bd0-437c-9698-df7797c9f49a\") " pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:46.051921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.051863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54d43d2-1bd0-437c-9698-df7797c9f49a-plugins-config-volume\") pod \"payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6\" (UID: \"e54d43d2-1bd0-437c-9698-df7797c9f49a\") " pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:46.052415 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.052386    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4\" (UID: \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:46.060472 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.060439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glbf\" (UniqueName: \"kubernetes.io/projected/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-kube-api-access-5glbf\") pod \"payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4\" (UID: \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:46.060755 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.060732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ds56\" (UniqueName: \"kubernetes.io/projected/e54d43d2-1bd0-437c-9698-df7797c9f49a-kube-api-access-9ds56\") pod \"payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6\" (UID: \"e54d43d2-1bd0-437c-9698-df7797c9f49a\") " pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:46.133763 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.131621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"]
Aug 04 16:39:46.135190 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:39:46.135162    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec9ef11_efa3_47f5_8277_072b84b2b1e0.slice/crio-f05d82124fe8c4459fb2b17fe5f645011d06a7b91d1d16bf82273ba01b5dfecf WatchSource:0}: Error finding container f05d82124fe8c4459fb2b17fe5f645011d06a7b91d1d16bf82273ba01b5dfecf: Status 404 returned error can't find the container with id f05d82124fe8c4459fb2b17fe5f645011d06a7b91d1d16bf82273ba01b5dfecf
Aug 04 16:39:46.136785 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.136768    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:39:46.168381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.168309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:46.215229 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.215196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:46.330430 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.330396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"]
Aug 04 16:39:46.331299 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:39:46.331257    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54d43d2_1bd0_437c_9698_df7797c9f49a.slice/crio-885ac2540c304468f1b01699458724bd3a5820e13045b5c5a3e735a946e75b63 WatchSource:0}: Error finding container 885ac2540c304468f1b01699458724bd3a5820e13045b5c5a3e735a946e75b63: Status 404 returned error can't find the container with id 885ac2540c304468f1b01699458724bd3a5820e13045b5c5a3e735a946e75b63
Aug 04 16:39:46.375740 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.375717    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"]
Aug 04 16:39:46.378247 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:39:46.378220    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58566fc8_20fe_429c_bc6f_1f13cc3f55dc.slice/crio-a000c65972efa3c16858ac7531fab764d423c69800a885f390907202f7314161 WatchSource:0}: Error finding container a000c65972efa3c16858ac7531fab764d423c69800a885f390907202f7314161: Status 404 returned error can't find the container with id a000c65972efa3c16858ac7531fab764d423c69800a885f390907202f7314161
Aug 04 16:39:46.963630 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.963591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx" event={"ID":"6ec9ef11-efa3-47f5-8277-072b84b2b1e0","Type":"ContainerStarted","Data":"892e2a51e2219cc7ba056c0db4a44747c497375bc8956e18f1376b369d06eaa9"}
Aug 04 16:39:46.963825 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.963660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx" event={"ID":"6ec9ef11-efa3-47f5-8277-072b84b2b1e0","Type":"ContainerStarted","Data":"f05d82124fe8c4459fb2b17fe5f645011d06a7b91d1d16bf82273ba01b5dfecf"}
Aug 04 16:39:46.963825 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.963704    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:46.965115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.965074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6" event={"ID":"e54d43d2-1bd0-437c-9698-df7797c9f49a","Type":"ContainerStarted","Data":"1feca9c9cbf33704c5c08e8ea75688fb5c1ff20b78c7caad4ebccd5a28df2cb5"}
Aug 04 16:39:46.965270 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.965131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6" event={"ID":"e54d43d2-1bd0-437c-9698-df7797c9f49a","Type":"ContainerStarted","Data":"885ac2540c304468f1b01699458724bd3a5820e13045b5c5a3e735a946e75b63"}
Aug 04 16:39:46.965270 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.965153    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:46.966729 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.966705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4" event={"ID":"58566fc8-20fe-429c-bc6f-1f13cc3f55dc","Type":"ContainerStarted","Data":"cb83d15c4a0e6c9fdfd7d700ae9ff827c2ec94a04b28fa42936c601b6baafb88"}
Aug 04 16:39:46.966850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.966755    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4" event={"ID":"58566fc8-20fe-429c-bc6f-1f13cc3f55dc","Type":"ContainerStarted","Data":"a000c65972efa3c16858ac7531fab764d423c69800a885f390907202f7314161"}
Aug 04 16:39:46.966850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.966778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:46.983066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.983015    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx" podStartSLOduration=1.5345081820000002 podStartE2EDuration="1.982994691s" totalImagesPullingTime="448.486509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:39:46.98136763 +0000 UTC m=+2267.808065101" watchObservedRunningTime="2026-08-04 16:39:46.982994691 +0000 UTC m=+2267.809692168"
Aug 04 16:39:46.998282 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:46.998238    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4" podStartSLOduration=1.9982238429999999 podStartE2EDuration="1.998223843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:39:46.99619608 +0000 UTC m=+2267.822893553" watchObservedRunningTime="2026-08-04 16:39:46.998223843 +0000 UTC m=+2267.824921315"
Aug 04 16:39:47.015246 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:47.015170    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6" podStartSLOduration=2.015153283 podStartE2EDuration="2.015153283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:39:47.014357698 +0000 UTC m=+2267.841055170" watchObservedRunningTime="2026-08-04 16:39:47.015153283 +0000 UTC m=+2267.841850757"
Aug 04 16:39:52.985194 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:52.985160    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:39:57.975770 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:57.975741    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:39:57.976237 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:57.975813    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:39:58.978052 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:58.978024    2563 patch_prober.go:28] interesting pod/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 04 16:39:58.979180 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:39:58.978098    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 04 16:40:00.052247 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:00.052212    2563 generic.go:356] "Generic (PLEG): container finished" podID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerID="aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73" exitCode=0
Aug 04 16:40:00.052614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:00.052286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" event={"ID":"6bb68a41-fcae-4138-807b-1f54281adc6d","Type":"ContainerDied","Data":"aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73"}
Aug 04 16:40:00.052706 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:00.052688    2563 scope.go:117] "RemoveContainer" containerID="aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73"
Aug 04 16:40:00.053703 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:00.053672    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:40:00.053759 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:00.053742    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:40:00.053795 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:00.053777    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:40:01.059725 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:01.059685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" event={"ID":"6bb68a41-fcae-4138-807b-1f54281adc6d","Type":"ContainerStarted","Data":"ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8"}
Aug 04 16:40:01.137511 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:01.137478    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:40:01.137722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:01.137639    2563 patch_prober.go:28] interesting pod/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 16:40:01.137722 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:01.137691    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 16:40:02.138084 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:02.138058    2563 patch_prober.go:28] interesting pod/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 16:40:02.138523 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:02.138497    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 16:40:03.137447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:03.137404    2563 patch_prober.go:28] interesting pod/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 16:40:03.137622 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:03.137474    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 16:40:04.137747 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:04.137711    2563 patch_prober.go:28] interesting pod/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 16:40:04.138122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:04.137768    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 16:40:05.137724 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:05.137689    2563 patch_prober.go:28] interesting pod/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Aug 04 16:40:05.137894 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:05.137740    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Aug 04 16:40:06.140957 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:06.140923    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:40:06.141325 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:06.141269    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:40:06.141885 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:06.141869    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:40:08.975649 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:08.975609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:40:16.054942 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:16.054897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:40:59.228674 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.228584    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"]
Aug 04 16:40:59.229246 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.228855    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx" podUID="6ec9ef11-efa3-47f5-8277-072b84b2b1e0" containerName="maas-api" containerID="cri-o://892e2a51e2219cc7ba056c0db4a44747c497375bc8956e18f1376b369d06eaa9" gracePeriod=30
Aug 04 16:40:59.256734 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.256710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:40:59.283806 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.283763    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"]
Aug 04 16:40:59.284075 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.284032    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6" podUID="e54d43d2-1bd0-437c-9698-df7797c9f49a" containerName="payload-processing" containerID="cri-o://1feca9c9cbf33704c5c08e8ea75688fb5c1ff20b78c7caad4ebccd5a28df2cb5" gracePeriod=30
Aug 04 16:40:59.290971 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.290946    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"]
Aug 04 16:40:59.291204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.291173    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4" podUID="58566fc8-20fe-429c-bc6f-1f13cc3f55dc" containerName="payload-pre-processing" containerID="cri-o://cb83d15c4a0e6c9fdfd7d700ae9ff827c2ec94a04b28fa42936c601b6baafb88" gracePeriod=30
Aug 04 16:40:59.325974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.325946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:40:59.394735 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.394701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:40:59.410062 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.410034    2563 generic.go:356] "Generic (PLEG): container finished" podID="58566fc8-20fe-429c-bc6f-1f13cc3f55dc" containerID="cb83d15c4a0e6c9fdfd7d700ae9ff827c2ec94a04b28fa42936c601b6baafb88" exitCode=0
Aug 04 16:40:59.410238 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.410121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4" event={"ID":"58566fc8-20fe-429c-bc6f-1f13cc3f55dc","Type":"ContainerDied","Data":"cb83d15c4a0e6c9fdfd7d700ae9ff827c2ec94a04b28fa42936c601b6baafb88"}
Aug 04 16:40:59.413090 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.413049    2563 generic.go:356] "Generic (PLEG): container finished" podID="6ec9ef11-efa3-47f5-8277-072b84b2b1e0" containerID="892e2a51e2219cc7ba056c0db4a44747c497375bc8956e18f1376b369d06eaa9" exitCode=0
Aug 04 16:40:59.413257 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.413136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx" event={"ID":"6ec9ef11-efa3-47f5-8277-072b84b2b1e0","Type":"ContainerDied","Data":"892e2a51e2219cc7ba056c0db4a44747c497375bc8956e18f1376b369d06eaa9"}
Aug 04 16:40:59.414985 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.414964    2563 generic.go:356] "Generic (PLEG): container finished" podID="e54d43d2-1bd0-437c-9698-df7797c9f49a" containerID="1feca9c9cbf33704c5c08e8ea75688fb5c1ff20b78c7caad4ebccd5a28df2cb5" exitCode=0
Aug 04 16:40:59.415123 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.415038    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6" event={"ID":"e54d43d2-1bd0-437c-9698-df7797c9f49a","Type":"ContainerDied","Data":"1feca9c9cbf33704c5c08e8ea75688fb5c1ff20b78c7caad4ebccd5a28df2cb5"}
Aug 04 16:40:59.459588 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.459481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:40:59.572503 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.572478    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:40:59.575980 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.575956    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:40:59.605943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.605893    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ds56\" (UniqueName: \"kubernetes.io/projected/e54d43d2-1bd0-437c-9698-df7797c9f49a-kube-api-access-9ds56\") pod \"e54d43d2-1bd0-437c-9698-df7797c9f49a\" (UID: \"e54d43d2-1bd0-437c-9698-df7797c9f49a\") "
Aug 04 16:40:59.606066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.605949    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54d43d2-1bd0-437c-9698-df7797c9f49a-plugins-config-volume\") pod \"e54d43d2-1bd0-437c-9698-df7797c9f49a\" (UID: \"e54d43d2-1bd0-437c-9698-df7797c9f49a\") "
Aug 04 16:40:59.606066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.605972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64j7m\" (UniqueName: \"kubernetes.io/projected/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-kube-api-access-64j7m\") pod \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") "
Aug 04 16:40:59.606066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.606011    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls\") pod \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") "
Aug 04 16:40:59.606066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.606038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-openshift-service-ca\") pod \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\" (UID: \"6ec9ef11-efa3-47f5-8277-072b84b2b1e0\") "
Aug 04 16:40:59.606375 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.606340    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e54d43d2-1bd0-437c-9698-df7797c9f49a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e54d43d2-1bd0-437c-9698-df7797c9f49a" (UID: "e54d43d2-1bd0-437c-9698-df7797c9f49a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:40:59.606639 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.606577    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ec9ef11-efa3-47f5-8277-072b84b2b1e0" (UID: "6ec9ef11-efa3-47f5-8277-072b84b2b1e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:40:59.608243 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.608217    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e54d43d2-1bd0-437c-9698-df7797c9f49a-kube-api-access-9ds56" (OuterVolumeSpecName: "kube-api-access-9ds56") pod "e54d43d2-1bd0-437c-9698-df7797c9f49a" (UID: "e54d43d2-1bd0-437c-9698-df7797c9f49a"). InnerVolumeSpecName "kube-api-access-9ds56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:40:59.608702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.608675    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ec9ef11-efa3-47f5-8277-072b84b2b1e0" (UID: "6ec9ef11-efa3-47f5-8277-072b84b2b1e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:40:59.608702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.608683    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-kube-api-access-64j7m" (OuterVolumeSpecName: "kube-api-access-64j7m") pod "6ec9ef11-efa3-47f5-8277-072b84b2b1e0" (UID: "6ec9ef11-efa3-47f5-8277-072b84b2b1e0"). InnerVolumeSpecName "kube-api-access-64j7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:40:59.612014 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.611992    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:40:59.706648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.706615    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5glbf\" (UniqueName: \"kubernetes.io/projected/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-kube-api-access-5glbf\") pod \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\" (UID: \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\") "
Aug 04 16:40:59.706810 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.706665    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-plugins-config-volume\") pod \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\" (UID: \"58566fc8-20fe-429c-bc6f-1f13cc3f55dc\") "
Aug 04 16:40:59.706886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.706873    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ds56\" (UniqueName: \"kubernetes.io/projected/e54d43d2-1bd0-437c-9698-df7797c9f49a-kube-api-access-9ds56\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:40:59.706976 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.706888    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e54d43d2-1bd0-437c-9698-df7797c9f49a-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:40:59.706976 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.706898    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64j7m\" (UniqueName: \"kubernetes.io/projected/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-kube-api-access-64j7m\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:40:59.706976 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.706943    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:40:59.706976 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.706955    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9ef11-efa3-47f5-8277-072b84b2b1e0-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:40:59.707107 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.707044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58566fc8-20fe-429c-bc6f-1f13cc3f55dc" (UID: "58566fc8-20fe-429c-bc6f-1f13cc3f55dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:40:59.708821 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.708799    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-kube-api-access-5glbf" (OuterVolumeSpecName: "kube-api-access-5glbf") pod "58566fc8-20fe-429c-bc6f-1f13cc3f55dc" (UID: "58566fc8-20fe-429c-bc6f-1f13cc3f55dc"). InnerVolumeSpecName "kube-api-access-5glbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:40:59.808043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.808010    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5glbf\" (UniqueName: \"kubernetes.io/projected/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-kube-api-access-5glbf\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:40:59.808043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:40:59.808042    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58566fc8-20fe-429c-bc6f-1f13cc3f55dc-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:41:00.422317 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.422278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx" event={"ID":"6ec9ef11-efa3-47f5-8277-072b84b2b1e0","Type":"ContainerDied","Data":"f05d82124fe8c4459fb2b17fe5f645011d06a7b91d1d16bf82273ba01b5dfecf"}
Aug 04 16:41:00.422317 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.422305    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"
Aug 04 16:41:00.422802 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.422362    2563 scope.go:117] "RemoveContainer" containerID="892e2a51e2219cc7ba056c0db4a44747c497375bc8956e18f1376b369d06eaa9"
Aug 04 16:41:00.423935 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.423828    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"
Aug 04 16:41:00.423935 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.423878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6" event={"ID":"e54d43d2-1bd0-437c-9698-df7797c9f49a","Type":"ContainerDied","Data":"885ac2540c304468f1b01699458724bd3a5820e13045b5c5a3e735a946e75b63"}
Aug 04 16:41:00.425497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.425473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4" event={"ID":"58566fc8-20fe-429c-bc6f-1f13cc3f55dc","Type":"ContainerDied","Data":"a000c65972efa3c16858ac7531fab764d423c69800a885f390907202f7314161"}
Aug 04 16:41:00.425617 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.425594    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"
Aug 04 16:41:00.433432 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.433406    2563 scope.go:117] "RemoveContainer" containerID="1feca9c9cbf33704c5c08e8ea75688fb5c1ff20b78c7caad4ebccd5a28df2cb5"
Aug 04 16:41:00.441168 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.441149    2563 scope.go:117] "RemoveContainer" containerID="cb83d15c4a0e6c9fdfd7d700ae9ff827c2ec94a04b28fa42936c601b6baafb88"
Aug 04 16:41:00.446244 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.446223    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"]
Aug 04 16:41:00.451431 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.451413    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8101352f-6d44d878d8-6qjh4"]
Aug 04 16:41:00.459804 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.459786    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"]
Aug 04 16:41:00.467106 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.467082    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8101352f-68b8f7c478-kv7b6"]
Aug 04 16:41:00.480864 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.480841    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"]
Aug 04 16:41:00.488037 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:00.488017    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8101352f-7c54865859-7nwvx"]
Aug 04 16:41:01.717011 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:01.716975    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58566fc8-20fe-429c-bc6f-1f13cc3f55dc" path="/var/lib/kubelet/pods/58566fc8-20fe-429c-bc6f-1f13cc3f55dc/volumes"
Aug 04 16:41:01.717573 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:01.717553    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec9ef11-efa3-47f5-8277-072b84b2b1e0" path="/var/lib/kubelet/pods/6ec9ef11-efa3-47f5-8277-072b84b2b1e0/volumes"
Aug 04 16:41:01.717976 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:01.717957    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e54d43d2-1bd0-437c-9698-df7797c9f49a" path="/var/lib/kubelet/pods/e54d43d2-1bd0-437c-9698-df7797c9f49a/volumes"
Aug 04 16:41:02.926601 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:02.926573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:41:07.991805 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:07.991768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:41:44.950397 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:44.950363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:41:45.425651 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:45.425620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:41:51.031993 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:51.031960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:41:59.861156 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:59.861121    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:41:59.869801 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:41:59.869778    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:42:05.293113 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:05.293073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:05.353332 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:05.353301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:05.572852 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:05.572774    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"]
Aug 04 16:42:05.573032 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:05.573008    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy" containerID="cri-o://ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8" gracePeriod=30
Aug 04 16:42:05.595241 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:05.595208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:05.847896 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:05.847802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:06.144425 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:06.144335    2563 patch_prober.go:28] interesting pod/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 16:42:06.144425 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:06.144414    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 16:42:10.829366 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.829344    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:42:10.842129 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.842069    2563 generic.go:356] "Generic (PLEG): container finished" podID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerID="ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8" exitCode=0
Aug 04 16:42:10.842129 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.842114    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"
Aug 04 16:42:10.842285 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.842151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" event={"ID":"6bb68a41-fcae-4138-807b-1f54281adc6d","Type":"ContainerDied","Data":"ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8"}
Aug 04 16:42:10.842285 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.842207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn" event={"ID":"6bb68a41-fcae-4138-807b-1f54281adc6d","Type":"ContainerDied","Data":"2fc303f759dc275785eeba8be912d44a81e9f2be740b1113f99e658391790463"}
Aug 04 16:42:10.842285 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.842237    2563 scope.go:117] "RemoveContainer" containerID="ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8"
Aug 04 16:42:10.852407 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.852371    2563 scope.go:117] "RemoveContainer" containerID="aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73"
Aug 04 16:42:10.864035 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.863347    2563 scope.go:117] "RemoveContainer" containerID="ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8"
Aug 04 16:42:10.864035 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:42:10.863963    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8\": container with ID starting with ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8 not found: ID does not exist" containerID="ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8"
Aug 04 16:42:10.864035 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.863989    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8"} err="failed to get container status \"ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8\": rpc error: code = NotFound desc = could not find container \"ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8\": container with ID starting with ea9d3188dc2275d2ebcec88ed122d7311c1cac7b00be9006e0d6e384764e04f8 not found: ID does not exist"
Aug 04 16:42:10.864035 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.864007    2563 scope.go:117] "RemoveContainer" containerID="aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73"
Aug 04 16:42:10.864423 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:42:10.864404    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73\": container with ID starting with aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73 not found: ID does not exist" containerID="aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73"
Aug 04 16:42:10.864508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.864427    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73"} err="failed to get container status \"aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73\": rpc error: code = NotFound desc = could not find container \"aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73\": container with ID starting with aeb339b04f0c34b1d42f2ba28f5bcdeb63c735a7ebbdde045fec2b41f2270a73 not found: ID does not exist"
Aug 04 16:42:10.925820 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.925790    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-credential-socket\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.925996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.925826    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb68a41-fcae-4138-807b-1f54281adc6d-istiod-ca-cert\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.925996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.925858    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-socket\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.925996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.925896    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-certs\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.925996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.925963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-token\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.926193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926015    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w2sx\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-kube-api-access-5w2sx\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.926193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926115    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:42:10.926193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926173    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-envoy\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.926359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926227    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-podinfo\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.926359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb68a41-fcae-4138-807b-1f54281adc6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:42:10.926359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-data\") pod \"6bb68a41-fcae-4138-807b-1f54281adc6d\" (UID: \"6bb68a41-fcae-4138-807b-1f54281adc6d\") "
Aug 04 16:42:10.926672 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926615    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:10.926672 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926622    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:42:10.926672 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926639    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb68a41-fcae-4138-807b-1f54281adc6d-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:10.926672 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926643    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:42:10.926962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.926928    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:42:10.928397 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.928367    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-kube-api-access-5w2sx" (OuterVolumeSpecName: "kube-api-access-5w2sx") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "kube-api-access-5w2sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:42:10.928505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.928392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:42:10.928705 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.928675    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:42:10.928806 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:10.928728    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6bb68a41-fcae-4138-807b-1f54281adc6d" (UID: "6bb68a41-fcae-4138-807b-1f54281adc6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:42:11.028043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.028010    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:11.028043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.028038    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:11.028043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.028046    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:11.028043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.028053    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:11.028338 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.028061    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb68a41-fcae-4138-807b-1f54281adc6d-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:11.028338 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.028070    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:11.028338 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.028078    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w2sx\" (UniqueName: \"kubernetes.io/projected/6bb68a41-fcae-4138-807b-1f54281adc6d-kube-api-access-5w2sx\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:42:11.164929 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.164885    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"]
Aug 04 16:42:11.168901 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.168873    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8101352f-openshift-default-78566c788d-6xqgn"]
Aug 04 16:42:11.717127 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:11.717085    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" path="/var/lib/kubelet/pods/6bb68a41-fcae-4138-807b-1f54281adc6d/volumes"
Aug 04 16:42:17.234128 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:17.234093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:17.330049 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:17.330015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:17.428955 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:17.428922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:18.045879 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:18.045850    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:18.137875 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:18.137846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:18.237965 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:18.237931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:19.579863 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:19.579830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:26.620007 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:26.619968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:26.718376 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:26.718343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:27.316226 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:27.316193    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:33.604964 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:33.604930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:33.715137 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:33.715106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:33.811095 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:33.811064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:44.372454 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:44.372413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:42:44.611264 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:42:44.611229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:05.679654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:05.679600    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:12.375380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:12.375346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:12.476488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:12.476459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:12.835122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:12.835085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:13.101374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101300    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"]
Aug 04 16:43:13.101725 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101711    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e54d43d2-1bd0-437c-9698-df7797c9f49a" containerName="payload-processing"
Aug 04 16:43:13.101725 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101725    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e54d43d2-1bd0-437c-9698-df7797c9f49a" containerName="payload-processing"
Aug 04 16:43:13.101826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101740    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy"
Aug 04 16:43:13.101826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101745    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy"
Aug 04 16:43:13.101826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101751    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy"
Aug 04 16:43:13.101826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101757    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy"
Aug 04 16:43:13.101826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101779    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec9ef11-efa3-47f5-8277-072b84b2b1e0" containerName="maas-api"
Aug 04 16:43:13.101826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101785    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec9ef11-efa3-47f5-8277-072b84b2b1e0" containerName="maas-api"
Aug 04 16:43:13.101826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101799    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58566fc8-20fe-429c-bc6f-1f13cc3f55dc" containerName="payload-pre-processing"
Aug 04 16:43:13.101826 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101804    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="58566fc8-20fe-429c-bc6f-1f13cc3f55dc" containerName="payload-pre-processing"
Aug 04 16:43:13.102163 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101877    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="58566fc8-20fe-429c-bc6f-1f13cc3f55dc" containerName="payload-pre-processing"
Aug 04 16:43:13.102163 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101887    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy"
Aug 04 16:43:13.102163 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101894    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec9ef11-efa3-47f5-8277-072b84b2b1e0" containerName="maas-api"
Aug 04 16:43:13.102163 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101918    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb68a41-fcae-4138-807b-1f54281adc6d" containerName="istio-proxy"
Aug 04 16:43:13.102163 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.101928    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e54d43d2-1bd0-437c-9698-df7797c9f49a" containerName="payload-processing"
Aug 04 16:43:13.104975 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.104960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.107197 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.107179    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6c210e-openshift-default-dockercfg-dp9tm\""
Aug 04 16:43:13.120714 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.120695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"]
Aug 04 16:43:13.123328 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.123301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:13.161075 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-certs\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.161185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-data\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.161185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-credential-socket\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.161296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-podinfo\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.161296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58cm7\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-kube-api-access-58cm7\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.161296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-socket\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.161435 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5a60fd2-0182-4640-b888-92895fcf2b31-istiod-ca-cert\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.161435 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-envoy\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.161538 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.161458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-token\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.249828 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.249782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:13.262069 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-token\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-certs\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-data\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-credential-socket\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-podinfo\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262193 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58cm7\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-kube-api-access-58cm7\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-socket\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5a60fd2-0182-4640-b888-92895fcf2b31-istiod-ca-cert\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-envoy\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262626 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-data\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262630    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-certs\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-credential-socket\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.262688 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.262652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-socket\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.263072 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.263053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5a60fd2-0182-4640-b888-92895fcf2b31-istiod-ca-cert\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.264787 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.264768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-envoy\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.265135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.265111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-podinfo\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.270453 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.270426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-token\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.270453 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.270447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58cm7\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-kube-api-access-58cm7\") pod \"e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") " pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.415518 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.415442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:13.553954 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.553927    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"]
Aug 04 16:43:13.555376 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:43:13.555352    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a60fd2_0182_4640_b888_92895fcf2b31.slice/crio-029fa7f43111570e1cba67eb4e70b3599429e04dc6497eef8e567eb282b65e3e WatchSource:0}: Error finding container 029fa7f43111570e1cba67eb4e70b3599429e04dc6497eef8e567eb282b65e3e: Status 404 returned error can't find the container with id 029fa7f43111570e1cba67eb4e70b3599429e04dc6497eef8e567eb282b65e3e
Aug 04 16:43:13.557545 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.557509    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:43:13.557625 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.557578    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:43:13.557625 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:13.557606    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:43:14.204616 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:14.204578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" event={"ID":"f5a60fd2-0182-4640-b888-92895fcf2b31","Type":"ContainerStarted","Data":"87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060"}
Aug 04 16:43:14.204813 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:14.204641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" event={"ID":"f5a60fd2-0182-4640-b888-92895fcf2b31","Type":"ContainerStarted","Data":"029fa7f43111570e1cba67eb4e70b3599429e04dc6497eef8e567eb282b65e3e"}
Aug 04 16:43:14.225927 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:14.225843    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" podStartSLOduration=1.22582462 podStartE2EDuration="1.22582462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:43:14.225048469 +0000 UTC m=+2475.051745960" watchObservedRunningTime="2026-08-04 16:43:14.22582462 +0000 UTC m=+2475.052522093"
Aug 04 16:43:14.415988 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:14.415955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:14.421127 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:14.421099    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:15.210152 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:15.210119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:15.210923 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:15.210886    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:16.181025 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:16.180987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:16.279130 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:16.279094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:17.284153 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.284111    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"]
Aug 04 16:43:17.287876 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.287851    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.289652 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.289630    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6c210e-serving-cert\""
Aug 04 16:43:17.299467 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.299435    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"]
Aug 04 16:43:17.322576 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.322549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:17.402177 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.402144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.402339 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.402211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59hfd\" (UniqueName: \"kubernetes.io/projected/4260c3a3-be7b-4ae6-ad65-6d8a572af957-kube-api-access-59hfd\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.402339 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.402241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4260c3a3-be7b-4ae6-ad65-6d8a572af957-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.502758 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.502725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.502958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.502776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59hfd\" (UniqueName: \"kubernetes.io/projected/4260c3a3-be7b-4ae6-ad65-6d8a572af957-kube-api-access-59hfd\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.502958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.502800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4260c3a3-be7b-4ae6-ad65-6d8a572af957-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.502958 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:43:17.502888    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-serving-cert: secret "maas-api-e2e-inf-a-6c210e-serving-cert" not found
Aug 04 16:43:17.503096 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:43:17.502997    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls podName:4260c3a3-be7b-4ae6-ad65-6d8a572af957 nodeName:}" failed. No retries permitted until 2026-08-04 16:43:18.00297983 +0000 UTC m=+2478.829677280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls") pod "maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb" (UID: "4260c3a3-be7b-4ae6-ad65-6d8a572af957") : secret "maas-api-e2e-inf-a-6c210e-serving-cert" not found
Aug 04 16:43:17.503501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.503478    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4260c3a3-be7b-4ae6-ad65-6d8a572af957-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.513157 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.513138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59hfd\" (UniqueName: \"kubernetes.io/projected/4260c3a3-be7b-4ae6-ad65-6d8a572af957-kube-api-access-59hfd\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:17.669996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.669922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:17.921033 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:17.920932    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:18.007433 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.007398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:18.010062 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.010037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls\") pod \"maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:18.020991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.020960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:18.069503 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.069475    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"]
Aug 04 16:43:18.073273 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.073253    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:18.075470 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.075450    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-6c210e\""
Aug 04 16:43:18.075470 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.075462    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-6c210e-dockercfg-xzwzv\""
Aug 04 16:43:18.085960 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.085934    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"]
Aug 04 16:43:18.102728 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.102702    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"]
Aug 04 16:43:18.106151 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.106137    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:18.119154 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.119128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"]
Aug 04 16:43:18.202289 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.202204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:18.209466 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.209438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprmf\" (UniqueName: \"kubernetes.io/projected/3a12ed29-857b-4b1e-a3f5-1ee349043675-kube-api-access-fprmf\") pod \"payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b\" (UID: \"3a12ed29-857b-4b1e-a3f5-1ee349043675\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:18.209603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.209488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87a920fc-389c-44d6-8580-d00222683b09-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58\" (UID: \"87a920fc-389c-44d6-8580-d00222683b09\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:18.209603 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.209575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsglt\" (UniqueName: \"kubernetes.io/projected/87a920fc-389c-44d6-8580-d00222683b09-kube-api-access-dsglt\") pod \"payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58\" (UID: \"87a920fc-389c-44d6-8580-d00222683b09\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:18.209736 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.209669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a12ed29-857b-4b1e-a3f5-1ee349043675-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b\" (UID: \"3a12ed29-857b-4b1e-a3f5-1ee349043675\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:18.310476 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.310441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a12ed29-857b-4b1e-a3f5-1ee349043675-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b\" (UID: \"3a12ed29-857b-4b1e-a3f5-1ee349043675\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:18.310948 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.310507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprmf\" (UniqueName: \"kubernetes.io/projected/3a12ed29-857b-4b1e-a3f5-1ee349043675-kube-api-access-fprmf\") pod \"payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b\" (UID: \"3a12ed29-857b-4b1e-a3f5-1ee349043675\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:18.310948 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.310539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87a920fc-389c-44d6-8580-d00222683b09-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58\" (UID: \"87a920fc-389c-44d6-8580-d00222683b09\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:18.310948 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.310592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsglt\" (UniqueName: \"kubernetes.io/projected/87a920fc-389c-44d6-8580-d00222683b09-kube-api-access-dsglt\") pod \"payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58\" (UID: \"87a920fc-389c-44d6-8580-d00222683b09\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:18.311380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.311354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a12ed29-857b-4b1e-a3f5-1ee349043675-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b\" (UID: \"3a12ed29-857b-4b1e-a3f5-1ee349043675\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:18.311491 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.311475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87a920fc-389c-44d6-8580-d00222683b09-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58\" (UID: \"87a920fc-389c-44d6-8580-d00222683b09\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:18.318370 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.318327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsglt\" (UniqueName: \"kubernetes.io/projected/87a920fc-389c-44d6-8580-d00222683b09-kube-api-access-dsglt\") pod \"payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58\" (UID: \"87a920fc-389c-44d6-8580-d00222683b09\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:18.319691 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.319664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprmf\" (UniqueName: \"kubernetes.io/projected/3a12ed29-857b-4b1e-a3f5-1ee349043675-kube-api-access-fprmf\") pod \"payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b\" (UID: \"3a12ed29-857b-4b1e-a3f5-1ee349043675\") " pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:18.352357 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.352333    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"]
Aug 04 16:43:18.354674 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:43:18.354643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4260c3a3_be7b_4ae6_ad65_6d8a572af957.slice/crio-0e6de700e06eecdb062349987aa420f016f45e1b3bffe99539c41fb29f3eaee7 WatchSource:0}: Error finding container 0e6de700e06eecdb062349987aa420f016f45e1b3bffe99539c41fb29f3eaee7: Status 404 returned error can't find the container with id 0e6de700e06eecdb062349987aa420f016f45e1b3bffe99539c41fb29f3eaee7
Aug 04 16:43:18.386159 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.386118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:18.417954 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.417898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:18.543849 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.543817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"]
Aug 04 16:43:18.546533 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:43:18.546443    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a12ed29_857b_4b1e_a3f5_1ee349043675.slice/crio-7b81abf7b40b32d3012537190f1377200e54ea12eccae644844c4c8c15ea2d7c WatchSource:0}: Error finding container 7b81abf7b40b32d3012537190f1377200e54ea12eccae644844c4c8c15ea2d7c: Status 404 returned error can't find the container with id 7b81abf7b40b32d3012537190f1377200e54ea12eccae644844c4c8c15ea2d7c
Aug 04 16:43:18.577102 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:18.575813    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"]
Aug 04 16:43:18.587106 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:43:18.587079    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a920fc_389c_44d6_8580_d00222683b09.slice/crio-fd45716cb8690d6e693b00ad0afa33b6a614ef83f32aed2d3d2462ff6bbc373a WatchSource:0}: Error finding container fd45716cb8690d6e693b00ad0afa33b6a614ef83f32aed2d3d2462ff6bbc373a: Status 404 returned error can't find the container with id fd45716cb8690d6e693b00ad0afa33b6a614ef83f32aed2d3d2462ff6bbc373a
Aug 04 16:43:19.235983 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.235878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb" event={"ID":"4260c3a3-be7b-4ae6-ad65-6d8a572af957","Type":"ContainerStarted","Data":"e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f"}
Aug 04 16:43:19.235983 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.235956    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb" event={"ID":"4260c3a3-be7b-4ae6-ad65-6d8a572af957","Type":"ContainerStarted","Data":"0e6de700e06eecdb062349987aa420f016f45e1b3bffe99539c41fb29f3eaee7"}
Aug 04 16:43:19.235983 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.235984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:19.237437 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.237399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58" event={"ID":"87a920fc-389c-44d6-8580-d00222683b09","Type":"ContainerStarted","Data":"3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e"}
Aug 04 16:43:19.237551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.237459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58" event={"ID":"87a920fc-389c-44d6-8580-d00222683b09","Type":"ContainerStarted","Data":"fd45716cb8690d6e693b00ad0afa33b6a614ef83f32aed2d3d2462ff6bbc373a"}
Aug 04 16:43:19.237551 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.237489    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:19.239299 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.239273    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b" event={"ID":"3a12ed29-857b-4b1e-a3f5-1ee349043675","Type":"ContainerStarted","Data":"c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650"}
Aug 04 16:43:19.239404 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.239314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b" event={"ID":"3a12ed29-857b-4b1e-a3f5-1ee349043675","Type":"ContainerStarted","Data":"7b81abf7b40b32d3012537190f1377200e54ea12eccae644844c4c8c15ea2d7c"}
Aug 04 16:43:19.239404 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.239363    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:19.256829 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.256782    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb" podStartSLOduration=1.822017062 podStartE2EDuration="2.256769146s" totalImagesPullingTime="434.752084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:43:19.254107221 +0000 UTC m=+2480.080804695" watchObservedRunningTime="2026-08-04 16:43:19.256769146 +0000 UTC m=+2480.083466618"
Aug 04 16:43:19.296420 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.296364    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b" podStartSLOduration=1.296344872 podStartE2EDuration="1.296344872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:43:19.295668337 +0000 UTC m=+2480.122365810" watchObservedRunningTime="2026-08-04 16:43:19.296344872 +0000 UTC m=+2480.123042346"
Aug 04 16:43:19.298036 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:19.297998    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58" podStartSLOduration=1.297985899 podStartE2EDuration="1.297985899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:43:19.27943386 +0000 UTC m=+2480.106131326" watchObservedRunningTime="2026-08-04 16:43:19.297985899 +0000 UTC m=+2480.124683371"
Aug 04 16:43:23.216324 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:23.216282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:25.250797 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:25.250767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:43:29.315996 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:29.315947    2563 generic.go:356] "Generic (PLEG): container finished" podID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerID="87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060" exitCode=0
Aug 04 16:43:29.316422 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:29.316019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" event={"ID":"f5a60fd2-0182-4640-b888-92895fcf2b31","Type":"ContainerDied","Data":"87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060"}
Aug 04 16:43:29.316422 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:29.316368    2563 scope.go:117] "RemoveContainer" containerID="87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060"
Aug 04 16:43:29.317323 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:29.317297    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:43:29.317382 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:29.317362    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:43:29.317471 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:29.317402    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:43:30.210385 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:30.210336    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:30.248010 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:30.247987    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:43:30.248187 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:30.248048    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:43:30.325661 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:30.325625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" event={"ID":"f5a60fd2-0182-4640-b888-92895fcf2b31","Type":"ContainerStarted","Data":"df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79"}
Aug 04 16:43:30.416047 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:30.416016    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:30.417332 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:30.417305    2563 patch_prober.go:28] interesting pod/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Aug 04 16:43:30.417481 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:30.417373    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Aug 04 16:43:31.416252 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:31.416217    2563 patch_prober.go:28] interesting pod/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Aug 04 16:43:31.416631 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:31.416283    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Aug 04 16:43:32.416339 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:32.416304    2563 patch_prober.go:28] interesting pod/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Aug 04 16:43:32.416726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:32.416375    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Aug 04 16:43:33.416766 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:33.416727    2563 patch_prober.go:28] interesting pod/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Aug 04 16:43:33.417181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:33.416802    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Aug 04 16:43:34.416686 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:34.416650    2563 patch_prober.go:28] interesting pod/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Aug 04 16:43:34.416867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:34.416704    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Aug 04 16:43:35.420544 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:35.420510    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:35.420958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:35.420878    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:35.421699 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:35.421683    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:43:41.275444 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:41.275370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:41.688767 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:41.688678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:42.990626 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:42.990590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:43.052381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:43.052324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:45.284839 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:45.284805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:45.386897 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:45.386848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:46.358251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.358217    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"]
Aug 04 16:43:46.361877 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.361852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.363744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.363721    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-19c94c-serving-cert\""
Aug 04 16:43:46.372842 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.372809    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"]
Aug 04 16:43:46.387177 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.387142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.387322 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.387289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wff5l\" (UniqueName: \"kubernetes.io/projected/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-kube-api-access-wff5l\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.387418 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.387400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.388969 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.388938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:46.488342 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.488312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.488526 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.488394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.488526 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.488446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wff5l\" (UniqueName: \"kubernetes.io/projected/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-kube-api-access-wff5l\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.488526 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:43:46.488465    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-serving-cert: secret "maas-api-e2e-inf-b-19c94c-serving-cert" not found
Aug 04 16:43:46.488712 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:43:46.488541    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls podName:d8bdf630-bd5e-47b9-9213-46eaee4a00f4 nodeName:}" failed. No retries permitted until 2026-08-04 16:43:46.988525003 +0000 UTC m=+2507.815222453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls") pod "maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9" (UID: "d8bdf630-bd5e-47b9-9213-46eaee4a00f4") : secret "maas-api-e2e-inf-b-19c94c-serving-cert" not found
Aug 04 16:43:46.489104 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.489081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.500488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.500463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wff5l\" (UniqueName: \"kubernetes.io/projected/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-kube-api-access-wff5l\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.857052 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.857011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:46.953766 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.953708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:46.994121 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.994087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:46.996580 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:46.996549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:47.026091 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.026062    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"]
Aug 04 16:43:47.029969 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.029942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:47.032207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.032190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-19c94c-dockercfg-chpsn\""
Aug 04 16:43:47.032307 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.032193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-19c94c\""
Aug 04 16:43:47.033596 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.033576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:43:47.040773 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.040747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"]
Aug 04 16:43:47.043974 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.043951    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"]
Aug 04 16:43:47.047333 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.047314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:47.055999 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.055967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"]
Aug 04 16:43:47.095492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.095462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5108f07d-8720-4aea-9e47-3f8a22a62543-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7\" (UID: \"5108f07d-8720-4aea-9e47-3f8a22a62543\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:47.095661 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.095501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8vw\" (UniqueName: \"kubernetes.io/projected/4515fad3-8c3e-4b19-b830-4e129eddeb8c-kube-api-access-cb8vw\") pod \"payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws\" (UID: \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:47.095661 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.095537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vz7c\" (UniqueName: \"kubernetes.io/projected/5108f07d-8720-4aea-9e47-3f8a22a62543-kube-api-access-7vz7c\") pod \"payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7\" (UID: \"5108f07d-8720-4aea-9e47-3f8a22a62543\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:47.095756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.095655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4515fad3-8c3e-4b19-b830-4e129eddeb8c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws\" (UID: \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:47.196726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.196645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4515fad3-8c3e-4b19-b830-4e129eddeb8c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws\" (UID: \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:47.196726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.196702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5108f07d-8720-4aea-9e47-3f8a22a62543-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7\" (UID: \"5108f07d-8720-4aea-9e47-3f8a22a62543\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:47.196946 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.196729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8vw\" (UniqueName: \"kubernetes.io/projected/4515fad3-8c3e-4b19-b830-4e129eddeb8c-kube-api-access-cb8vw\") pod \"payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws\" (UID: \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:47.196946 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.196760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vz7c\" (UniqueName: \"kubernetes.io/projected/5108f07d-8720-4aea-9e47-3f8a22a62543-kube-api-access-7vz7c\") pod \"payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7\" (UID: \"5108f07d-8720-4aea-9e47-3f8a22a62543\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:47.197642 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.197618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4515fad3-8c3e-4b19-b830-4e129eddeb8c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws\" (UID: \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:47.197752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.197618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5108f07d-8720-4aea-9e47-3f8a22a62543-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7\" (UID: \"5108f07d-8720-4aea-9e47-3f8a22a62543\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:47.205102 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.205075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8vw\" (UniqueName: \"kubernetes.io/projected/4515fad3-8c3e-4b19-b830-4e129eddeb8c-kube-api-access-cb8vw\") pod \"payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws\" (UID: \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:47.205185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.205079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vz7c\" (UniqueName: \"kubernetes.io/projected/5108f07d-8720-4aea-9e47-3f8a22a62543-kube-api-access-7vz7c\") pod \"payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7\" (UID: \"5108f07d-8720-4aea-9e47-3f8a22a62543\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:47.275329 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.275301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:47.342780 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.342739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:47.361222 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.361198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:47.439601 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.439539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"]
Aug 04 16:43:47.441836 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:43:47.441796    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8bdf630_bd5e_47b9_9213_46eaee4a00f4.slice/crio-faff75d707449eae55543d116dd3c9c1bf3ec537b4d43a8f9a13d055cf083d0d WatchSource:0}: Error finding container faff75d707449eae55543d116dd3c9c1bf3ec537b4d43a8f9a13d055cf083d0d: Status 404 returned error can't find the container with id faff75d707449eae55543d116dd3c9c1bf3ec537b4d43a8f9a13d055cf083d0d
Aug 04 16:43:47.512300 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.512272    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"]
Aug 04 16:43:47.512421 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:43:47.512275    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5108f07d_8720_4aea_9e47_3f8a22a62543.slice/crio-122248d481c66a422bf148876dc509713cf7d59d2582bf6b683caaea4ba0ec4f WatchSource:0}: Error finding container 122248d481c66a422bf148876dc509713cf7d59d2582bf6b683caaea4ba0ec4f: Status 404 returned error can't find the container with id 122248d481c66a422bf148876dc509713cf7d59d2582bf6b683caaea4ba0ec4f
Aug 04 16:43:47.749684 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:47.749657    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"]
Aug 04 16:43:47.751135 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:43:47.751094    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4515fad3_8c3e_4b19_b830_4e129eddeb8c.slice/crio-5fd0b72e5b398df944851fc2c990eaa2844d2c6f0ff023058e4ef79e0e6678fd WatchSource:0}: Error finding container 5fd0b72e5b398df944851fc2c990eaa2844d2c6f0ff023058e4ef79e0e6678fd: Status 404 returned error can't find the container with id 5fd0b72e5b398df944851fc2c990eaa2844d2c6f0ff023058e4ef79e0e6678fd
Aug 04 16:43:48.446678 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.446643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7" event={"ID":"5108f07d-8720-4aea-9e47-3f8a22a62543","Type":"ContainerStarted","Data":"dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55"}
Aug 04 16:43:48.447135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.446706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7" event={"ID":"5108f07d-8720-4aea-9e47-3f8a22a62543","Type":"ContainerStarted","Data":"122248d481c66a422bf148876dc509713cf7d59d2582bf6b683caaea4ba0ec4f"}
Aug 04 16:43:48.447135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.446823    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:48.448196 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.448177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9" event={"ID":"d8bdf630-bd5e-47b9-9213-46eaee4a00f4","Type":"ContainerStarted","Data":"6419a05f4fddee3a2ea232ccae82f56461699ca5b449e0283eb0f6680f20f684"}
Aug 04 16:43:48.448310 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.448214    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:48.448310 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.448234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9" event={"ID":"d8bdf630-bd5e-47b9-9213-46eaee4a00f4","Type":"ContainerStarted","Data":"faff75d707449eae55543d116dd3c9c1bf3ec537b4d43a8f9a13d055cf083d0d"}
Aug 04 16:43:48.449631 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.449608    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws" event={"ID":"4515fad3-8c3e-4b19-b830-4e129eddeb8c","Type":"ContainerStarted","Data":"6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff"}
Aug 04 16:43:48.449734 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.449651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws" event={"ID":"4515fad3-8c3e-4b19-b830-4e129eddeb8c","Type":"ContainerStarted","Data":"5fd0b72e5b398df944851fc2c990eaa2844d2c6f0ff023058e4ef79e0e6678fd"}
Aug 04 16:43:48.449734 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.449679    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:43:48.462288 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.462244    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7" podStartSLOduration=1.462231054 podStartE2EDuration="1.462231054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:43:48.460822017 +0000 UTC m=+2509.287519593" watchObservedRunningTime="2026-08-04 16:43:48.462231054 +0000 UTC m=+2509.288928526"
Aug 04 16:43:48.480328 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.480281    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws" podStartSLOduration=1.480263249 podStartE2EDuration="1.480263249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:43:48.476755712 +0000 UTC m=+2509.303453197" watchObservedRunningTime="2026-08-04 16:43:48.480263249 +0000 UTC m=+2509.306960723"
Aug 04 16:43:48.494602 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:48.494555    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9" podStartSLOduration=2.012452944 podStartE2EDuration="2.494539971s" totalImagesPullingTime="482.087027ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:43:48.492839017 +0000 UTC m=+2509.319536492" watchObservedRunningTime="2026-08-04 16:43:48.494539971 +0000 UTC m=+2509.321237483"
Aug 04 16:43:54.467888 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:54.467813    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:43:59.464572 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:59.464535    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:43:59.465064 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:43:59.464981    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:44:10.372097 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:44:10.372063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:44:28.156315 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:44:28.156274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:44:40.846134 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:44:40.846101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:44:58.333190 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:44:58.333149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:40.523641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:40.523553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:41.467058 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:41.466985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:51.923451 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:51.923416    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:52.179282 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.179192    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"]
Aug 04 16:45:52.179450 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.179397    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb" podUID="4260c3a3-be7b-4ae6-ad65-6d8a572af957" containerName="maas-api" containerID="cri-o://e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f" gracePeriod=30
Aug 04 16:45:52.214414 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.214387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:52.238858 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.238828    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"]
Aug 04 16:45:52.239291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.239155    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b" podUID="3a12ed29-857b-4b1e-a3f5-1ee349043675" containerName="payload-processing" containerID="cri-o://c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650" gracePeriod=30
Aug 04 16:45:52.243525 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.243498    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"]
Aug 04 16:45:52.243726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.243700    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58" podUID="87a920fc-389c-44d6-8580-d00222683b09" containerName="payload-pre-processing" containerID="cri-o://3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e" gracePeriod=30
Aug 04 16:45:52.315547 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.315510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:52.406381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.406199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:52.468337 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.468308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:52.527296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.527271    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:45:52.555286 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.555264    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:45:52.561632 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.561611    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:45:52.616622 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.616583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a12ed29-857b-4b1e-a3f5-1ee349043675-plugins-config-volume\") pod \"3a12ed29-857b-4b1e-a3f5-1ee349043675\" (UID: \"3a12ed29-857b-4b1e-a3f5-1ee349043675\") "
Aug 04 16:45:52.616775 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.616710    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fprmf\" (UniqueName: \"kubernetes.io/projected/3a12ed29-857b-4b1e-a3f5-1ee349043675-kube-api-access-fprmf\") pod \"3a12ed29-857b-4b1e-a3f5-1ee349043675\" (UID: \"3a12ed29-857b-4b1e-a3f5-1ee349043675\") "
Aug 04 16:45:52.617010 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.616982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a12ed29-857b-4b1e-a3f5-1ee349043675-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a12ed29-857b-4b1e-a3f5-1ee349043675" (UID: "3a12ed29-857b-4b1e-a3f5-1ee349043675"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:45:52.618991 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.618968    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a12ed29-857b-4b1e-a3f5-1ee349043675-kube-api-access-fprmf" (OuterVolumeSpecName: "kube-api-access-fprmf") pod "3a12ed29-857b-4b1e-a3f5-1ee349043675" (UID: "3a12ed29-857b-4b1e-a3f5-1ee349043675"). InnerVolumeSpecName "kube-api-access-fprmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:45:52.717361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717288    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls\") pod \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") "
Aug 04 16:45:52.717361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717344    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4260c3a3-be7b-4ae6-ad65-6d8a572af957-openshift-service-ca\") pod \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") "
Aug 04 16:45:52.717569 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717388    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsglt\" (UniqueName: \"kubernetes.io/projected/87a920fc-389c-44d6-8580-d00222683b09-kube-api-access-dsglt\") pod \"87a920fc-389c-44d6-8580-d00222683b09\" (UID: \"87a920fc-389c-44d6-8580-d00222683b09\") "
Aug 04 16:45:52.717569 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717412    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59hfd\" (UniqueName: \"kubernetes.io/projected/4260c3a3-be7b-4ae6-ad65-6d8a572af957-kube-api-access-59hfd\") pod \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\" (UID: \"4260c3a3-be7b-4ae6-ad65-6d8a572af957\") "
Aug 04 16:45:52.717569 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717444    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87a920fc-389c-44d6-8580-d00222683b09-plugins-config-volume\") pod \"87a920fc-389c-44d6-8580-d00222683b09\" (UID: \"87a920fc-389c-44d6-8580-d00222683b09\") "
Aug 04 16:45:52.717758 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717739    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a12ed29-857b-4b1e-a3f5-1ee349043675-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:45:52.717822 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717750    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4260c3a3-be7b-4ae6-ad65-6d8a572af957-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4260c3a3-be7b-4ae6-ad65-6d8a572af957" (UID: "4260c3a3-be7b-4ae6-ad65-6d8a572af957"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:45:52.717822 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717764    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fprmf\" (UniqueName: \"kubernetes.io/projected/3a12ed29-857b-4b1e-a3f5-1ee349043675-kube-api-access-fprmf\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:45:52.717900 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.717850    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a920fc-389c-44d6-8580-d00222683b09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87a920fc-389c-44d6-8580-d00222683b09" (UID: "87a920fc-389c-44d6-8580-d00222683b09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:45:52.719462 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.719440    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4260c3a3-be7b-4ae6-ad65-6d8a572af957" (UID: "4260c3a3-be7b-4ae6-ad65-6d8a572af957"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:45:52.719569 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.719548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a920fc-389c-44d6-8580-d00222683b09-kube-api-access-dsglt" (OuterVolumeSpecName: "kube-api-access-dsglt") pod "87a920fc-389c-44d6-8580-d00222683b09" (UID: "87a920fc-389c-44d6-8580-d00222683b09"). InnerVolumeSpecName "kube-api-access-dsglt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:45:52.719614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.719570    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4260c3a3-be7b-4ae6-ad65-6d8a572af957-kube-api-access-59hfd" (OuterVolumeSpecName: "kube-api-access-59hfd") pod "4260c3a3-be7b-4ae6-ad65-6d8a572af957" (UID: "4260c3a3-be7b-4ae6-ad65-6d8a572af957"). InnerVolumeSpecName "kube-api-access-59hfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:45:52.818752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.818723    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87a920fc-389c-44d6-8580-d00222683b09-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:45:52.818752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.818747    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4260c3a3-be7b-4ae6-ad65-6d8a572af957-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:45:52.818752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.818757    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4260c3a3-be7b-4ae6-ad65-6d8a572af957-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:45:52.818970 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.818765    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsglt\" (UniqueName: \"kubernetes.io/projected/87a920fc-389c-44d6-8580-d00222683b09-kube-api-access-dsglt\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:45:52.818970 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.818774    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59hfd\" (UniqueName: \"kubernetes.io/projected/4260c3a3-be7b-4ae6-ad65-6d8a572af957-kube-api-access-59hfd\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:45:52.819433 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:52.819407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:53.211484 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.211453    2563 generic.go:356] "Generic (PLEG): container finished" podID="4260c3a3-be7b-4ae6-ad65-6d8a572af957" containerID="e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f" exitCode=0
Aug 04 16:45:53.211874 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.211520    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"
Aug 04 16:45:53.211874 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.211551    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb" event={"ID":"4260c3a3-be7b-4ae6-ad65-6d8a572af957","Type":"ContainerDied","Data":"e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f"}
Aug 04 16:45:53.211874 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.211617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb" event={"ID":"4260c3a3-be7b-4ae6-ad65-6d8a572af957","Type":"ContainerDied","Data":"0e6de700e06eecdb062349987aa420f016f45e1b3bffe99539c41fb29f3eaee7"}
Aug 04 16:45:53.211874 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.211647    2563 scope.go:117] "RemoveContainer" containerID="e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f"
Aug 04 16:45:53.213162 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.212843    2563 generic.go:356] "Generic (PLEG): container finished" podID="87a920fc-389c-44d6-8580-d00222683b09" containerID="3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e" exitCode=0
Aug 04 16:45:53.213162 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.212896    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"
Aug 04 16:45:53.213162 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.212931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58" event={"ID":"87a920fc-389c-44d6-8580-d00222683b09","Type":"ContainerDied","Data":"3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e"}
Aug 04 16:45:53.213162 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.212986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58" event={"ID":"87a920fc-389c-44d6-8580-d00222683b09","Type":"ContainerDied","Data":"fd45716cb8690d6e693b00ad0afa33b6a614ef83f32aed2d3d2462ff6bbc373a"}
Aug 04 16:45:53.214389 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.214366    2563 generic.go:356] "Generic (PLEG): container finished" podID="3a12ed29-857b-4b1e-a3f5-1ee349043675" containerID="c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650" exitCode=0
Aug 04 16:45:53.214492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.214395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b" event={"ID":"3a12ed29-857b-4b1e-a3f5-1ee349043675","Type":"ContainerDied","Data":"c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650"}
Aug 04 16:45:53.214492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.214445    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"
Aug 04 16:45:53.214492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.214447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b" event={"ID":"3a12ed29-857b-4b1e-a3f5-1ee349043675","Type":"ContainerDied","Data":"7b81abf7b40b32d3012537190f1377200e54ea12eccae644844c4c8c15ea2d7c"}
Aug 04 16:45:53.223477 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.223456    2563 scope.go:117] "RemoveContainer" containerID="e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f"
Aug 04 16:45:53.223800 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:45:53.223760    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f\": container with ID starting with e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f not found: ID does not exist" containerID="e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f"
Aug 04 16:45:53.223878 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.223809    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f"} err="failed to get container status \"e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f\": rpc error: code = NotFound desc = could not find container \"e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f\": container with ID starting with e9b315beb47c94dee168859763f1e137d9de055464be1e9e593d60378b92ab9f not found: ID does not exist"
Aug 04 16:45:53.223878 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.223834    2563 scope.go:117] "RemoveContainer" containerID="3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e"
Aug 04 16:45:53.232395 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.232380    2563 scope.go:117] "RemoveContainer" containerID="3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e"
Aug 04 16:45:53.232636 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:45:53.232618    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e\": container with ID starting with 3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e not found: ID does not exist" containerID="3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e"
Aug 04 16:45:53.232695 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.232642    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e"} err="failed to get container status \"3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e\": rpc error: code = NotFound desc = could not find container \"3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e\": container with ID starting with 3a5a698f3962a49e9fdfd5aa56c6fe36de63a476ef89629f0c388231aefa4e9e not found: ID does not exist"
Aug 04 16:45:53.232695 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.232658    2563 scope.go:117] "RemoveContainer" containerID="c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650"
Aug 04 16:45:53.239049 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.239028    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"]
Aug 04 16:45:53.241307 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.241289    2563 scope.go:117] "RemoveContainer" containerID="c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650"
Aug 04 16:45:53.241568 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:45:53.241539    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650\": container with ID starting with c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650 not found: ID does not exist" containerID="c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650"
Aug 04 16:45:53.241625 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.241578    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650"} err="failed to get container status \"c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650\": rpc error: code = NotFound desc = could not find container \"c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650\": container with ID starting with c35511bd63b891a76d7857030e02c2a1807fa9e89f85d70ce7c187ddec375650 not found: ID does not exist"
Aug 04 16:45:53.242876 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.242859    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6c210e-85465bc9b8-h2dsb"]
Aug 04 16:45:53.251716 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.251698    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"]
Aug 04 16:45:53.255364 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.255344    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6c210e-c584d89d4-m4v58"]
Aug 04 16:45:53.266007 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.265975    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"]
Aug 04 16:45:53.268260 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.268240    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-6c210e-65dc847848-n7x6b"]
Aug 04 16:45:53.717850 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.717817    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a12ed29-857b-4b1e-a3f5-1ee349043675" path="/var/lib/kubelet/pods/3a12ed29-857b-4b1e-a3f5-1ee349043675/volumes"
Aug 04 16:45:53.718248 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.718234    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4260c3a3-be7b-4ae6-ad65-6d8a572af957" path="/var/lib/kubelet/pods/4260c3a3-be7b-4ae6-ad65-6d8a572af957/volumes"
Aug 04 16:45:53.718550 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:53.718537    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87a920fc-389c-44d6-8580-d00222683b09" path="/var/lib/kubelet/pods/87a920fc-389c-44d6-8580-d00222683b09/volumes"
Aug 04 16:45:58.937709 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:58.937678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:59.038427 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:59.038399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:59.199089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:59.199005    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"]
Aug 04 16:45:59.199278 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:59.199253    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy" containerID="cri-o://df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79" gracePeriod=30
Aug 04 16:45:59.219467 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:59.219443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:45:59.491498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:45:59.491466    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:04.451918 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.451877    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:46:04.517500 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517469    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-socket\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.517669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517511    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-credential-socket\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.517669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517547    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-podinfo\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.517669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517569    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-data\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.517669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517586    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-certs\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.517669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517622    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5a60fd2-0182-4640-b888-92895fcf2b31-istiod-ca-cert\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.517669 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517637    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-token\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.518000 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517686    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-envoy\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.518000 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517729    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:04.518000 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517791    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:04.518000 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517808    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58cm7\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-kube-api-access-58cm7\") pod \"f5a60fd2-0182-4640-b888-92895fcf2b31\" (UID: \"f5a60fd2-0182-4640-b888-92895fcf2b31\") "
Aug 04 16:46:04.518000 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.517964    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:04.518256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.518091    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-data" (OuterVolumeSpecName: "istio-data") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:04.518256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.518248    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:04.518368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.518268    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:04.518368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.518283    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:04.518368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.518296    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:04.518579 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.518555    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5a60fd2-0182-4640-b888-92895fcf2b31-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:46:04.520053 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.520032    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:46:04.520159 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.520103    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-kube-api-access-58cm7" (OuterVolumeSpecName: "kube-api-access-58cm7") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "kube-api-access-58cm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:46:04.520432 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.520415    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:04.520478 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.520428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-token" (OuterVolumeSpecName: "istio-token") pod "f5a60fd2-0182-4640-b888-92895fcf2b31" (UID: "f5a60fd2-0182-4640-b888-92895fcf2b31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:46:04.618968 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.618934    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:04.618968 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.618966    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58cm7\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-kube-api-access-58cm7\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:04.619178 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.618979    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:04.619178 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.618988    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5a60fd2-0182-4640-b888-92895fcf2b31-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:04.619178 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:04.618995    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a60fd2-0182-4640-b888-92895fcf2b31-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:05.287482 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.287445    2563 generic.go:356] "Generic (PLEG): container finished" podID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerID="df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79" exitCode=0
Aug 04 16:46:05.287675 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.287494    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"
Aug 04 16:46:05.287675 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.287531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" event={"ID":"f5a60fd2-0182-4640-b888-92895fcf2b31","Type":"ContainerDied","Data":"df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79"}
Aug 04 16:46:05.287675 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.287580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2" event={"ID":"f5a60fd2-0182-4640-b888-92895fcf2b31","Type":"ContainerDied","Data":"029fa7f43111570e1cba67eb4e70b3599429e04dc6497eef8e567eb282b65e3e"}
Aug 04 16:46:05.287675 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.287602    2563 scope.go:117] "RemoveContainer" containerID="df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79"
Aug 04 16:46:05.297506 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.297490    2563 scope.go:117] "RemoveContainer" containerID="87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060"
Aug 04 16:46:05.305870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.305851    2563 scope.go:117] "RemoveContainer" containerID="df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79"
Aug 04 16:46:05.306194 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:46:05.306170    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79\": container with ID starting with df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79 not found: ID does not exist" containerID="df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79"
Aug 04 16:46:05.306290 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.306205    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79"} err="failed to get container status \"df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79\": rpc error: code = NotFound desc = could not find container \"df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79\": container with ID starting with df144ba7590d72b2de9dddb2aa4c192d0c8248fee5bf43c31d9575d589a4df79 not found: ID does not exist"
Aug 04 16:46:05.306290 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.306229    2563 scope.go:117] "RemoveContainer" containerID="87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060"
Aug 04 16:46:05.306531 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:46:05.306502    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060\": container with ID starting with 87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060 not found: ID does not exist" containerID="87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060"
Aug 04 16:46:05.306644 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.306546    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060"} err="failed to get container status \"87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060\": rpc error: code = NotFound desc = could not find container \"87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060\": container with ID starting with 87b796f987f9bf6111f3762c81e1994d65cd39f44354c1480b6c468017e24060 not found: ID does not exist"
Aug 04 16:46:05.309478 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.309456    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"]
Aug 04 16:46:05.312784 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.312764    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6c210e-openshift-default-79c6855848-ptjd2"]
Aug 04 16:46:05.717943 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:05.717837    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" path="/var/lib/kubelet/pods/f5a60fd2-0182-4640-b888-92895fcf2b31/volumes"
Aug 04 16:46:10.181796 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.181764    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"]
Aug 04 16:46:10.182556 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.182524    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9" podUID="d8bdf630-bd5e-47b9-9213-46eaee4a00f4" containerName="maas-api" containerID="cri-o://6419a05f4fddee3a2ea232ccae82f56461699ca5b449e0283eb0f6680f20f684" gracePeriod=30
Aug 04 16:46:10.210889 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.210867    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:10.233584 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.233551    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"]
Aug 04 16:46:10.233817 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.233787    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws" podUID="4515fad3-8c3e-4b19-b830-4e129eddeb8c" containerName="payload-processing" containerID="cri-o://6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff" gracePeriod=30
Aug 04 16:46:10.244723 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.244690    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"]
Aug 04 16:46:10.245032 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.244987    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7" podUID="5108f07d-8720-4aea-9e47-3f8a22a62543" containerName="payload-pre-processing" containerID="cri-o://dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55" gracePeriod=30
Aug 04 16:46:10.283342 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.283300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:10.317508 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.317478    2563 generic.go:356] "Generic (PLEG): container finished" podID="d8bdf630-bd5e-47b9-9213-46eaee4a00f4" containerID="6419a05f4fddee3a2ea232ccae82f56461699ca5b449e0283eb0f6680f20f684" exitCode=0
Aug 04 16:46:10.317649 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.317560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9" event={"ID":"d8bdf630-bd5e-47b9-9213-46eaee4a00f4","Type":"ContainerDied","Data":"6419a05f4fddee3a2ea232ccae82f56461699ca5b449e0283eb0f6680f20f684"}
Aug 04 16:46:10.377266 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.377224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:10.439404 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.439265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:10.523760 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.523735    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:46:10.538718 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.538691    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:46:10.553141 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.553120    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:46:10.567389 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls\") pod \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") "
Aug 04 16:46:10.567501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567400    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5108f07d-8720-4aea-9e47-3f8a22a62543-plugins-config-volume\") pod \"5108f07d-8720-4aea-9e47-3f8a22a62543\" (UID: \"5108f07d-8720-4aea-9e47-3f8a22a62543\") "
Aug 04 16:46:10.567501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567437    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb8vw\" (UniqueName: \"kubernetes.io/projected/4515fad3-8c3e-4b19-b830-4e129eddeb8c-kube-api-access-cb8vw\") pod \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\" (UID: \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\") "
Aug 04 16:46:10.567577 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4515fad3-8c3e-4b19-b830-4e129eddeb8c-plugins-config-volume\") pod \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\" (UID: \"4515fad3-8c3e-4b19-b830-4e129eddeb8c\") "
Aug 04 16:46:10.567626 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567601    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vz7c\" (UniqueName: \"kubernetes.io/projected/5108f07d-8720-4aea-9e47-3f8a22a62543-kube-api-access-7vz7c\") pod \"5108f07d-8720-4aea-9e47-3f8a22a62543\" (UID: \"5108f07d-8720-4aea-9e47-3f8a22a62543\") "
Aug 04 16:46:10.567681 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567645    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wff5l\" (UniqueName: \"kubernetes.io/projected/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-kube-api-access-wff5l\") pod \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") "
Aug 04 16:46:10.567738 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567687    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-openshift-service-ca\") pod \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\" (UID: \"d8bdf630-bd5e-47b9-9213-46eaee4a00f4\") "
Aug 04 16:46:10.568003 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567893    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5108f07d-8720-4aea-9e47-3f8a22a62543-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5108f07d-8720-4aea-9e47-3f8a22a62543" (UID: "5108f07d-8720-4aea-9e47-3f8a22a62543"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:46:10.568003 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.567966    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4515fad3-8c3e-4b19-b830-4e129eddeb8c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4515fad3-8c3e-4b19-b830-4e129eddeb8c" (UID: "4515fad3-8c3e-4b19-b830-4e129eddeb8c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:46:10.568171 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.568067    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5108f07d-8720-4aea-9e47-3f8a22a62543-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:10.568265 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.568227    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4515fad3-8c3e-4b19-b830-4e129eddeb8c-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:10.568331 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.568259    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d8bdf630-bd5e-47b9-9213-46eaee4a00f4" (UID: "d8bdf630-bd5e-47b9-9213-46eaee4a00f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:46:10.569896 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.569871    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d8bdf630-bd5e-47b9-9213-46eaee4a00f4" (UID: "d8bdf630-bd5e-47b9-9213-46eaee4a00f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:46:10.570327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.570307    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5108f07d-8720-4aea-9e47-3f8a22a62543-kube-api-access-7vz7c" (OuterVolumeSpecName: "kube-api-access-7vz7c") pod "5108f07d-8720-4aea-9e47-3f8a22a62543" (UID: "5108f07d-8720-4aea-9e47-3f8a22a62543"). InnerVolumeSpecName "kube-api-access-7vz7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:46:10.570432 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.570418    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4515fad3-8c3e-4b19-b830-4e129eddeb8c-kube-api-access-cb8vw" (OuterVolumeSpecName: "kube-api-access-cb8vw") pod "4515fad3-8c3e-4b19-b830-4e129eddeb8c" (UID: "4515fad3-8c3e-4b19-b830-4e129eddeb8c"). InnerVolumeSpecName "kube-api-access-cb8vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:46:10.570497 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.570433    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-kube-api-access-wff5l" (OuterVolumeSpecName: "kube-api-access-wff5l") pod "d8bdf630-bd5e-47b9-9213-46eaee4a00f4" (UID: "d8bdf630-bd5e-47b9-9213-46eaee4a00f4"). InnerVolumeSpecName "kube-api-access-wff5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:46:10.669385 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.669351    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb8vw\" (UniqueName: \"kubernetes.io/projected/4515fad3-8c3e-4b19-b830-4e129eddeb8c-kube-api-access-cb8vw\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:10.669385 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.669376    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vz7c\" (UniqueName: \"kubernetes.io/projected/5108f07d-8720-4aea-9e47-3f8a22a62543-kube-api-access-7vz7c\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:10.669385 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.669385    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wff5l\" (UniqueName: \"kubernetes.io/projected/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-kube-api-access-wff5l\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:10.669385 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.669394    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:10.669650 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.669403    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8bdf630-bd5e-47b9-9213-46eaee4a00f4-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:46:10.782730 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:10.782699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:11.324732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.324699    2563 generic.go:356] "Generic (PLEG): container finished" podID="5108f07d-8720-4aea-9e47-3f8a22a62543" containerID="dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55" exitCode=0
Aug 04 16:46:11.325209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.324748    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"
Aug 04 16:46:11.325209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.324788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7" event={"ID":"5108f07d-8720-4aea-9e47-3f8a22a62543","Type":"ContainerDied","Data":"dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55"}
Aug 04 16:46:11.325209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.324847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7" event={"ID":"5108f07d-8720-4aea-9e47-3f8a22a62543","Type":"ContainerDied","Data":"122248d481c66a422bf148876dc509713cf7d59d2582bf6b683caaea4ba0ec4f"}
Aug 04 16:46:11.325209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.324871    2563 scope.go:117] "RemoveContainer" containerID="dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55"
Aug 04 16:46:11.326276 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.326240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9" event={"ID":"d8bdf630-bd5e-47b9-9213-46eaee4a00f4","Type":"ContainerDied","Data":"faff75d707449eae55543d116dd3c9c1bf3ec537b4d43a8f9a13d055cf083d0d"}
Aug 04 16:46:11.326399 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.326241    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"
Aug 04 16:46:11.327675 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.327649    2563 generic.go:356] "Generic (PLEG): container finished" podID="4515fad3-8c3e-4b19-b830-4e129eddeb8c" containerID="6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff" exitCode=0
Aug 04 16:46:11.327789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.327687    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"
Aug 04 16:46:11.327789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.327739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws" event={"ID":"4515fad3-8c3e-4b19-b830-4e129eddeb8c","Type":"ContainerDied","Data":"6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff"}
Aug 04 16:46:11.327789 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.327785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws" event={"ID":"4515fad3-8c3e-4b19-b830-4e129eddeb8c","Type":"ContainerDied","Data":"5fd0b72e5b398df944851fc2c990eaa2844d2c6f0ff023058e4ef79e0e6678fd"}
Aug 04 16:46:11.335981 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.335966    2563 scope.go:117] "RemoveContainer" containerID="dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55"
Aug 04 16:46:11.336306 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:46:11.336287    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55\": container with ID starting with dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55 not found: ID does not exist" containerID="dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55"
Aug 04 16:46:11.336369 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.336314    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55"} err="failed to get container status \"dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55\": rpc error: code = NotFound desc = could not find container \"dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55\": container with ID starting with dcea586aa949975382ff5df0e7a21b4dd6b48e13b4fb1108282bbbb10dcb5c55 not found: ID does not exist"
Aug 04 16:46:11.336369 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.336332    2563 scope.go:117] "RemoveContainer" containerID="6419a05f4fddee3a2ea232ccae82f56461699ca5b449e0283eb0f6680f20f684"
Aug 04 16:46:11.345522 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.345460    2563 scope.go:117] "RemoveContainer" containerID="6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff"
Aug 04 16:46:11.348052 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.348033    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"]
Aug 04 16:46:11.351418 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.351395    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-19c94c-6bf785bffb-lhdx7"]
Aug 04 16:46:11.354440 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.354412    2563 scope.go:117] "RemoveContainer" containerID="6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff"
Aug 04 16:46:11.354692 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:46:11.354673    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff\": container with ID starting with 6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff not found: ID does not exist" containerID="6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff"
Aug 04 16:46:11.354754 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.354699    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff"} err="failed to get container status \"6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff\": rpc error: code = NotFound desc = could not find container \"6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff\": container with ID starting with 6b59293f30566fd6fe0f451a1d64063d2aa39d8ab500c81e9e5c4316c5ce86ff not found: ID does not exist"
Aug 04 16:46:11.360246 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.360228    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"]
Aug 04 16:46:11.364403 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.364383    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-19c94c-76f7464d98-zqwws"]
Aug 04 16:46:11.372953 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.372930    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"]
Aug 04 16:46:11.378895 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.378878    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-19c94c-68699d89d9-rfrm9"]
Aug 04 16:46:11.717595 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.717562    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4515fad3-8c3e-4b19-b830-4e129eddeb8c" path="/var/lib/kubelet/pods/4515fad3-8c3e-4b19-b830-4e129eddeb8c/volumes"
Aug 04 16:46:11.717936 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.717923    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5108f07d-8720-4aea-9e47-3f8a22a62543" path="/var/lib/kubelet/pods/5108f07d-8720-4aea-9e47-3f8a22a62543/volumes"
Aug 04 16:46:11.718268 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:11.718257    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8bdf630-bd5e-47b9-9213-46eaee4a00f4" path="/var/lib/kubelet/pods/d8bdf630-bd5e-47b9-9213-46eaee4a00f4/volumes"
Aug 04 16:46:16.595774 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:16.595706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:16.663038 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:16.662996    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:16.901742 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:16.901623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:17.128514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.128477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:17.487229 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.487197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:17.791330 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791296    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"]
Aug 04 16:46:17.791875 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791856    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4260c3a3-be7b-4ae6-ad65-6d8a572af957" containerName="maas-api"
Aug 04 16:46:17.791875 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791871    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4260c3a3-be7b-4ae6-ad65-6d8a572af957" containerName="maas-api"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791901    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bdf630-bd5e-47b9-9213-46eaee4a00f4" containerName="maas-api"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791927    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bdf630-bd5e-47b9-9213-46eaee4a00f4" containerName="maas-api"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791941    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a920fc-389c-44d6-8580-d00222683b09" containerName="payload-pre-processing"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791950    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a920fc-389c-44d6-8580-d00222683b09" containerName="payload-pre-processing"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791964    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791972    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.791981    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5108f07d-8720-4aea-9e47-3f8a22a62543" containerName="payload-pre-processing"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792014    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5108f07d-8720-4aea-9e47-3f8a22a62543" containerName="payload-pre-processing"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792035    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy"
Aug 04 16:46:17.792057 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792044    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792067    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4515fad3-8c3e-4b19-b830-4e129eddeb8c" containerName="payload-processing"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792076    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4515fad3-8c3e-4b19-b830-4e129eddeb8c" containerName="payload-processing"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792093    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a12ed29-857b-4b1e-a3f5-1ee349043675" containerName="payload-processing"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792100    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a12ed29-857b-4b1e-a3f5-1ee349043675" containerName="payload-processing"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792187    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5108f07d-8720-4aea-9e47-3f8a22a62543" containerName="payload-pre-processing"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792198    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8bdf630-bd5e-47b9-9213-46eaee4a00f4" containerName="maas-api"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792210    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4515fad3-8c3e-4b19-b830-4e129eddeb8c" containerName="payload-processing"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792222    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a12ed29-857b-4b1e-a3f5-1ee349043675" containerName="payload-processing"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792230    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792238    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a920fc-389c-44d6-8580-d00222683b09" containerName="payload-pre-processing"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792246    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4260c3a3-be7b-4ae6-ad65-6d8a572af957" containerName="maas-api"
Aug 04 16:46:17.792504 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.792254    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5a60fd2-0182-4640-b888-92895fcf2b31" containerName="istio-proxy"
Aug 04 16:46:17.797863 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.797844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.799700 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.799683    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-734f56-openshift-default-dockercfg-q8wmf\""
Aug 04 16:46:17.806132 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.806110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"]
Aug 04 16:46:17.817751 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.817720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:17.830089 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830064    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-data\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.830200 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-credential-socket\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.830200 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gltw4\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-kube-api-access-gltw4\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.830293 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-token\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.830331 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-socket\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.830378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-envoy\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.830429 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-certs\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.830480 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5f1e3e7-fc1b-419b-b116-d560f573b146-istiod-ca-cert\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.830537 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.830484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-podinfo\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.931953 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.931890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-socket\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.931980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-envoy\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-certs\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5f1e3e7-fc1b-419b-b116-d560f573b146-istiod-ca-cert\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-podinfo\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-data\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-credential-socket\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gltw4\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-kube-api-access-gltw4\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-token\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-socket\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932594 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-credential-socket\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932594 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-data\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932699 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-certs\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.932800 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.932782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5f1e3e7-fc1b-419b-b116-d560f573b146-istiod-ca-cert\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.934305 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.934281    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-envoy\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.934647 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.934628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-podinfo\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.940316 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.940295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-token\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:17.940443 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:17.940338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gltw4\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-kube-api-access-gltw4\") pod \"e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") " pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:18.098453 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.098375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:18.109458 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.109438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:18.254574 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.254548    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"]
Aug 04 16:46:18.256180 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:46:18.256155    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f1e3e7_fc1b_419b_b116_d560f573b146.slice/crio-4a98d60a49ccef880adf0ab25936caf271a40219cc3dec61f52314b69f8ce755 WatchSource:0}: Error finding container 4a98d60a49ccef880adf0ab25936caf271a40219cc3dec61f52314b69f8ce755: Status 404 returned error can't find the container with id 4a98d60a49ccef880adf0ab25936caf271a40219cc3dec61f52314b69f8ce755
Aug 04 16:46:18.258351 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.258314    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:46:18.258427 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.258406    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:46:18.258477 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.258460    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:46:18.378896 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.378795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" event={"ID":"f5f1e3e7-fc1b-419b-b116-d560f573b146","Type":"ContainerStarted","Data":"9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e"}
Aug 04 16:46:18.378896 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.378859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" event={"ID":"f5f1e3e7-fc1b-419b-b116-d560f573b146","Type":"ContainerStarted","Data":"4a98d60a49ccef880adf0ab25936caf271a40219cc3dec61f52314b69f8ce755"}
Aug 04 16:46:18.401381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:18.401297    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podStartSLOduration=1.401276494 podStartE2EDuration="1.401276494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:46:18.398528015 +0000 UTC m=+2659.225225488" watchObservedRunningTime="2026-08-04 16:46:18.401276494 +0000 UTC m=+2659.227973968"
Aug 04 16:46:19.110531 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:19.110495    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:19.115797 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:19.115773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:19.385631 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:19.385543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:19.386432 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:19.386414    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:20.345657 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:20.345625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:20.436149 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:20.436108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:21.435184 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.435149    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"]
Aug 04 16:46:21.440446 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.440419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.442219 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.442196    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-734f56-serving-cert\""
Aug 04 16:46:21.446712 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.446677    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"]
Aug 04 16:46:21.470129 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.470094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:21.567593 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.567558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c49dc6-ae3b-4a03-a555-f5487944a867-maas-api-tls\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.567769 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.567607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c49dc6-ae3b-4a03-a555-f5487944a867-openshift-service-ca\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.567769 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.567643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7vf\" (UniqueName: \"kubernetes.io/projected/b1c49dc6-ae3b-4a03-a555-f5487944a867-kube-api-access-rq7vf\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.652414 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.652373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:21.668684 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.668650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c49dc6-ae3b-4a03-a555-f5487944a867-maas-api-tls\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.668861 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.668695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c49dc6-ae3b-4a03-a555-f5487944a867-openshift-service-ca\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.668861 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.668725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7vf\" (UniqueName: \"kubernetes.io/projected/b1c49dc6-ae3b-4a03-a555-f5487944a867-kube-api-access-rq7vf\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.669475 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.669445    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c49dc6-ae3b-4a03-a555-f5487944a867-openshift-service-ca\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.671246 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.671227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c49dc6-ae3b-4a03-a555-f5487944a867-maas-api-tls\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.676000 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.675982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7vf\" (UniqueName: \"kubernetes.io/projected/b1c49dc6-ae3b-4a03-a555-f5487944a867-kube-api-access-rq7vf\") pod \"maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.755466 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.755428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:21.908641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.908609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"]
Aug 04 16:46:21.910231 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:46:21.910206    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c49dc6_ae3b_4a03_a555_f5487944a867.slice/crio-f3bed7123f27631b4c99d4cb8b25f5db7aad1bc95e853f2fa4badbf2ece9cac2 WatchSource:0}: Error finding container f3bed7123f27631b4c99d4cb8b25f5db7aad1bc95e853f2fa4badbf2ece9cac2: Status 404 returned error can't find the container with id f3bed7123f27631b4c99d4cb8b25f5db7aad1bc95e853f2fa4badbf2ece9cac2
Aug 04 16:46:21.911812 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:21.911790    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:46:22.001824 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.001793    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:22.078066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.077982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:22.079702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.079681    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"]
Aug 04 16:46:22.084320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.084297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:22.086392 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.086361    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-734f56\""
Aug 04 16:46:22.087025 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.086984    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-734f56-dockercfg-mv7tk\""
Aug 04 16:46:22.094515 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.094488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"]
Aug 04 16:46:22.098400 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.098367    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"]
Aug 04 16:46:22.102291 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.102268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:22.129351 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.129318    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"]
Aug 04 16:46:22.174344 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.174305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cffee29-33b9-46c3-97ae-21572219ef93-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j\" (UID: \"9cffee29-33b9-46c3-97ae-21572219ef93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:22.174541 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.174350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzfsl\" (UniqueName: \"kubernetes.io/projected/9cffee29-33b9-46c3-97ae-21572219ef93-kube-api-access-xzfsl\") pod \"payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j\" (UID: \"9cffee29-33b9-46c3-97ae-21572219ef93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:22.174541 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.174494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd050f8-c81b-4d06-a153-39947a10774b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7\" (UID: \"4cd050f8-c81b-4d06-a153-39947a10774b\") " pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:22.174541 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.174536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4tmp\" (UniqueName: \"kubernetes.io/projected/4cd050f8-c81b-4d06-a153-39947a10774b-kube-api-access-g4tmp\") pod \"payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7\" (UID: \"4cd050f8-c81b-4d06-a153-39947a10774b\") " pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:22.275768 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.275704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cffee29-33b9-46c3-97ae-21572219ef93-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j\" (UID: \"9cffee29-33b9-46c3-97ae-21572219ef93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:22.275987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.275784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfsl\" (UniqueName: \"kubernetes.io/projected/9cffee29-33b9-46c3-97ae-21572219ef93-kube-api-access-xzfsl\") pod \"payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j\" (UID: \"9cffee29-33b9-46c3-97ae-21572219ef93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:22.275987 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.275938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd050f8-c81b-4d06-a153-39947a10774b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7\" (UID: \"4cd050f8-c81b-4d06-a153-39947a10774b\") " pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:22.276120 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.275989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4tmp\" (UniqueName: \"kubernetes.io/projected/4cd050f8-c81b-4d06-a153-39947a10774b-kube-api-access-g4tmp\") pod \"payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7\" (UID: \"4cd050f8-c81b-4d06-a153-39947a10774b\") " pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:22.276814 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.276591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cffee29-33b9-46c3-97ae-21572219ef93-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j\" (UID: \"9cffee29-33b9-46c3-97ae-21572219ef93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:22.276975 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.276893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd050f8-c81b-4d06-a153-39947a10774b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7\" (UID: \"4cd050f8-c81b-4d06-a153-39947a10774b\") " pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:22.287197 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.287167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzfsl\" (UniqueName: \"kubernetes.io/projected/9cffee29-33b9-46c3-97ae-21572219ef93-kube-api-access-xzfsl\") pod \"payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j\" (UID: \"9cffee29-33b9-46c3-97ae-21572219ef93\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:22.287197 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.287192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4tmp\" (UniqueName: \"kubernetes.io/projected/4cd050f8-c81b-4d06-a153-39947a10774b-kube-api-access-g4tmp\") pod \"payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7\" (UID: \"4cd050f8-c81b-4d06-a153-39947a10774b\") " pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:22.399737 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.399651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:22.404960 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.404932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9" event={"ID":"b1c49dc6-ae3b-4a03-a555-f5487944a867","Type":"ContainerStarted","Data":"f3bed7123f27631b4c99d4cb8b25f5db7aad1bc95e853f2fa4badbf2ece9cac2"}
Aug 04 16:46:22.417261 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.417237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:22.574375 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.572830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"]
Aug 04 16:46:22.612447 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:22.612417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"]
Aug 04 16:46:22.614657 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:46:22.614632    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd050f8_c81b_4d06_a153_39947a10774b.slice/crio-79cb0b11373e48e357c1da31c0ea4986e641f706a6bd20c84d0a5cc07b78f740 WatchSource:0}: Error finding container 79cb0b11373e48e357c1da31c0ea4986e641f706a6bd20c84d0a5cc07b78f740: Status 404 returned error can't find the container with id 79cb0b11373e48e357c1da31c0ea4986e641f706a6bd20c84d0a5cc07b78f740
Aug 04 16:46:23.415632 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.415587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9" event={"ID":"b1c49dc6-ae3b-4a03-a555-f5487944a867","Type":"ContainerStarted","Data":"562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d"}
Aug 04 16:46:23.415875 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.415792    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:23.417489 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.417463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7" event={"ID":"4cd050f8-c81b-4d06-a153-39947a10774b","Type":"ContainerStarted","Data":"1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459"}
Aug 04 16:46:23.417614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.417511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7" event={"ID":"4cd050f8-c81b-4d06-a153-39947a10774b","Type":"ContainerStarted","Data":"79cb0b11373e48e357c1da31c0ea4986e641f706a6bd20c84d0a5cc07b78f740"}
Aug 04 16:46:23.417614 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.417539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:23.419253 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.419230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j" event={"ID":"9cffee29-33b9-46c3-97ae-21572219ef93","Type":"ContainerStarted","Data":"e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0"}
Aug 04 16:46:23.419367 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.419272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j" event={"ID":"9cffee29-33b9-46c3-97ae-21572219ef93","Type":"ContainerStarted","Data":"693e2007165f57a3049a051db0e1526ccb0a6b9d10308448d1b173e90bde4b58"}
Aug 04 16:46:23.419413 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.419374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:23.431174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.431132    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9" podStartSLOduration=1.924950707 podStartE2EDuration="2.431118448s" totalImagesPullingTime="506.167741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:46:23.429788307 +0000 UTC m=+2664.256485779" watchObservedRunningTime="2026-08-04 16:46:23.431118448 +0000 UTC m=+2664.257815934"
Aug 04 16:46:23.446862 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.446808    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j" podStartSLOduration=1.446792124 podStartE2EDuration="1.446792124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:46:23.444084812 +0000 UTC m=+2664.270782284" watchObservedRunningTime="2026-08-04 16:46:23.446792124 +0000 UTC m=+2664.273489574"
Aug 04 16:46:23.464386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:23.464337    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7" podStartSLOduration=1.4643197909999999 podStartE2EDuration="1.464319791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:46:23.461217698 +0000 UTC m=+2664.287915183" watchObservedRunningTime="2026-08-04 16:46:23.464319791 +0000 UTC m=+2664.291017263"
Aug 04 16:46:29.431191 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:29.431162    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:46:34.386900 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.386812    2563 patch_prober.go:28] interesting pod/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Aug 04 16:46:34.386900 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.386880    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Aug 04 16:46:34.428124 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.428040    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:46:34.428124 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.428122    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:46:34.489505 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.489466    2563 generic.go:356] "Generic (PLEG): container finished" podID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerID="9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e" exitCode=0
Aug 04 16:46:34.489697 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.489528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" event={"ID":"f5f1e3e7-fc1b-419b-b116-d560f573b146","Type":"ContainerDied","Data":"9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e"}
Aug 04 16:46:34.490023 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.490004    2563 scope.go:117] "RemoveContainer" containerID="9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e"
Aug 04 16:46:34.491349 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.491311    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:46:34.491444 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.491406    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:46:34.491498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:34.491480    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:46:35.501648 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:35.501611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" event={"ID":"f5f1e3e7-fc1b-419b-b116-d560f573b146","Type":"ContainerStarted","Data":"f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4"}
Aug 04 16:46:36.110524 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:36.110492    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:36.110702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:36.110649    2563 patch_prober.go:28] interesting pod/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Aug 04 16:46:36.110747 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:36.110696    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Aug 04 16:46:37.110515 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:37.110476    2563 patch_prober.go:28] interesting pod/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Aug 04 16:46:37.111030 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:37.110543    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Aug 04 16:46:38.110229 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:38.110191    2563 patch_prober.go:28] interesting pod/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Aug 04 16:46:38.110430 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:38.110248    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Aug 04 16:46:39.110276 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:39.110238    2563 patch_prober.go:28] interesting pod/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Aug 04 16:46:39.110656 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:39.110313    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Aug 04 16:46:40.110576 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:40.110535    2563 patch_prober.go:28] interesting pod/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Aug 04 16:46:40.111008 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:40.110603    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Aug 04 16:46:41.114174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:41.114138    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:41.114646 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:41.114632    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:41.115423 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:41.115401    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:46:45.354498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:45.354463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:45.938387 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:45.938351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:46.131846 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:46.131813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:46.268361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:46.268326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:49.043760 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:49.043725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:49.128413 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:49.128378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:50.123693 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.123617    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"]
Aug 04 16:46:50.126376 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.126356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.129204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.129186    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2847c7-serving-cert\""
Aug 04 16:46:50.142329 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.142302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"]
Aug 04 16:46:50.151343 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.151318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.151449 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.151404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq9lt\" (UniqueName: \"kubernetes.io/projected/74b02049-7664-4a51-b9cb-3c7b93c9c938-kube-api-access-vq9lt\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.151449 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.151434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b02049-7664-4a51-b9cb-3c7b93c9c938-openshift-service-ca\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.157965 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.157941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:50.252395 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.252359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9lt\" (UniqueName: \"kubernetes.io/projected/74b02049-7664-4a51-b9cb-3c7b93c9c938-kube-api-access-vq9lt\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.252598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.252429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b02049-7664-4a51-b9cb-3c7b93c9c938-openshift-service-ca\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.252598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.252503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.252736 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:46:50.252636    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-serving-cert: secret "maas-api-e2e-api-b-2847c7-serving-cert" not found
Aug 04 16:46:50.252736 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:46:50.252720    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls podName:74b02049-7664-4a51-b9cb-3c7b93c9c938 nodeName:}" failed. No retries permitted until 2026-08-04 16:46:50.752699277 +0000 UTC m=+2691.579396747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls") pod "maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s" (UID: "74b02049-7664-4a51-b9cb-3c7b93c9c938") : secret "maas-api-e2e-api-b-2847c7-serving-cert" not found
Aug 04 16:46:50.253157 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.253137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b02049-7664-4a51-b9cb-3c7b93c9c938-openshift-service-ca\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.267804 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.267781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq9lt\" (UniqueName: \"kubernetes.io/projected/74b02049-7664-4a51-b9cb-3c7b93c9c938-kube-api-access-vq9lt\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.758042 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.758006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.760631 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.760603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls\") pod \"maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:50.772024 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.772000    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"]
Aug 04 16:46:50.774560 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.774544    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:50.776638 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.776619    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-2847c7-dockercfg-lcmjm\""
Aug 04 16:46:50.776856 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.776838    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-2847c7\""
Aug 04 16:46:50.797113 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.797085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"]
Aug 04 16:46:50.859706 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.859645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0473dc-637c-4dce-ba49-d8609c0ddda5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh\" (UID: \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\") " pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:50.859946 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.859720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29dpw\" (UniqueName: \"kubernetes.io/projected/ac0473dc-637c-4dce-ba49-d8609c0ddda5-kube-api-access-29dpw\") pod \"payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh\" (UID: \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\") " pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:50.884418 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.884382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:50.960201 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.960168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0473dc-637c-4dce-ba49-d8609c0ddda5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh\" (UID: \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\") " pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:50.960371 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.960215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29dpw\" (UniqueName: \"kubernetes.io/projected/ac0473dc-637c-4dce-ba49-d8609c0ddda5-kube-api-access-29dpw\") pod \"payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh\" (UID: \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\") " pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:50.960859 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.960839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0473dc-637c-4dce-ba49-d8609c0ddda5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh\" (UID: \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\") " pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:50.969595 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.969568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29dpw\" (UniqueName: \"kubernetes.io/projected/ac0473dc-637c-4dce-ba49-d8609c0ddda5-kube-api-access-29dpw\") pod \"payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh\" (UID: \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\") " pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:50.986064 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:50.986033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:46:51.037665 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.037587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:51.094941 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.094892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:51.193686 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.193658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"]
Aug 04 16:46:51.194631 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:46:51.194602    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b02049_7664_4a51_b9cb_3c7b93c9c938.slice/crio-c312f3264a4cee655503cf49179e475800fb5c5bd7a158e7dcb86e1cdd74d1aa WatchSource:0}: Error finding container c312f3264a4cee655503cf49179e475800fb5c5bd7a158e7dcb86e1cdd74d1aa: Status 404 returned error can't find the container with id c312f3264a4cee655503cf49179e475800fb5c5bd7a158e7dcb86e1cdd74d1aa
Aug 04 16:46:51.249670 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.249638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"]
Aug 04 16:46:51.251176 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:46:51.251148    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0473dc_637c_4dce_ba49_d8609c0ddda5.slice/crio-8f14171a168b1f478f5507ace9367c4634fdc8165848d1cc0653de7ab976a75c WatchSource:0}: Error finding container 8f14171a168b1f478f5507ace9367c4634fdc8165848d1cc0653de7ab976a75c: Status 404 returned error can't find the container with id 8f14171a168b1f478f5507ace9367c4634fdc8165848d1cc0653de7ab976a75c
Aug 04 16:46:51.597356 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.597267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s" event={"ID":"74b02049-7664-4a51-b9cb-3c7b93c9c938","Type":"ContainerStarted","Data":"c312f3264a4cee655503cf49179e475800fb5c5bd7a158e7dcb86e1cdd74d1aa"}
Aug 04 16:46:51.598823 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.598798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh" event={"ID":"ac0473dc-637c-4dce-ba49-d8609c0ddda5","Type":"ContainerStarted","Data":"ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d"}
Aug 04 16:46:51.598954 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.598845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh" event={"ID":"ac0473dc-637c-4dce-ba49-d8609c0ddda5","Type":"ContainerStarted","Data":"8f14171a168b1f478f5507ace9367c4634fdc8165848d1cc0653de7ab976a75c"}
Aug 04 16:46:51.599034 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.599013    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:46:51.615186 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:51.615132    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh" podStartSLOduration=1.615115221 podStartE2EDuration="1.615115221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:46:51.614929433 +0000 UTC m=+2692.441626903" watchObservedRunningTime="2026-08-04 16:46:51.615115221 +0000 UTC m=+2692.441812717"
Aug 04 16:46:52.606598 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:52.606559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s" event={"ID":"74b02049-7664-4a51-b9cb-3c7b93c9c938","Type":"ContainerStarted","Data":"599135dbf5c0dee23413d35255334c62d3f7b6c4b004ee73ca77c6461d22b099"}
Aug 04 16:46:52.607063 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:52.606653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:52.625690 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:52.625640    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s" podStartSLOduration=2.078324996 podStartE2EDuration="2.625626626s" totalImagesPullingTime="547.30163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:46:52.623009772 +0000 UTC m=+2693.449707244" watchObservedRunningTime="2026-08-04 16:46:52.625626626 +0000 UTC m=+2693.452324098"
Aug 04 16:46:58.618997 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:58.618969    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:46:59.900645 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:59.900618    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:46:59.911304 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:46:59.911282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:47:02.608408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:02.608381    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:47:14.026948 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:14.026888    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:32.401879 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.401833    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"]
Aug 04 16:47:32.402462 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.402063    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9" podUID="b1c49dc6-ae3b-4a03-a555-f5487944a867" containerName="maas-api" containerID="cri-o://562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d" gracePeriod=30
Aug 04 16:47:32.431632 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.431606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:32.465073 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.463796    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"]
Aug 04 16:47:32.465073 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.464056    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7" podUID="4cd050f8-c81b-4d06-a153-39947a10774b" containerName="payload-processing" containerID="cri-o://1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459" gracePeriod=30
Aug 04 16:47:32.468439 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.468409    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"]
Aug 04 16:47:32.468933 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.468785    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j" podUID="9cffee29-33b9-46c3-97ae-21572219ef93" containerName="payload-pre-processing" containerID="cri-o://e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0" gracePeriod=30
Aug 04 16:47:32.506754 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.506729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:32.565953 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.565921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:32.667587 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.667546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:32.748670 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.748647    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:47:32.759316 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.759288    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq7vf\" (UniqueName: \"kubernetes.io/projected/b1c49dc6-ae3b-4a03-a555-f5487944a867-kube-api-access-rq7vf\") pod \"b1c49dc6-ae3b-4a03-a555-f5487944a867\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") "
Aug 04 16:47:32.759496 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.759400    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c49dc6-ae3b-4a03-a555-f5487944a867-openshift-service-ca\") pod \"b1c49dc6-ae3b-4a03-a555-f5487944a867\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") "
Aug 04 16:47:32.759496 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.759467    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c49dc6-ae3b-4a03-a555-f5487944a867-maas-api-tls\") pod \"b1c49dc6-ae3b-4a03-a555-f5487944a867\" (UID: \"b1c49dc6-ae3b-4a03-a555-f5487944a867\") "
Aug 04 16:47:32.760142 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.760008    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c49dc6-ae3b-4a03-a555-f5487944a867-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1c49dc6-ae3b-4a03-a555-f5487944a867" (UID: "b1c49dc6-ae3b-4a03-a555-f5487944a867"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:47:32.762765 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.762739    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c49dc6-ae3b-4a03-a555-f5487944a867-kube-api-access-rq7vf" (OuterVolumeSpecName: "kube-api-access-rq7vf") pod "b1c49dc6-ae3b-4a03-a555-f5487944a867" (UID: "b1c49dc6-ae3b-4a03-a555-f5487944a867"). InnerVolumeSpecName "kube-api-access-rq7vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:47:32.767954 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.767929    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c49dc6-ae3b-4a03-a555-f5487944a867-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1c49dc6-ae3b-4a03-a555-f5487944a867" (UID: "b1c49dc6-ae3b-4a03-a555-f5487944a867"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:47:32.779990 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.779966    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:47:32.786674 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.786657    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:47:32.860066 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd050f8-c81b-4d06-a153-39947a10774b-plugins-config-volume\") pod \"4cd050f8-c81b-4d06-a153-39947a10774b\" (UID: \"4cd050f8-c81b-4d06-a153-39947a10774b\") "
Aug 04 16:47:32.860240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9" event={"ID":"b1c49dc6-ae3b-4a03-a555-f5487944a867","Type":"ContainerDied","Data":"562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d"}
Aug 04 16:47:32.860240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860111    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"
Aug 04 16:47:32.860240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860151    2563 scope.go:117] "RemoveContainer" containerID="562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d"
Aug 04 16:47:32.860240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860075    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4tmp\" (UniqueName: \"kubernetes.io/projected/4cd050f8-c81b-4d06-a153-39947a10774b-kube-api-access-g4tmp\") pod \"4cd050f8-c81b-4d06-a153-39947a10774b\" (UID: \"4cd050f8-c81b-4d06-a153-39947a10774b\") "
Aug 04 16:47:32.860240 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860039    2563 generic.go:356] "Generic (PLEG): container finished" podID="b1c49dc6-ae3b-4a03-a555-f5487944a867" containerID="562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d" exitCode=0
Aug 04 16:47:32.860553 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9" event={"ID":"b1c49dc6-ae3b-4a03-a555-f5487944a867","Type":"ContainerDied","Data":"f3bed7123f27631b4c99d4cb8b25f5db7aad1bc95e853f2fa4badbf2ece9cac2"}
Aug 04 16:47:32.860553 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzfsl\" (UniqueName: \"kubernetes.io/projected/9cffee29-33b9-46c3-97ae-21572219ef93-kube-api-access-xzfsl\") pod \"9cffee29-33b9-46c3-97ae-21572219ef93\" (UID: \"9cffee29-33b9-46c3-97ae-21572219ef93\") "
Aug 04 16:47:32.860666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cd050f8-c81b-4d06-a153-39947a10774b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4cd050f8-c81b-4d06-a153-39947a10774b" (UID: "4cd050f8-c81b-4d06-a153-39947a10774b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:47:32.860666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.860559    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cffee29-33b9-46c3-97ae-21572219ef93-plugins-config-volume\") pod \"9cffee29-33b9-46c3-97ae-21572219ef93\" (UID: \"9cffee29-33b9-46c3-97ae-21572219ef93\") "
Aug 04 16:47:32.861056 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.861021    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cffee29-33b9-46c3-97ae-21572219ef93-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9cffee29-33b9-46c3-97ae-21572219ef93" (UID: "9cffee29-33b9-46c3-97ae-21572219ef93"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:47:32.861192 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.861116    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd050f8-c81b-4d06-a153-39947a10774b-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:32.861192 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.861133    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c49dc6-ae3b-4a03-a555-f5487944a867-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:32.861192 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.861147    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c49dc6-ae3b-4a03-a555-f5487944a867-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:32.861192 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.861161    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cffee29-33b9-46c3-97ae-21572219ef93-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:32.861192 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.861173    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq7vf\" (UniqueName: \"kubernetes.io/projected/b1c49dc6-ae3b-4a03-a555-f5487944a867-kube-api-access-rq7vf\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:32.862417 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.862383    2563 generic.go:356] "Generic (PLEG): container finished" podID="4cd050f8-c81b-4d06-a153-39947a10774b" containerID="1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459" exitCode=0
Aug 04 16:47:32.862523 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.862461    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7" event={"ID":"4cd050f8-c81b-4d06-a153-39947a10774b","Type":"ContainerDied","Data":"1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459"}
Aug 04 16:47:32.862523 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.862501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7" event={"ID":"4cd050f8-c81b-4d06-a153-39947a10774b","Type":"ContainerDied","Data":"79cb0b11373e48e357c1da31c0ea4986e641f706a6bd20c84d0a5cc07b78f740"}
Aug 04 16:47:32.862652 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.862590    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"
Aug 04 16:47:32.863467 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.863421    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd050f8-c81b-4d06-a153-39947a10774b-kube-api-access-g4tmp" (OuterVolumeSpecName: "kube-api-access-g4tmp") pod "4cd050f8-c81b-4d06-a153-39947a10774b" (UID: "4cd050f8-c81b-4d06-a153-39947a10774b"). InnerVolumeSpecName "kube-api-access-g4tmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:47:32.863655 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.863632    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cffee29-33b9-46c3-97ae-21572219ef93-kube-api-access-xzfsl" (OuterVolumeSpecName: "kube-api-access-xzfsl") pod "9cffee29-33b9-46c3-97ae-21572219ef93" (UID: "9cffee29-33b9-46c3-97ae-21572219ef93"). InnerVolumeSpecName "kube-api-access-xzfsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:47:32.864516 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.864491    2563 generic.go:356] "Generic (PLEG): container finished" podID="9cffee29-33b9-46c3-97ae-21572219ef93" containerID="e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0" exitCode=0
Aug 04 16:47:32.864640 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.864545    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"
Aug 04 16:47:32.864702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.864546    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j" event={"ID":"9cffee29-33b9-46c3-97ae-21572219ef93","Type":"ContainerDied","Data":"e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0"}
Aug 04 16:47:32.864702 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.864678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j" event={"ID":"9cffee29-33b9-46c3-97ae-21572219ef93","Type":"ContainerDied","Data":"693e2007165f57a3049a051db0e1526ccb0a6b9d10308448d1b173e90bde4b58"}
Aug 04 16:47:32.871368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.871352    2563 scope.go:117] "RemoveContainer" containerID="562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d"
Aug 04 16:47:32.871648 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:47:32.871629    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d\": container with ID starting with 562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d not found: ID does not exist" containerID="562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d"
Aug 04 16:47:32.871721 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.871656    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d"} err="failed to get container status \"562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d\": rpc error: code = NotFound desc = could not find container \"562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d\": container with ID starting with 562fe366279f914537a8586bc5fa573034d5f275052be76f45f077c12a6d1b0d not found: ID does not exist"
Aug 04 16:47:32.871721 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.871674    2563 scope.go:117] "RemoveContainer" containerID="1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459"
Aug 04 16:47:32.882785 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.882766    2563 scope.go:117] "RemoveContainer" containerID="1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459"
Aug 04 16:47:32.883058 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:47:32.883039    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459\": container with ID starting with 1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459 not found: ID does not exist" containerID="1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459"
Aug 04 16:47:32.883130 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.883070    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459"} err="failed to get container status \"1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459\": rpc error: code = NotFound desc = could not find container \"1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459\": container with ID starting with 1bbc7af189b1423fcc751704270741935d42a40842e5a3d105b0995f1478c459 not found: ID does not exist"
Aug 04 16:47:32.883130 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.883092    2563 scope.go:117] "RemoveContainer" containerID="e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0"
Aug 04 16:47:32.893807 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.891740    2563 scope.go:117] "RemoveContainer" containerID="e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0"
Aug 04 16:47:32.893807 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:47:32.892773    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0\": container with ID starting with e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0 not found: ID does not exist" containerID="e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0"
Aug 04 16:47:32.893807 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.892806    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0"} err="failed to get container status \"e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0\": rpc error: code = NotFound desc = could not find container \"e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0\": container with ID starting with e8893b8450fff185443b0ae8ed2e629ee4e7165927d6514b772f5c1927275df0 not found: ID does not exist"
Aug 04 16:47:32.900846 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.900820    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"]
Aug 04 16:47:32.915700 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.915636    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-734f56-65ff7b9799-tlhs9"]
Aug 04 16:47:32.928175 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.928146    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"]
Aug 04 16:47:32.930750 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.930725    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-734f56-5fdcc4c6d-g7v5j"]
Aug 04 16:47:32.961694 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.961663    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4tmp\" (UniqueName: \"kubernetes.io/projected/4cd050f8-c81b-4d06-a153-39947a10774b-kube-api-access-g4tmp\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:32.961694 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:32.961690    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzfsl\" (UniqueName: \"kubernetes.io/projected/9cffee29-33b9-46c3-97ae-21572219ef93-kube-api-access-xzfsl\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:33.001231 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:33.001197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:33.183266 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:33.183235    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"]
Aug 04 16:47:33.187074 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:33.187048    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-734f56-fb84f9574-5tmr7"]
Aug 04 16:47:33.719002 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:33.718963    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cd050f8-c81b-4d06-a153-39947a10774b" path="/var/lib/kubelet/pods/4cd050f8-c81b-4d06-a153-39947a10774b/volumes"
Aug 04 16:47:33.719375 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:33.719366    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cffee29-33b9-46c3-97ae-21572219ef93" path="/var/lib/kubelet/pods/9cffee29-33b9-46c3-97ae-21572219ef93/volumes"
Aug 04 16:47:33.719698 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:33.719685    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c49dc6-ae3b-4a03-a555-f5487944a867" path="/var/lib/kubelet/pods/b1c49dc6-ae3b-4a03-a555-f5487944a867/volumes"
Aug 04 16:47:38.820349 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:38.820313    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:38.920310 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:38.920277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:39.079400 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:39.079310    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"]
Aug 04 16:47:39.079616 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:39.079589    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy" containerID="cri-o://f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4" gracePeriod=30
Aug 04 16:47:39.092468 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:39.092437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:39.305596 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:39.305563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:41.117487 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:41.117453    2563 patch_prober.go:28] interesting pod/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 16:47:41.117867 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:41.117521    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 16:47:44.330886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.330864    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:47:44.364222 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364138    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-token\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364222 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-socket\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364444 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364330    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-envoy\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364444 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364370    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-podinfo\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364444 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364398    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-certs\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364600 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364526    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:47:44.364600 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364561    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-credential-socket\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gltw4\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-kube-api-access-gltw4\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364636    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5f1e3e7-fc1b-419b-b116-d560f573b146-istiod-ca-cert\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364664    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-data\") pod \"f5f1e3e7-fc1b-419b-b116-d560f573b146\" (UID: \"f5f1e3e7-fc1b-419b-b116-d560f573b146\") "
Aug 04 16:47:44.364704 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364692    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:47:44.364946 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.364843    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:47:44.365296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.365227    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.365296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.365251    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.365296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.365267    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.365296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.365336    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5f1e3e7-fc1b-419b-b116-d560f573b146-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:47:44.365687 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.365505    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-data" (OuterVolumeSpecName: "istio-data") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:47:44.366707 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.366684    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:47:44.366707 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.366703    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-token" (OuterVolumeSpecName: "istio-token") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:47:44.366899 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.366884    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-kube-api-access-gltw4" (OuterVolumeSpecName: "kube-api-access-gltw4") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "kube-api-access-gltw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:47:44.367017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.367000    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f5f1e3e7-fc1b-419b-b116-d560f573b146" (UID: "f5f1e3e7-fc1b-419b-b116-d560f573b146"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:47:44.465842 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.465805    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.465842 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.465842    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.466146 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.465856    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gltw4\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-kube-api-access-gltw4\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.466146 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.465870    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5f1e3e7-fc1b-419b-b116-d560f573b146-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.466146 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.465883    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.466146 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.465893    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5f1e3e7-fc1b-419b-b116-d560f573b146-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:44.944490 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.944456    2563 generic.go:356] "Generic (PLEG): container finished" podID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerID="f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4" exitCode=0
Aug 04 16:47:44.944666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.944506    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"
Aug 04 16:47:44.944666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.944542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" event={"ID":"f5f1e3e7-fc1b-419b-b116-d560f573b146","Type":"ContainerDied","Data":"f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4"}
Aug 04 16:47:44.944666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.944598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b" event={"ID":"f5f1e3e7-fc1b-419b-b116-d560f573b146","Type":"ContainerDied","Data":"4a98d60a49ccef880adf0ab25936caf271a40219cc3dec61f52314b69f8ce755"}
Aug 04 16:47:44.944666 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.944623    2563 scope.go:117] "RemoveContainer" containerID="f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4"
Aug 04 16:47:44.954799 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.954778    2563 scope.go:117] "RemoveContainer" containerID="9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e"
Aug 04 16:47:44.964271 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.964197    2563 scope.go:117] "RemoveContainer" containerID="f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4"
Aug 04 16:47:44.964598 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:47:44.964572    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4\": container with ID starting with f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4 not found: ID does not exist" containerID="f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4"
Aug 04 16:47:44.964677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.964608    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4"} err="failed to get container status \"f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4\": rpc error: code = NotFound desc = could not find container \"f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4\": container with ID starting with f64c834a8b24a4dac84d559fe95b1e2be101ad1dc7d5da16834a6eb646f937f4 not found: ID does not exist"
Aug 04 16:47:44.964677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.964629    2563 scope.go:117] "RemoveContainer" containerID="9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e"
Aug 04 16:47:44.964872 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:47:44.964856    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e\": container with ID starting with 9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e not found: ID does not exist" containerID="9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e"
Aug 04 16:47:44.964950 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.964877    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e"} err="failed to get container status \"9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e\": rpc error: code = NotFound desc = could not find container \"9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e\": container with ID starting with 9371d9cd65b147cc093f9ab76b0c5963854411138dcce1e540400e45b74bf51e not found: ID does not exist"
Aug 04 16:47:44.966489 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.966434    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"]
Aug 04 16:47:44.969119 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:44.969101    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-734f56-openshift-default-5546f9dc66-bh77b"]
Aug 04 16:47:45.718629 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:45.718598    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" path="/var/lib/kubelet/pods/f5f1e3e7-fc1b-419b-b116-d560f573b146/volumes"
Aug 04 16:47:54.875065 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:54.875028    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"]
Aug 04 16:47:54.875544 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:54.875327    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s" podUID="74b02049-7664-4a51-b9cb-3c7b93c9c938" containerName="maas-api" containerID="cri-o://599135dbf5c0dee23413d35255334c62d3f7b6c4b004ee73ca77c6461d22b099" gracePeriod=30
Aug 04 16:47:54.910751 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:54.910724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:54.937791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:54.937754    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"]
Aug 04 16:47:54.938100 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:54.938071    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh" podUID="ac0473dc-637c-4dce-ba49-d8609c0ddda5" containerName="payload-processing" containerID="cri-o://ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d" gracePeriod=30
Aug 04 16:47:55.007569 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.007535    2563 generic.go:356] "Generic (PLEG): container finished" podID="74b02049-7664-4a51-b9cb-3c7b93c9c938" containerID="599135dbf5c0dee23413d35255334c62d3f7b6c4b004ee73ca77c6461d22b099" exitCode=0
Aug 04 16:47:55.007764 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.007642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s" event={"ID":"74b02049-7664-4a51-b9cb-3c7b93c9c938","Type":"ContainerDied","Data":"599135dbf5c0dee23413d35255334c62d3f7b6c4b004ee73ca77c6461d22b099"}
Aug 04 16:47:55.011268 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.011224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:55.141323 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.141202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:55.200122 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.200093    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:47:55.224610 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.224572    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:47:55.264327 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.264289    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b02049-7664-4a51-b9cb-3c7b93c9c938-openshift-service-ca\") pod \"74b02049-7664-4a51-b9cb-3c7b93c9c938\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") "
Aug 04 16:47:55.264515 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.264335    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls\") pod \"74b02049-7664-4a51-b9cb-3c7b93c9c938\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") "
Aug 04 16:47:55.264515 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.264375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq9lt\" (UniqueName: \"kubernetes.io/projected/74b02049-7664-4a51-b9cb-3c7b93c9c938-kube-api-access-vq9lt\") pod \"74b02049-7664-4a51-b9cb-3c7b93c9c938\" (UID: \"74b02049-7664-4a51-b9cb-3c7b93c9c938\") "
Aug 04 16:47:55.264711 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.264679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b02049-7664-4a51-b9cb-3c7b93c9c938-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "74b02049-7664-4a51-b9cb-3c7b93c9c938" (UID: "74b02049-7664-4a51-b9cb-3c7b93c9c938"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:47:55.266659 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.266636    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "74b02049-7664-4a51-b9cb-3c7b93c9c938" (UID: "74b02049-7664-4a51-b9cb-3c7b93c9c938"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:47:55.266779 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.266757    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b02049-7664-4a51-b9cb-3c7b93c9c938-kube-api-access-vq9lt" (OuterVolumeSpecName: "kube-api-access-vq9lt") pod "74b02049-7664-4a51-b9cb-3c7b93c9c938" (UID: "74b02049-7664-4a51-b9cb-3c7b93c9c938"). InnerVolumeSpecName "kube-api-access-vq9lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:47:55.365179 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.365150    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29dpw\" (UniqueName: \"kubernetes.io/projected/ac0473dc-637c-4dce-ba49-d8609c0ddda5-kube-api-access-29dpw\") pod \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\" (UID: \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\") "
Aug 04 16:47:55.365349 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.365197    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0473dc-637c-4dce-ba49-d8609c0ddda5-plugins-config-volume\") pod \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\" (UID: \"ac0473dc-637c-4dce-ba49-d8609c0ddda5\") "
Aug 04 16:47:55.365500 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.365483    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b02049-7664-4a51-b9cb-3c7b93c9c938-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:55.365561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.365505    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b02049-7664-4a51-b9cb-3c7b93c9c938-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:55.365561 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.365520    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq9lt\" (UniqueName: \"kubernetes.io/projected/74b02049-7664-4a51-b9cb-3c7b93c9c938-kube-api-access-vq9lt\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:55.365686 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.365564    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac0473dc-637c-4dce-ba49-d8609c0ddda5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac0473dc-637c-4dce-ba49-d8609c0ddda5" (UID: "ac0473dc-637c-4dce-ba49-d8609c0ddda5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:47:55.367641 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.367621    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac0473dc-637c-4dce-ba49-d8609c0ddda5-kube-api-access-29dpw" (OuterVolumeSpecName: "kube-api-access-29dpw") pod "ac0473dc-637c-4dce-ba49-d8609c0ddda5" (UID: "ac0473dc-637c-4dce-ba49-d8609c0ddda5"). InnerVolumeSpecName "kube-api-access-29dpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:47:55.466611 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.466521    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29dpw\" (UniqueName: \"kubernetes.io/projected/ac0473dc-637c-4dce-ba49-d8609c0ddda5-kube-api-access-29dpw\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:55.466611 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.466554    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0473dc-637c-4dce-ba49-d8609c0ddda5-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:47:55.527353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:55.527309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:47:56.014760 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.014730    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"
Aug 04 16:47:56.015255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.014775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s" event={"ID":"74b02049-7664-4a51-b9cb-3c7b93c9c938","Type":"ContainerDied","Data":"c312f3264a4cee655503cf49179e475800fb5c5bd7a158e7dcb86e1cdd74d1aa"}
Aug 04 16:47:56.015255 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.014854    2563 scope.go:117] "RemoveContainer" containerID="599135dbf5c0dee23413d35255334c62d3f7b6c4b004ee73ca77c6461d22b099"
Aug 04 16:47:56.016386 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.016360    2563 generic.go:356] "Generic (PLEG): container finished" podID="ac0473dc-637c-4dce-ba49-d8609c0ddda5" containerID="ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d" exitCode=0
Aug 04 16:47:56.016470 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.016402    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"
Aug 04 16:47:56.016470 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.016448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh" event={"ID":"ac0473dc-637c-4dce-ba49-d8609c0ddda5","Type":"ContainerDied","Data":"ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d"}
Aug 04 16:47:56.016556 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.016514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh" event={"ID":"ac0473dc-637c-4dce-ba49-d8609c0ddda5","Type":"ContainerDied","Data":"8f14171a168b1f478f5507ace9367c4634fdc8165848d1cc0653de7ab976a75c"}
Aug 04 16:47:56.024679 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.024660    2563 scope.go:117] "RemoveContainer" containerID="ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d"
Aug 04 16:47:56.033260 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.033233    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"]
Aug 04 16:47:56.034492 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.034472    2563 scope.go:117] "RemoveContainer" containerID="ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d"
Aug 04 16:47:56.034799 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:47:56.034778    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d\": container with ID starting with ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d not found: ID does not exist" containerID="ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d"
Aug 04 16:47:56.034855 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.034808    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d"} err="failed to get container status \"ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d\": rpc error: code = NotFound desc = could not find container \"ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d\": container with ID starting with ff3d2f26c187bdd37cea8b62b0afcb5529348855cb02d9daf488a4f1757aeb3d not found: ID does not exist"
Aug 04 16:47:56.035798 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.035779    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2847c7-66b4c8fb4b-p9m4s"]
Aug 04 16:47:56.043314 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.043289    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"]
Aug 04 16:47:56.047436 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:56.047413    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2847c7-69bb9dc4fb-79nhh"]
Aug 04 16:47:57.719012 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:57.718978    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b02049-7664-4a51-b9cb-3c7b93c9c938" path="/var/lib/kubelet/pods/74b02049-7664-4a51-b9cb-3c7b93c9c938/volumes"
Aug 04 16:47:57.719454 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:47:57.719438    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac0473dc-637c-4dce-ba49-d8609c0ddda5" path="/var/lib/kubelet/pods/ac0473dc-637c-4dce-ba49-d8609c0ddda5/volumes"
Aug 04 16:48:01.488712 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:01.488660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:01.605219 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:01.605187    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:01.828464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:01.828431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:02.022301 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.022268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:02.413265 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.413235    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:02.716862 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.716787    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"]
Aug 04 16:48:02.717256 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717241    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c49dc6-ae3b-4a03-a555-f5487944a867" containerName="maas-api"
Aug 04 16:48:02.717308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717258    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c49dc6-ae3b-4a03-a555-f5487944a867" containerName="maas-api"
Aug 04 16:48:02.717308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717274    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cffee29-33b9-46c3-97ae-21572219ef93" containerName="payload-pre-processing"
Aug 04 16:48:02.717308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717284    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cffee29-33b9-46c3-97ae-21572219ef93" containerName="payload-pre-processing"
Aug 04 16:48:02.717308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717297    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy"
Aug 04 16:48:02.717308 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717302    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717312    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd050f8-c81b-4d06-a153-39947a10774b" containerName="payload-processing"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717318    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd050f8-c81b-4d06-a153-39947a10774b" containerName="payload-processing"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717327    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717332    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717341    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b02049-7664-4a51-b9cb-3c7b93c9c938" containerName="maas-api"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717347    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b02049-7664-4a51-b9cb-3c7b93c9c938" containerName="maas-api"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717362    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0473dc-637c-4dce-ba49-d8609c0ddda5" containerName="payload-processing"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717368    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0473dc-637c-4dce-ba49-d8609c0ddda5" containerName="payload-processing"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717433    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cd050f8-c81b-4d06-a153-39947a10774b" containerName="payload-processing"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717452    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac0473dc-637c-4dce-ba49-d8609c0ddda5" containerName="payload-processing"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717459    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717465    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5f1e3e7-fc1b-419b-b116-d560f573b146" containerName="istio-proxy"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717470    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cffee29-33b9-46c3-97ae-21572219ef93" containerName="payload-pre-processing"
Aug 04 16:48:02.717473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717476    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c49dc6-ae3b-4a03-a555-f5487944a867" containerName="maas-api"
Aug 04 16:48:02.717928 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.717481    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b02049-7664-4a51-b9cb-3c7b93c9c938" containerName="maas-api"
Aug 04 16:48:02.722253 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.722232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.724381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.724361    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4e1c51-openshift-default-dockercfg-9mxfv\""
Aug 04 16:48:02.733028 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.733004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"]
Aug 04 16:48:02.742127 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.742101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:02.842127 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n77j\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-kube-api-access-7n77j\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.842320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-certs\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.842320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-socket\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.842320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-credential-socket\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.842320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-istio-token\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.842320 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-data\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.842536 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6940798a-9168-4072-849b-929ae2c8e70d-istiod-ca-cert\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.842536 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6940798a-9168-4072-849b-929ae2c8e70d-istio-podinfo\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.842536 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.842396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-envoy\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.943643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.943605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-socket\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.943643 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.943644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-credential-socket\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.943887 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.943674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-istio-token\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.943887 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.943691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-data\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.943887 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.943748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6940798a-9168-4072-849b-929ae2c8e70d-istiod-ca-cert\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.943887 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.943771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6940798a-9168-4072-849b-929ae2c8e70d-istio-podinfo\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.944135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.943902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-envoy\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.944135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.944051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n77j\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-kube-api-access-7n77j\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.944135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.944095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-certs\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.944135 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.944108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-socket\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.944340 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.944158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-credential-socket\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.944340 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.944227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-data\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.944428 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.944411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-certs\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.944509 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.944492    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6940798a-9168-4072-849b-929ae2c8e70d-istiod-ca-cert\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.946428 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.946405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-envoy\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.946630 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.946612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6940798a-9168-4072-849b-929ae2c8e70d-istio-podinfo\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.952266 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.952243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-istio-token\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:02.952474 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:02.952455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n77j\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-kube-api-access-7n77j\") pod \"e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") " pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:03.033581 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:03.033548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:03.172748 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:03.172717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:03.198147 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:03.198121    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"]
Aug 04 16:48:03.199373 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:48:03.199346    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6940798a_9168_4072_849b_929ae2c8e70d.slice/crio-a9b5546da51196cf6ef9e87e258ff67a1c81ef56a7c0de2bfbedfdd938ade7f7 WatchSource:0}: Error finding container a9b5546da51196cf6ef9e87e258ff67a1c81ef56a7c0de2bfbedfdd938ade7f7: Status 404 returned error can't find the container with id a9b5546da51196cf6ef9e87e258ff67a1c81ef56a7c0de2bfbedfdd938ade7f7
Aug 04 16:48:03.201410 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:03.201374    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:48:03.201498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:03.201451    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:48:03.201498 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:03.201484    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:48:04.066926 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:04.066879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" event={"ID":"6940798a-9168-4072-849b-929ae2c8e70d","Type":"ContainerStarted","Data":"d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c"}
Aug 04 16:48:04.067363 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:04.066965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" event={"ID":"6940798a-9168-4072-849b-929ae2c8e70d","Type":"ContainerStarted","Data":"a9b5546da51196cf6ef9e87e258ff67a1c81ef56a7c0de2bfbedfdd938ade7f7"}
Aug 04 16:48:04.086785 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:04.086707    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" podStartSLOduration=2.086688876 podStartE2EDuration="2.086688876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:48:04.08524979 +0000 UTC m=+2764.911947289" watchObservedRunningTime="2026-08-04 16:48:04.086688876 +0000 UTC m=+2764.913386402"
Aug 04 16:48:05.034292 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:05.034249    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:05.039506 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:05.039481    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:05.073087 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:05.073057    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:05.074076 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:05.074057    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:06.055950 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:06.055894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:06.212519 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:06.212488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:07.327373 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.327336    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"]
Aug 04 16:48:07.331514 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.331495    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.333223 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.333201    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-4e1c51-serving-cert\""
Aug 04 16:48:07.341131 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.340878    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"]
Aug 04 16:48:07.357258 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.357197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:07.488372 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.488333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.488535 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.488435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.488535 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.488474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb4bs\" (UniqueName: \"kubernetes.io/projected/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-kube-api-access-nb4bs\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.589989 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.589861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.589989 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.589950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb4bs\" (UniqueName: \"kubernetes.io/projected/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-kube-api-access-nb4bs\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.589989 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.589989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.590290 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:48:07.590111    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-serving-cert: secret "maas-api-e2e-shared-a-4e1c51-serving-cert" not found
Aug 04 16:48:07.590290 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:48:07.590166    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls podName:429210e6-a47b-41ab-ba00-c6f70d3cc2cc nodeName:}" failed. No retries permitted until 2026-08-04 16:48:08.090150326 +0000 UTC m=+2768.916847777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls") pod "maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv" (UID: "429210e6-a47b-41ab-ba00-c6f70d3cc2cc") : secret "maas-api-e2e-shared-a-4e1c51-serving-cert" not found
Aug 04 16:48:07.590527 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.590505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.598590 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.598565    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb4bs\" (UniqueName: \"kubernetes.io/projected/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-kube-api-access-nb4bs\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:07.749993 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.749959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:07.853174 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.853088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:07.951376 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:07.951341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:08.095434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:08.095395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:08.098434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:08.098408    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls\") pod \"maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:08.245591 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:08.245559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:08.390187 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:08.390123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"]
Aug 04 16:48:08.390609 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:48:08.390424    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429210e6_a47b_41ab_ba00_c6f70d3cc2cc.slice/crio-e93906fc08764294a6d72d05722122bd43dc52785a9357b7c455edb7c517bf2a WatchSource:0}: Error finding container e93906fc08764294a6d72d05722122bd43dc52785a9357b7c455edb7c517bf2a: Status 404 returned error can't find the container with id e93906fc08764294a6d72d05722122bd43dc52785a9357b7c455edb7c517bf2a
Aug 04 16:48:09.107739 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:09.107706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv" event={"ID":"429210e6-a47b-41ab-ba00-c6f70d3cc2cc","Type":"ContainerStarted","Data":"f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b"}
Aug 04 16:48:09.107941 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:09.107780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv" event={"ID":"429210e6-a47b-41ab-ba00-c6f70d3cc2cc","Type":"ContainerStarted","Data":"e93906fc08764294a6d72d05722122bd43dc52785a9357b7c455edb7c517bf2a"}
Aug 04 16:48:09.107941 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:09.107803    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:09.126623 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:09.126553    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv" podStartSLOduration=1.5437238629999999 podStartE2EDuration="2.126531489s" totalImagesPullingTime="582.807626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:48:09.12379044 +0000 UTC m=+2769.950487912" watchObservedRunningTime="2026-08-04 16:48:09.126531489 +0000 UTC m=+2769.953228962"
Aug 04 16:48:09.723164 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:09.723133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:15.120114 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:15.120085    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 16:48:20.075190 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:20.075154    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Aug 04 16:48:20.075619 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:20.075220    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Aug 04 16:48:20.180214 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:20.180134    2563 generic.go:356] "Generic (PLEG): container finished" podID="6940798a-9168-4072-849b-929ae2c8e70d" containerID="d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c" exitCode=0
Aug 04 16:48:20.180370 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:20.180210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" event={"ID":"6940798a-9168-4072-849b-929ae2c8e70d","Type":"ContainerDied","Data":"d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c"}
Aug 04 16:48:20.180647 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:20.180627    2563 scope.go:117] "RemoveContainer" containerID="d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c"
Aug 04 16:48:20.181756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:20.181723    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:48:20.181841 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:20.181820    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:48:20.181890 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:20.181864    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:48:21.192217 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:21.192182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" event={"ID":"6940798a-9168-4072-849b-929ae2c8e70d","Type":"ContainerStarted","Data":"1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774"}
Aug 04 16:48:22.033982 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:22.033945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:22.034208 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:22.034185    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Aug 04 16:48:22.034253 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:22.034236    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Aug 04 16:48:23.034548 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:23.034511    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Aug 04 16:48:23.034963 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:23.034568    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Aug 04 16:48:24.034846 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:24.034806    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Aug 04 16:48:24.035251 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:24.034863    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Aug 04 16:48:25.034219 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:25.034184    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Aug 04 16:48:25.034388 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:25.034245    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Aug 04 16:48:26.034231 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:26.034195    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Aug 04 16:48:26.034677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:26.034251    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Aug 04 16:48:27.038800 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:27.038768    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:27.039272 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:27.039124    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:27.040018 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:27.039997    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 16:48:31.163732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:31.163683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:31.532616 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:31.532583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:31.956636 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:31.956505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:32.431881 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:32.431849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:34.512407 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:34.512370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:34.611588 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:34.611559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:35.735128 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.735089    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"]
Aug 04 16:48:35.738234 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.738137    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.740146 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.740123    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-222eca-serving-cert\""
Aug 04 16:48:35.749564 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.749537    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"]
Aug 04 16:48:35.770125 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.770086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:35.855353 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.855315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn6hj\" (UniqueName: \"kubernetes.io/projected/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-kube-api-access-wn6hj\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.855528 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.855397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.855528 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.855444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-maas-api-tls\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.956359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.956325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn6hj\" (UniqueName: \"kubernetes.io/projected/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-kube-api-access-wn6hj\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.956359 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.956375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.956610 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.956559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-maas-api-tls\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.957049 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.957033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.959380 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.959356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-maas-api-tls\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.966280 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.966254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn6hj\" (UniqueName: \"kubernetes.io/projected/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-kube-api-access-wn6hj\") pod \"maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:35.995082 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:35.995036    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:36.051288 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:36.051252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:36.208199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:36.208163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"]
Aug 04 16:48:36.208563 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:48:36.208540    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea0bad5_0d8a_4a3d_a2c9_9c260528a0b1.slice/crio-3c66700baedf0b5d9e477ac697935d488cfa26fda6753470ccaf0446cfcc2db8 WatchSource:0}: Error finding container 3c66700baedf0b5d9e477ac697935d488cfa26fda6753470ccaf0446cfcc2db8: Status 404 returned error can't find the container with id 3c66700baedf0b5d9e477ac697935d488cfa26fda6753470ccaf0446cfcc2db8
Aug 04 16:48:36.284527 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:36.284426    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z" event={"ID":"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1","Type":"ContainerStarted","Data":"3c66700baedf0b5d9e477ac697935d488cfa26fda6753470ccaf0446cfcc2db8"}
Aug 04 16:48:36.342381 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:36.342340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:36.443045 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:36.443007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:48:37.292726 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:37.292692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z" event={"ID":"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1","Type":"ContainerStarted","Data":"fdb459fd778c66ad2795fa166ee23c5b2d2f65f5978b624db8b7eed212e29fe3"}
Aug 04 16:48:37.293187 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:37.292756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:37.312204 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:37.312146    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z" podStartSLOduration=1.5468346400000001 podStartE2EDuration="2.312129347s" totalImagesPullingTime="765.294707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:48:37.311875823 +0000 UTC m=+2798.138573296" watchObservedRunningTime="2026-08-04 16:48:37.312129347 +0000 UTC m=+2798.138826818"
Aug 04 16:48:43.304677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:43.304647    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 16:48:59.590411 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:48:59.590374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:49:19.842338 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:49:19.842285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:50:04.335227 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:50:04.335128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:50:33.209290 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:50:33.209243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:50:44.485151 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:50:44.485095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:50:48.823661 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:50:48.823626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:51:13.110709 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:51:13.110675    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:51:24.580001 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:51:24.579920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:51:33.773296 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:51:33.773249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:51:59.940323 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:51:59.940296    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:51:59.951630 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:51:59.951607    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:52:06.263501 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:52:06.263460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:52:06.364929 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:52:06.364874    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:54:03.573972 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:54:03.573938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:54:04.334059 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:54:04.334007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:54:08.988379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:54:08.988336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:54:10.832335 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:54:10.832296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:54:43.599809 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:54:43.599719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:55:50.662367 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:55:50.662262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:55:52.422711 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:55:52.422672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:56:13.362373 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:56:13.362312    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:56:29.080209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:56:29.080167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:56:42.538370 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:56:42.538330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:56:59.979165 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:56:59.979128    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:56:59.991368 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:56:59.991344    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 16:57:42.763581 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:57:42.763490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:05.047344 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:05.047306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:05.810532 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:05.810489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:13.153510 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.153465    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:13.156845 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.156829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:13.158977 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.158956    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zj6q8\""
Aug 04 16:58:13.164454 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.164428    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:13.254265 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.254227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkbh8\" (UniqueName: \"kubernetes.io/projected/31799256-b50d-4c99-b1a9-226d811e957d-kube-api-access-xkbh8\") pod \"test-curl-7667-140255613723392\" (UID: \"31799256-b50d-4c99-b1a9-226d811e957d\") " pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:13.355324 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.355287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkbh8\" (UniqueName: \"kubernetes.io/projected/31799256-b50d-4c99-b1a9-226d811e957d-kube-api-access-xkbh8\") pod \"test-curl-7667-140255613723392\" (UID: \"31799256-b50d-4c99-b1a9-226d811e957d\") " pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:13.364067 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.364032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkbh8\" (UniqueName: \"kubernetes.io/projected/31799256-b50d-4c99-b1a9-226d811e957d-kube-api-access-xkbh8\") pod \"test-curl-7667-140255613723392\" (UID: \"31799256-b50d-4c99-b1a9-226d811e957d\") " pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:13.467802 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.467716    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:13.606342 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.606319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:13.608038 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:58:13.608010    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31799256_b50d_4c99_b1a9_226d811e957d.slice/crio-c8e9d355f9aca831e8e0ca2589ac4e03bcde4daf4e416cd8a35538ecea573563 WatchSource:0}: Error finding container c8e9d355f9aca831e8e0ca2589ac4e03bcde4daf4e416cd8a35538ecea573563: Status 404 returned error can't find the container with id c8e9d355f9aca831e8e0ca2589ac4e03bcde4daf4e416cd8a35538ecea573563
Aug 04 16:58:13.609433 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.609414    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:58:13.716448 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:13.716417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-140255613723392" event={"ID":"31799256-b50d-4c99-b1a9-226d811e957d","Type":"ContainerStarted","Data":"c8e9d355f9aca831e8e0ca2589ac4e03bcde4daf4e416cd8a35538ecea573563"}
Aug 04 16:58:14.718181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:14.718086    2563 generic.go:356] "Generic (PLEG): container finished" podID="31799256-b50d-4c99-b1a9-226d811e957d" containerID="ae227eb10776f395316dec6729e90429f68299782af5b9ca4c3fbe234861c71b" exitCode=0
Aug 04 16:58:14.718181 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:14.718148    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-140255613723392" event={"ID":"31799256-b50d-4c99-b1a9-226d811e957d","Type":"ContainerDied","Data":"ae227eb10776f395316dec6729e90429f68299782af5b9ca4c3fbe234861c71b"}
Aug 04 16:58:15.859140 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:15.859115    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:15.878677 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:15.878650    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkbh8\" (UniqueName: \"kubernetes.io/projected/31799256-b50d-4c99-b1a9-226d811e957d-kube-api-access-xkbh8\") pod \"31799256-b50d-4c99-b1a9-226d811e957d\" (UID: \"31799256-b50d-4c99-b1a9-226d811e957d\") "
Aug 04 16:58:15.879466 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:15.879440    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7667-140255613723392_31799256-b50d-4c99-b1a9-226d811e957d/test-curl-7667-140255613723392/0.log"
Aug 04 16:58:15.880927 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:15.880891    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31799256-b50d-4c99-b1a9-226d811e957d-kube-api-access-xkbh8" (OuterVolumeSpecName: "kube-api-access-xkbh8") pod "31799256-b50d-4c99-b1a9-226d811e957d" (UID: "31799256-b50d-4c99-b1a9-226d811e957d"). InnerVolumeSpecName "kube-api-access-xkbh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:58:15.906796 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:15.906761    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:15.910751 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:15.910727    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:15.979998 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:15.979929    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkbh8\" (UniqueName: \"kubernetes.io/projected/31799256-b50d-4c99-b1a9-226d811e957d-kube-api-access-xkbh8\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:58:16.029921 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.029880    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:16.030460 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.030437    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31799256-b50d-4c99-b1a9-226d811e957d" containerName="test-curl-7667-140255613723392"
Aug 04 16:58:16.030460 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.030460    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31799256-b50d-4c99-b1a9-226d811e957d" containerName="test-curl-7667-140255613723392"
Aug 04 16:58:16.030604 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.030574    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="31799256-b50d-4c99-b1a9-226d811e957d" containerName="test-curl-7667-140255613723392"
Aug 04 16:58:16.033573 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.033558    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:16.037513 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.037480    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:16.081153 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.081117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hj9j\" (UniqueName: \"kubernetes.io/projected/474631a5-9dec-444b-a4ae-a675cee25485-kube-api-access-9hj9j\") pod \"test-curl-7667-140255613723392\" (UID: \"474631a5-9dec-444b-a4ae-a675cee25485\") " pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:16.182012 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.181972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hj9j\" (UniqueName: \"kubernetes.io/projected/474631a5-9dec-444b-a4ae-a675cee25485-kube-api-access-9hj9j\") pod \"test-curl-7667-140255613723392\" (UID: \"474631a5-9dec-444b-a4ae-a675cee25485\") " pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:16.190473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.190450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hj9j\" (UniqueName: \"kubernetes.io/projected/474631a5-9dec-444b-a4ae-a675cee25485-kube-api-access-9hj9j\") pod \"test-curl-7667-140255613723392\" (UID: \"474631a5-9dec-444b-a4ae-a675cee25485\") " pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:16.344769 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.344735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:16.480968 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.480944    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:16.482227 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:58:16.482203    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod474631a5_9dec_444b_a4ae_a675cee25485.slice/crio-648d44ad6be97f9b6e5aa47ee1418a3284cfc73521202774c37e91601b3a81ee WatchSource:0}: Error finding container 648d44ad6be97f9b6e5aa47ee1418a3284cfc73521202774c37e91601b3a81ee: Status 404 returned error can't find the container with id 648d44ad6be97f9b6e5aa47ee1418a3284cfc73521202774c37e91601b3a81ee
Aug 04 16:58:16.729958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.729849    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:16.729958 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.729890    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8e9d355f9aca831e8e0ca2589ac4e03bcde4daf4e416cd8a35538ecea573563"
Aug 04 16:58:16.731180 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.731142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-140255613723392" event={"ID":"474631a5-9dec-444b-a4ae-a675cee25485","Type":"ContainerStarted","Data":"648d44ad6be97f9b6e5aa47ee1418a3284cfc73521202774c37e91601b3a81ee"}
Aug 04 16:58:16.741189 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:16.741159    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7667-140255613723392" oldPodUID="31799256-b50d-4c99-b1a9-226d811e957d" podUID="474631a5-9dec-444b-a4ae-a675cee25485"
Aug 04 16:58:17.717752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:17.717721    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31799256-b50d-4c99-b1a9-226d811e957d" path="/var/lib/kubelet/pods/31799256-b50d-4c99-b1a9-226d811e957d/volumes"
Aug 04 16:58:17.738348 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:17.738319    2563 generic.go:356] "Generic (PLEG): container finished" podID="474631a5-9dec-444b-a4ae-a675cee25485" containerID="768d20af209bfab66002f1f9eb5200191bb06a4c649984e43b063411871d3614" exitCode=0
Aug 04 16:58:17.738513 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:17.738405    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-140255613723392" event={"ID":"474631a5-9dec-444b-a4ae-a675cee25485","Type":"ContainerDied","Data":"768d20af209bfab66002f1f9eb5200191bb06a4c649984e43b063411871d3614"}
Aug 04 16:58:18.881016 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:18.880991    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:18.902674 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:18.902644    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7667-140255613723392_474631a5-9dec-444b-a4ae-a675cee25485/test-curl-7667-140255613723392/0.log"
Aug 04 16:58:18.908881 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:18.908857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hj9j\" (UniqueName: \"kubernetes.io/projected/474631a5-9dec-444b-a4ae-a675cee25485-kube-api-access-9hj9j\") pod \"474631a5-9dec-444b-a4ae-a675cee25485\" (UID: \"474631a5-9dec-444b-a4ae-a675cee25485\") "
Aug 04 16:58:18.911032 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:18.911007    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/474631a5-9dec-444b-a4ae-a675cee25485-kube-api-access-9hj9j" (OuterVolumeSpecName: "kube-api-access-9hj9j") pod "474631a5-9dec-444b-a4ae-a675cee25485" (UID: "474631a5-9dec-444b-a4ae-a675cee25485"). InnerVolumeSpecName "kube-api-access-9hj9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:58:18.927840 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:18.927817    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:18.930182 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:18.930162    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7667-140255613723392"]
Aug 04 16:58:19.010156 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.010070    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hj9j\" (UniqueName: \"kubernetes.io/projected/474631a5-9dec-444b-a4ae-a675cee25485-kube-api-access-9hj9j\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:58:19.051510 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.051479    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:19.051961 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.051947    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="474631a5-9dec-444b-a4ae-a675cee25485" containerName="test-curl-7667-140255613723392"
Aug 04 16:58:19.052017 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.051962    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="474631a5-9dec-444b-a4ae-a675cee25485" containerName="test-curl-7667-140255613723392"
Aug 04 16:58:19.052060 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.052034    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="474631a5-9dec-444b-a4ae-a675cee25485" containerName="test-curl-7667-140255613723392"
Aug 04 16:58:19.055114 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.055099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:19.059948 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.059923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:19.110819 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.110776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqcmj\" (UniqueName: \"kubernetes.io/projected/ba64086e-899c-40e1-925e-08ef8bf2f4fc-kube-api-access-fqcmj\") pod \"test-curl-7667-140255613726416\" (UID: \"ba64086e-899c-40e1-925e-08ef8bf2f4fc\") " pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:19.211761 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.211729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqcmj\" (UniqueName: \"kubernetes.io/projected/ba64086e-899c-40e1-925e-08ef8bf2f4fc-kube-api-access-fqcmj\") pod \"test-curl-7667-140255613726416\" (UID: \"ba64086e-899c-40e1-925e-08ef8bf2f4fc\") " pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:19.221845 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.221822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqcmj\" (UniqueName: \"kubernetes.io/projected/ba64086e-899c-40e1-925e-08ef8bf2f4fc-kube-api-access-fqcmj\") pod \"test-curl-7667-140255613726416\" (UID: \"ba64086e-899c-40e1-925e-08ef8bf2f4fc\") " pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:19.366203 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.366127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:19.507121 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.507091    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:19.508716 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:58:19.508689    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba64086e_899c_40e1_925e_08ef8bf2f4fc.slice/crio-36146eed89fcc13d12b8089ad9d8ad8fc4982f95ed6018b54b1b120ac6b1b14b WatchSource:0}: Error finding container 36146eed89fcc13d12b8089ad9d8ad8fc4982f95ed6018b54b1b120ac6b1b14b: Status 404 returned error can't find the container with id 36146eed89fcc13d12b8089ad9d8ad8fc4982f95ed6018b54b1b120ac6b1b14b
Aug 04 16:58:19.717836 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.717760    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="474631a5-9dec-444b-a4ae-a675cee25485" path="/var/lib/kubelet/pods/474631a5-9dec-444b-a4ae-a675cee25485/volumes"
Aug 04 16:58:19.750275 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.750244    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613723392"
Aug 04 16:58:19.750275 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.750260    2563 scope.go:117] "RemoveContainer" containerID="768d20af209bfab66002f1f9eb5200191bb06a4c649984e43b063411871d3614"
Aug 04 16:58:19.751590 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:19.751564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-140255613726416" event={"ID":"ba64086e-899c-40e1-925e-08ef8bf2f4fc","Type":"ContainerStarted","Data":"36146eed89fcc13d12b8089ad9d8ad8fc4982f95ed6018b54b1b120ac6b1b14b"}
Aug 04 16:58:20.759994 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:20.759960    2563 generic.go:356] "Generic (PLEG): container finished" podID="ba64086e-899c-40e1-925e-08ef8bf2f4fc" containerID="75c813210c8b30b35cf33ee7cda72bc4c9356bd3040959df57e441690914c6e8" exitCode=0
Aug 04 16:58:20.760362 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:20.760046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-140255613726416" event={"ID":"ba64086e-899c-40e1-925e-08ef8bf2f4fc","Type":"ContainerDied","Data":"75c813210c8b30b35cf33ee7cda72bc4c9356bd3040959df57e441690914c6e8"}
Aug 04 16:58:21.904408 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:21.904384    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:21.923360 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:21.923332    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7667-140255613726416_ba64086e-899c-40e1-925e-08ef8bf2f4fc/test-curl-7667-140255613726416/0.log"
Aug 04 16:58:21.937663 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:21.937633    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqcmj\" (UniqueName: \"kubernetes.io/projected/ba64086e-899c-40e1-925e-08ef8bf2f4fc-kube-api-access-fqcmj\") pod \"ba64086e-899c-40e1-925e-08ef8bf2f4fc\" (UID: \"ba64086e-899c-40e1-925e-08ef8bf2f4fc\") "
Aug 04 16:58:21.939743 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:21.939720    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba64086e-899c-40e1-925e-08ef8bf2f4fc-kube-api-access-fqcmj" (OuterVolumeSpecName: "kube-api-access-fqcmj") pod "ba64086e-899c-40e1-925e-08ef8bf2f4fc" (UID: "ba64086e-899c-40e1-925e-08ef8bf2f4fc"). InnerVolumeSpecName "kube-api-access-fqcmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:58:21.946378 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:21.946357    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:21.951927 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:21.951894    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:22.038570 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:22.038513    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqcmj\" (UniqueName: \"kubernetes.io/projected/ba64086e-899c-40e1-925e-08ef8bf2f4fc-kube-api-access-fqcmj\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 16:58:22.771740 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:22.771712    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:22.771740 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:22.771729    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36146eed89fcc13d12b8089ad9d8ad8fc4982f95ed6018b54b1b120ac6b1b14b"
Aug 04 16:58:22.784202 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:58:22.784169    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7667-140255613726416\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="ba64086e-899c-40e1-925e-08ef8bf2f4fc" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:23.718470 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:23.718435    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba64086e-899c-40e1-925e-08ef8bf2f4fc" path="/var/lib/kubelet/pods/ba64086e-899c-40e1-925e-08ef8bf2f4fc/volumes"
Aug 04 16:58:25.865488 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:25.865454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:26.193784 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:26.193691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:26.677456 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:26.677415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:29.160804 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:29.160757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:29.261150 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:29.261113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:30.802474 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.802443    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"]
Aug 04 16:58:30.802960 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.802930    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba64086e-899c-40e1-925e-08ef8bf2f4fc" containerName="test-curl-7667-140255613726416"
Aug 04 16:58:30.803016 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.802965    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba64086e-899c-40e1-925e-08ef8bf2f4fc" containerName="test-curl-7667-140255613726416"
Aug 04 16:58:30.803143 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.803132    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba64086e-899c-40e1-925e-08ef8bf2f4fc" containerName="test-curl-7667-140255613726416"
Aug 04 16:58:30.808473 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.808456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:30.811470 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.811450    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-a125dd-serving-cert\""
Aug 04 16:58:30.827719 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.827673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"]
Aug 04 16:58:30.841700 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.841672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:30.919059 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.919028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780e3be8-ab63-4e16-8209-0e1266a71631-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:30.919220 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.919135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx9b5\" (UniqueName: \"kubernetes.io/projected/780e3be8-ab63-4e16-8209-0e1266a71631-kube-api-access-rx9b5\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:30.919220 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:30.919197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.020209 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.020176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx9b5\" (UniqueName: \"kubernetes.io/projected/780e3be8-ab63-4e16-8209-0e1266a71631-kube-api-access-rx9b5\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.020361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.020238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.020361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.020279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780e3be8-ab63-4e16-8209-0e1266a71631-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.020458 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:58:31.020391    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-serving-cert: secret "maas-api-e2e-ipp-a-a125dd-serving-cert" not found
Aug 04 16:58:31.020509 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:58:31.020496    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls podName:780e3be8-ab63-4e16-8209-0e1266a71631 nodeName:}" failed. No retries permitted until 2026-08-04 16:58:31.520474612 +0000 UTC m=+3392.347172072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls") pod "maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2" (UID: "780e3be8-ab63-4e16-8209-0e1266a71631") : secret "maas-api-e2e-ipp-a-a125dd-serving-cert" not found
Aug 04 16:58:31.020962 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.020928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780e3be8-ab63-4e16-8209-0e1266a71631-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.028651 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.028631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx9b5\" (UniqueName: \"kubernetes.io/projected/780e3be8-ab63-4e16-8209-0e1266a71631-kube-api-access-rx9b5\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.380379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.380339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:31.480038 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.479998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:31.526521 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.526489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.529217 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.529196    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.538776 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.538750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:31.582566 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.582537    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"]
Aug 04 16:58:31.586693 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.586677    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:31.588758 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.588741    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a125dd\""
Aug 04 16:58:31.589115 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.589096    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a125dd-dockercfg-kr7fl\""
Aug 04 16:58:31.597249 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.597230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"]
Aug 04 16:58:31.627045 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.627015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dpwx\" (UniqueName: \"kubernetes.io/projected/f3dc45b6-df91-4554-8c62-ecaf83f3d192-kube-api-access-4dpwx\") pod \"payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8\" (UID: \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:31.627186 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.627156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3dc45b6-df91-4554-8c62-ecaf83f3d192-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8\" (UID: \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:31.722043 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.721960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:31.728472 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.728450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dpwx\" (UniqueName: \"kubernetes.io/projected/f3dc45b6-df91-4554-8c62-ecaf83f3d192-kube-api-access-4dpwx\") pod \"payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8\" (UID: \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:31.728574 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.728557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3dc45b6-df91-4554-8c62-ecaf83f3d192-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8\" (UID: \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:31.729428 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.729382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3dc45b6-df91-4554-8c62-ecaf83f3d192-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8\" (UID: \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:31.736870 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.736839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dpwx\" (UniqueName: \"kubernetes.io/projected/f3dc45b6-df91-4554-8c62-ecaf83f3d192-kube-api-access-4dpwx\") pod \"payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8\" (UID: \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:31.866644 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.866613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"]
Aug 04 16:58:31.868482 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:58:31.868455    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780e3be8_ab63_4e16_8209_0e1266a71631.slice/crio-0fd87550314377b0caec0b95866719a1921edf32b752d735304da5b87afe90ab WatchSource:0}: Error finding container 0fd87550314377b0caec0b95866719a1921edf32b752d735304da5b87afe90ab: Status 404 returned error can't find the container with id 0fd87550314377b0caec0b95866719a1921edf32b752d735304da5b87afe90ab
Aug 04 16:58:31.899101 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:31.899077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:32.046379 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.046349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"]
Aug 04 16:58:32.047134 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:58:32.047108    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3dc45b6_df91_4554_8c62_ecaf83f3d192.slice/crio-ad03bdd78c2adb58ac8f2bebb3a97c799c338c731b4363f7bf004233e956d941 WatchSource:0}: Error finding container ad03bdd78c2adb58ac8f2bebb3a97c799c338c731b4363f7bf004233e956d941: Status 404 returned error can't find the container with id ad03bdd78c2adb58ac8f2bebb3a97c799c338c731b4363f7bf004233e956d941
Aug 04 16:58:32.847040 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.847003    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2" event={"ID":"780e3be8-ab63-4e16-8209-0e1266a71631","Type":"ContainerStarted","Data":"52364ef951d40d13ce8efc5941a564ccb7da837399e0ff49b4ea6ba9269f7fcf"}
Aug 04 16:58:32.847207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.847074    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:32.847207 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.847097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2" event={"ID":"780e3be8-ab63-4e16-8209-0e1266a71631","Type":"ContainerStarted","Data":"0fd87550314377b0caec0b95866719a1921edf32b752d735304da5b87afe90ab"}
Aug 04 16:58:32.848654 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.848631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8" event={"ID":"f3dc45b6-df91-4554-8c62-ecaf83f3d192","Type":"ContainerStarted","Data":"dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3"}
Aug 04 16:58:32.848766 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.848671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8" event={"ID":"f3dc45b6-df91-4554-8c62-ecaf83f3d192","Type":"ContainerStarted","Data":"ad03bdd78c2adb58ac8f2bebb3a97c799c338c731b4363f7bf004233e956d941"}
Aug 04 16:58:32.848766 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.848714    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:32.864220 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.864150    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2" podStartSLOduration=2.341434149 podStartE2EDuration="2.864128559s" totalImagesPullingTime="522.69441ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:58:32.862838939 +0000 UTC m=+3393.689536412" watchObservedRunningTime="2026-08-04 16:58:32.864128559 +0000 UTC m=+3393.690826032"
Aug 04 16:58:32.878342 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:32.878288    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8" podStartSLOduration=1.8782728 podStartE2EDuration="1.8782728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:58:32.876810646 +0000 UTC m=+3393.703508120" watchObservedRunningTime="2026-08-04 16:58:32.8782728 +0000 UTC m=+3393.704970272"
Aug 04 16:58:38.860188 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:38.860158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 16:58:43.856865 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:43.856835    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 16:58:54.250852 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:54.250760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:54.958185 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:54.958142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:55.258452 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.258416    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"]
Aug 04 16:58:55.262886 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.262854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.264923 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.264875    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-3589b4-openshift-default-dockercfg-hlcdb\""
Aug 04 16:58:55.274025 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.274003    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"]
Aug 04 16:58:55.280430 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.280402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:55.355310 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istiod-ca-cert\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.355511 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-credential-socket\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.355511 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-socket\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.355511 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-podinfo\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.355756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-token\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.355756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-certs\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.355756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-data\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.355756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-envoy\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.355756 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.355725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjt5v\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-kube-api-access-hjt5v\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.449847 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.449813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:55.457004 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.456976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-credential-socket\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-socket\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-podinfo\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-token\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-certs\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457166 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-data\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-envoy\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjt5v\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-kube-api-access-hjt5v\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457434 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istiod-ca-cert\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457607 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457449    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-credential-socket\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457696 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-socket\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457758 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-data\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457758 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-certs\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.457898 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.457883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istiod-ca-cert\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.460191 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.460165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-envoy\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.460309 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.460295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-podinfo\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.464891 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.464869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-token\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.465118 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.465101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjt5v\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-kube-api-access-hjt5v\") pod \"e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") " pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.575556 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.575473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:55.718758 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.718735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"]
Aug 04 16:58:55.719529 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:58:55.719499    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe3bcaa_492f_4f0c_a41b_ec9c16e1bb71.slice/crio-a8be9a7a16f95f045bf54a47908bae5e0673994dd1f419184d1a05bd79fbba4a WatchSource:0}: Error finding container a8be9a7a16f95f045bf54a47908bae5e0673994dd1f419184d1a05bd79fbba4a: Status 404 returned error can't find the container with id a8be9a7a16f95f045bf54a47908bae5e0673994dd1f419184d1a05bd79fbba4a
Aug 04 16:58:55.721744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.721712    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:58:55.721813 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.721778    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:58:55.721852 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.721826    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:58:55.994268 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.994229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" event={"ID":"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71","Type":"ContainerStarted","Data":"743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48"}
Aug 04 16:58:55.994452 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:55.994292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" event={"ID":"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71","Type":"ContainerStarted","Data":"a8be9a7a16f95f045bf54a47908bae5e0673994dd1f419184d1a05bd79fbba4a"}
Aug 04 16:58:56.015155 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:56.015099    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podStartSLOduration=1.015083017 podStartE2EDuration="1.015083017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:58:56.012292013 +0000 UTC m=+3416.838989485" watchObservedRunningTime="2026-08-04 16:58:56.015083017 +0000 UTC m=+3416.841780490"
Aug 04 16:58:56.575919 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:56.575879    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:56.581277 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:56.581250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:57.000300 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:57.000271    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:57.001289 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:57.001266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:58:57.971199 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:57.971162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:58.078173 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:58.078138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:59.351404 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.351366    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"]
Aug 04 16:58:59.355949 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.355921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.358640 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.358193    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-3589b4-serving-cert\""
Aug 04 16:58:59.364169 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.364143    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"]
Aug 04 16:58:59.380587 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.380558    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:59.397426 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.397392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77dbt\" (UniqueName: \"kubernetes.io/projected/440b1d57-ea16-4d61-9f0d-108fa165f36a-kube-api-access-77dbt\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.397586 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.397433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.397586 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.397517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/440b1d57-ea16-4d61-9f0d-108fa165f36a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.498703 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.498665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77dbt\" (UniqueName: \"kubernetes.io/projected/440b1d57-ea16-4d61-9f0d-108fa165f36a-kube-api-access-77dbt\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.498882 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.498709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.498882 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.498746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/440b1d57-ea16-4d61-9f0d-108fa165f36a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.499051 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:58:59.498892    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-serving-cert: secret "maas-api-e2e-ipp-b-3589b4-serving-cert" not found
Aug 04 16:58:59.499051 ip-10-0-131-60 kubenswrapper[2563]: E0804 16:58:59.499000    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls podName:440b1d57-ea16-4d61-9f0d-108fa165f36a nodeName:}" failed. No retries permitted until 2026-08-04 16:58:59.998981006 +0000 UTC m=+3420.825678457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls") pod "maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l" (UID: "440b1d57-ea16-4d61-9f0d-108fa165f36a") : secret "maas-api-e2e-ipp-b-3589b4-serving-cert" not found
Aug 04 16:58:59.499464 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.499446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/440b1d57-ea16-4d61-9f0d-108fa165f36a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.506849 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.506826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77dbt\" (UniqueName: \"kubernetes.io/projected/440b1d57-ea16-4d61-9f0d-108fa165f36a-kube-api-access-77dbt\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:58:59.585074 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.585037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:59.838472 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.838434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:58:59.938976 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:58:59.938899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:59:00.004138 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:00.004104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:59:00.006589 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:00.006558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:59:00.271374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:00.271347    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:59:00.413599 ip-10-0-131-60 kubenswrapper[2563]: W0804 16:59:00.413565    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440b1d57_ea16_4d61_9f0d_108fa165f36a.slice/crio-a8439bc3860e22c4915d65a19d3f8131f8fecb54c53dad7f15547dbe38b18731 WatchSource:0}: Error finding container a8439bc3860e22c4915d65a19d3f8131f8fecb54c53dad7f15547dbe38b18731: Status 404 returned error can't find the container with id a8439bc3860e22c4915d65a19d3f8131f8fecb54c53dad7f15547dbe38b18731
Aug 04 16:59:00.413977 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:00.413876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"]
Aug 04 16:59:01.029361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:01.029280    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l" event={"ID":"440b1d57-ea16-4d61-9f0d-108fa165f36a","Type":"ContainerStarted","Data":"0b45805a590dc6a6a374e9ac0f189b6d710b886cd7f0665657d2e28a7709b6d7"}
Aug 04 16:59:01.029361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:01.029336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l" event={"ID":"440b1d57-ea16-4d61-9f0d-108fa165f36a","Type":"ContainerStarted","Data":"a8439bc3860e22c4915d65a19d3f8131f8fecb54c53dad7f15547dbe38b18731"}
Aug 04 16:59:01.029361 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:01.029357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:59:01.048692 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:01.048647    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l" podStartSLOduration=1.710509372 podStartE2EDuration="2.048630704s" totalImagesPullingTime="338.121332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:59:01.045885556 +0000 UTC m=+3421.872583031" watchObservedRunningTime="2026-08-04 16:59:01.048630704 +0000 UTC m=+3421.875328175"
Aug 04 16:59:02.326732 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:02.326693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:59:02.388819 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:02.388786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:59:07.041459 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:07.041432    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 16:59:12.344374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:12.343740    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": read tcp 10.134.0.2:51250->10.134.0.94:15021: read: connection reset by peer" start-of-body=
Aug 04 16:59:12.344374 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:12.343806    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": read tcp 10.134.0.2:51250->10.134.0.94:15021: read: connection reset by peer"
Aug 04 16:59:12.778791 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:12.778749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 16:59:13.110038 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:13.109956    2563 generic.go:356] "Generic (PLEG): container finished" podID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerID="743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48" exitCode=0
Aug 04 16:59:13.110186 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:13.110031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" event={"ID":"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71","Type":"ContainerDied","Data":"743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48"}
Aug 04 16:59:13.110437 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:13.110423    2563 scope.go:117] "RemoveContainer" containerID="743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48"
Aug 04 16:59:13.111494 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:13.111469    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:59:13.111542 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:13.111531    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:59:13.111577 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:13.111564    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 16:59:14.118048 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:14.118006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" event={"ID":"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71","Type":"ContainerStarted","Data":"e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5"}
Aug 04 16:59:14.577024 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:14.576943    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:59:14.577539 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:14.577510    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Aug 04 16:59:14.577744 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:14.577716    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Aug 04 16:59:15.576283 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:15.576244    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Aug 04 16:59:15.576752 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:15.576329    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Aug 04 16:59:16.576283 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:16.576243    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Aug 04 16:59:16.576576 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:16.576545    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Aug 04 16:59:17.576557 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:17.576521    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Aug 04 16:59:17.576857 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:17.576828    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Aug 04 16:59:18.576128 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:18.576082    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Aug 04 16:59:18.576356 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:18.576155    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Aug 04 16:59:19.580463 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:19.580422    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:59:19.580969 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:19.580948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:59:19.581608 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:19.581590    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 16:59:19.799227 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:19.799191    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rjj74_67a520b9-9663-482d-90c1-b14743896017/payload-processing/0.log"
Aug 04 16:59:26.926564 ip-10-0-131-60 kubenswrapper[2563]: I0804 16:59:26.926531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:04.599987 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:04.599948    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"]
Aug 04 17:00:04.602730 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:04.602706    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764335-5n9kk"]
Aug 04 17:00:05.717652 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:05.717616    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d" path="/var/lib/kubelet/pods/5cc6d4b1-2ff8-4bfd-8a90-c6ae4ce3238d/volumes"
Aug 04 17:00:10.001012 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:10.000974    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8_f3dc45b6-df91-4554-8c62-ecaf83f3d192/payload-processing/0.log"
Aug 04 17:00:10.134890 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:10.134861    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rjj74_67a520b9-9663-482d-90c1-b14743896017/payload-processing/0.log"
Aug 04 17:00:10.584896 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:10.584854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:10.903202 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:10.903112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:11.041139 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:11.041102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:13.933374 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:13.933338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:14.033760 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:14.033709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:15.021455 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.021414    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"]
Aug 04 17:00:15.025103 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.025077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.027039 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.027016    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-72d790-serving-cert\""
Aug 04 17:00:15.035211 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.035189    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"]
Aug 04 17:00:15.051029 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.051002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:15.075018 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.074993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14d11674-6d1e-42fd-ba35-d761461882a6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.075151 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.075049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whxn4\" (UniqueName: \"kubernetes.io/projected/14d11674-6d1e-42fd-ba35-d761461882a6-kube-api-access-whxn4\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.075246 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.075226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.176092 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.176054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whxn4\" (UniqueName: \"kubernetes.io/projected/14d11674-6d1e-42fd-ba35-d761461882a6-kube-api-access-whxn4\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.176300 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.176183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.176300 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.176210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14d11674-6d1e-42fd-ba35-d761461882a6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.176426 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:00:15.176323    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-serving-cert: secret "maas-api-e2e-ipp-cleanup-72d790-serving-cert" not found
Aug 04 17:00:15.176426 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:00:15.176417    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls podName:14d11674-6d1e-42fd-ba35-d761461882a6 nodeName:}" failed. No retries permitted until 2026-08-04 17:00:15.676394238 +0000 UTC m=+3496.503091707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" (UID: "14d11674-6d1e-42fd-ba35-d761461882a6") : secret "maas-api-e2e-ipp-cleanup-72d790-serving-cert" not found
Aug 04 17:00:15.176863 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.176838    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14d11674-6d1e-42fd-ba35-d761461882a6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.185322 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.185299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whxn4\" (UniqueName: \"kubernetes.io/projected/14d11674-6d1e-42fd-ba35-d761461882a6-kube-api-access-whxn4\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.615817 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.615783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:15.680843 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.680812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:15.681028 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:00:15.680984    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-serving-cert: secret "maas-api-e2e-ipp-cleanup-72d790-serving-cert" not found
Aug 04 17:00:15.681074 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:00:15.681054    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls podName:14d11674-6d1e-42fd-ba35-d761461882a6 nodeName:}" failed. No retries permitted until 2026-08-04 17:00:16.681036955 +0000 UTC m=+3497.507734408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" (UID: "14d11674-6d1e-42fd-ba35-d761461882a6") : secret "maas-api-e2e-ipp-cleanup-72d790-serving-cert" not found
Aug 04 17:00:15.695026 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.694990    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:15.837302 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:15.837256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:16.692859 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:16.692826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:16.695466 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:16.695443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:16.838249 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:16.838214    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:16.987978 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:16.987951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"]
Aug 04 17:00:16.989228 ip-10-0-131-60 kubenswrapper[2563]: W0804 17:00:16.989202    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d11674_6d1e_42fd_ba35_d761461882a6.slice/crio-8c250c1e34cce7064ee8dfcb2f0d8541b5b703e18c52a4e81a316966944f8ed6 WatchSource:0}: Error finding container 8c250c1e34cce7064ee8dfcb2f0d8541b5b703e18c52a4e81a316966944f8ed6: Status 404 returned error can't find the container with id 8c250c1e34cce7064ee8dfcb2f0d8541b5b703e18c52a4e81a316966944f8ed6
Aug 04 17:00:17.515053 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:17.515014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" event={"ID":"14d11674-6d1e-42fd-ba35-d761461882a6","Type":"ContainerStarted","Data":"8c250c1e34cce7064ee8dfcb2f0d8541b5b703e18c52a4e81a316966944f8ed6"}
Aug 04 17:00:18.523203 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:18.523162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" event={"ID":"14d11674-6d1e-42fd-ba35-d761461882a6","Type":"ContainerStarted","Data":"10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492"}
Aug 04 17:00:18.523598 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:18.523352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:18.539235 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:18.539182    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" podStartSLOduration=3.374840538 podStartE2EDuration="4.539164352s" totalImagesPullingTime="1.164323814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:00:18.537698733 +0000 UTC m=+3499.364396204" watchObservedRunningTime="2026-08-04 17:00:18.539164352 +0000 UTC m=+3499.365861823"
Aug 04 17:00:24.534935 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:24.534840    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:28.474992 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:28.474957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:34.506473 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.506434    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"]
Aug 04 17:00:34.507263 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.507226    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" podUID="14d11674-6d1e-42fd-ba35-d761461882a6" containerName="maas-api" containerID="cri-o://10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492" gracePeriod=30
Aug 04 17:00:34.526373 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.526340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:34.530400 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.530375    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" podUID="14d11674-6d1e-42fd-ba35-d761461882a6" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.96:8443/health\": dial tcp 10.134.0.96:8443: connect: connection refused"
Aug 04 17:00:34.580996 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.580955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:34.634860 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.634824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:34.737040 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.736948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:34.767949 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.767863    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:34.884121 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.884026    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whxn4\" (UniqueName: \"kubernetes.io/projected/14d11674-6d1e-42fd-ba35-d761461882a6-kube-api-access-whxn4\") pod \"14d11674-6d1e-42fd-ba35-d761461882a6\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") "
Aug 04 17:00:34.884313 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.884147    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14d11674-6d1e-42fd-ba35-d761461882a6-openshift-service-ca\") pod \"14d11674-6d1e-42fd-ba35-d761461882a6\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") "
Aug 04 17:00:34.884313 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.884182    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls\") pod \"14d11674-6d1e-42fd-ba35-d761461882a6\" (UID: \"14d11674-6d1e-42fd-ba35-d761461882a6\") "
Aug 04 17:00:34.884714 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.884472    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14d11674-6d1e-42fd-ba35-d761461882a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "14d11674-6d1e-42fd-ba35-d761461882a6" (UID: "14d11674-6d1e-42fd-ba35-d761461882a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:00:34.886648 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.886593    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "14d11674-6d1e-42fd-ba35-d761461882a6" (UID: "14d11674-6d1e-42fd-ba35-d761461882a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:00:34.886765 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.886666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14d11674-6d1e-42fd-ba35-d761461882a6-kube-api-access-whxn4" (OuterVolumeSpecName: "kube-api-access-whxn4") pod "14d11674-6d1e-42fd-ba35-d761461882a6" (UID: "14d11674-6d1e-42fd-ba35-d761461882a6"). InnerVolumeSpecName "kube-api-access-whxn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:00:34.985397 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.985359    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whxn4\" (UniqueName: \"kubernetes.io/projected/14d11674-6d1e-42fd-ba35-d761461882a6-kube-api-access-whxn4\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:00:34.985397 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.985392    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14d11674-6d1e-42fd-ba35-d761461882a6-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:00:34.985609 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:34.985407    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14d11674-6d1e-42fd-ba35-d761461882a6-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:00:35.314717 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.314678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:35.629133 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.629044    2563 generic.go:356] "Generic (PLEG): container finished" podID="14d11674-6d1e-42fd-ba35-d761461882a6" containerID="10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492" exitCode=0
Aug 04 17:00:35.629133 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.629094    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"
Aug 04 17:00:35.629678 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.629144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" event={"ID":"14d11674-6d1e-42fd-ba35-d761461882a6","Type":"ContainerDied","Data":"10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492"}
Aug 04 17:00:35.629678 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.629199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd" event={"ID":"14d11674-6d1e-42fd-ba35-d761461882a6","Type":"ContainerDied","Data":"8c250c1e34cce7064ee8dfcb2f0d8541b5b703e18c52a4e81a316966944f8ed6"}
Aug 04 17:00:35.629678 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.629224    2563 scope.go:117] "RemoveContainer" containerID="10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492"
Aug 04 17:00:35.639632 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.639613    2563 scope.go:117] "RemoveContainer" containerID="10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492"
Aug 04 17:00:35.639961 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:00:35.639891    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492\": container with ID starting with 10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492 not found: ID does not exist" containerID="10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492"
Aug 04 17:00:35.640021 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.639975    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492"} err="failed to get container status \"10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492\": rpc error: code = NotFound desc = could not find container \"10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492\": container with ID starting with 10edb1f03193fc802a405476bf5897fbc2fea3e90f817191e625d42ac4d81492 not found: ID does not exist"
Aug 04 17:00:35.650036 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.650015    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"]
Aug 04 17:00:35.655025 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.655007    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-72d790-7c7cc5b7df-qjwrd"]
Aug 04 17:00:35.723410 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:35.723374    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14d11674-6d1e-42fd-ba35-d761461882a6" path="/var/lib/kubelet/pods/14d11674-6d1e-42fd-ba35-d761461882a6/volumes"
Aug 04 17:00:41.144601 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:41.144565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:41.241659 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:41.241623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:41.434430 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:41.434330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:41.599933 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:41.599870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:58.407193 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.407157    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"]
Aug 04 17:00:58.407630 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.407419    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2" podUID="780e3be8-ab63-4e16-8209-0e1266a71631" containerName="maas-api" containerID="cri-o://52364ef951d40d13ce8efc5941a564ccb7da837399e0ff49b4ea6ba9269f7fcf" gracePeriod=30
Aug 04 17:00:58.454773 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.454740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:00:58.456987 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.456956    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"]
Aug 04 17:00:58.457249 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.457199    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8" podUID="f3dc45b6-df91-4554-8c62-ecaf83f3d192" containerName="payload-processing" containerID="cri-o://dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3" gracePeriod=30
Aug 04 17:00:58.763640 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.763610    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 17:00:58.790013 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.789618    2563 generic.go:356] "Generic (PLEG): container finished" podID="780e3be8-ab63-4e16-8209-0e1266a71631" containerID="52364ef951d40d13ce8efc5941a564ccb7da837399e0ff49b4ea6ba9269f7fcf" exitCode=0
Aug 04 17:00:58.790013 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.789857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2" event={"ID":"780e3be8-ab63-4e16-8209-0e1266a71631","Type":"ContainerDied","Data":"52364ef951d40d13ce8efc5941a564ccb7da837399e0ff49b4ea6ba9269f7fcf"}
Aug 04 17:00:58.792271 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.792248    2563 generic.go:356] "Generic (PLEG): container finished" podID="f3dc45b6-df91-4554-8c62-ecaf83f3d192" containerID="dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3" exitCode=0
Aug 04 17:00:58.792608 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.792376    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"
Aug 04 17:00:58.793313 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.792394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8" event={"ID":"f3dc45b6-df91-4554-8c62-ecaf83f3d192","Type":"ContainerDied","Data":"dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3"}
Aug 04 17:00:58.793313 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.793267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8" event={"ID":"f3dc45b6-df91-4554-8c62-ecaf83f3d192","Type":"ContainerDied","Data":"ad03bdd78c2adb58ac8f2bebb3a97c799c338c731b4363f7bf004233e956d941"}
Aug 04 17:00:58.793313 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.793307    2563 scope.go:117] "RemoveContainer" containerID="dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3"
Aug 04 17:00:58.807812 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.807716    2563 scope.go:117] "RemoveContainer" containerID="dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3"
Aug 04 17:00:58.808439 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:00:58.808376    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3\": container with ID starting with dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3 not found: ID does not exist" containerID="dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3"
Aug 04 17:00:58.808439 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.808414    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3"} err="failed to get container status \"dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3\": rpc error: code = NotFound desc = could not find container \"dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3\": container with ID starting with dabc7304edd7f64180eb91a68432d6ba1f75a93df418ed84aa77546465ee9ad3 not found: ID does not exist"
Aug 04 17:00:58.820133 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.820111    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3dc45b6-df91-4554-8c62-ecaf83f3d192-plugins-config-volume\") pod \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\" (UID: \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\") "
Aug 04 17:00:58.820244 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.820217    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dpwx\" (UniqueName: \"kubernetes.io/projected/f3dc45b6-df91-4554-8c62-ecaf83f3d192-kube-api-access-4dpwx\") pod \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\" (UID: \"f3dc45b6-df91-4554-8c62-ecaf83f3d192\") "
Aug 04 17:00:58.820462 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.820438    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3dc45b6-df91-4554-8c62-ecaf83f3d192-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f3dc45b6-df91-4554-8c62-ecaf83f3d192" (UID: "f3dc45b6-df91-4554-8c62-ecaf83f3d192"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:00:58.823528 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.823500    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3dc45b6-df91-4554-8c62-ecaf83f3d192-kube-api-access-4dpwx" (OuterVolumeSpecName: "kube-api-access-4dpwx") pod "f3dc45b6-df91-4554-8c62-ecaf83f3d192" (UID: "f3dc45b6-df91-4554-8c62-ecaf83f3d192"). InnerVolumeSpecName "kube-api-access-4dpwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:00:58.853728 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.853702    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 17:00:58.921161 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.921130    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780e3be8-ab63-4e16-8209-0e1266a71631-openshift-service-ca\") pod \"780e3be8-ab63-4e16-8209-0e1266a71631\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") "
Aug 04 17:00:58.921320 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.921194    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls\") pod \"780e3be8-ab63-4e16-8209-0e1266a71631\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") "
Aug 04 17:00:58.921366 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.921329    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx9b5\" (UniqueName: \"kubernetes.io/projected/780e3be8-ab63-4e16-8209-0e1266a71631-kube-api-access-rx9b5\") pod \"780e3be8-ab63-4e16-8209-0e1266a71631\" (UID: \"780e3be8-ab63-4e16-8209-0e1266a71631\") "
Aug 04 17:00:58.921497 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.921466    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780e3be8-ab63-4e16-8209-0e1266a71631-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "780e3be8-ab63-4e16-8209-0e1266a71631" (UID: "780e3be8-ab63-4e16-8209-0e1266a71631"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:00:58.921631 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.921609    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dpwx\" (UniqueName: \"kubernetes.io/projected/f3dc45b6-df91-4554-8c62-ecaf83f3d192-kube-api-access-4dpwx\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:00:58.921631 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.921628    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780e3be8-ab63-4e16-8209-0e1266a71631-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:00:58.921783 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.921638    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3dc45b6-df91-4554-8c62-ecaf83f3d192-plugins-config-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:00:58.923403 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.923381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "780e3be8-ab63-4e16-8209-0e1266a71631" (UID: "780e3be8-ab63-4e16-8209-0e1266a71631"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:00:58.923482 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:58.923404    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780e3be8-ab63-4e16-8209-0e1266a71631-kube-api-access-rx9b5" (OuterVolumeSpecName: "kube-api-access-rx9b5") pod "780e3be8-ab63-4e16-8209-0e1266a71631" (UID: "780e3be8-ab63-4e16-8209-0e1266a71631"). InnerVolumeSpecName "kube-api-access-rx9b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:00:59.023213 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.023180    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780e3be8-ab63-4e16-8209-0e1266a71631-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:00:59.023213 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.023209    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx9b5\" (UniqueName: \"kubernetes.io/projected/780e3be8-ab63-4e16-8209-0e1266a71631-kube-api-access-rx9b5\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:00:59.114315 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.114278    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"]
Aug 04 17:00:59.120333 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.120307    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a125dd-bf5ff8fd8-qvbh8"]
Aug 04 17:00:59.718836 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.718803    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3dc45b6-df91-4554-8c62-ecaf83f3d192" path="/var/lib/kubelet/pods/f3dc45b6-df91-4554-8c62-ecaf83f3d192/volumes"
Aug 04 17:00:59.801506 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.801474    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"
Aug 04 17:00:59.801506 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.801490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2" event={"ID":"780e3be8-ab63-4e16-8209-0e1266a71631","Type":"ContainerDied","Data":"0fd87550314377b0caec0b95866719a1921edf32b752d735304da5b87afe90ab"}
Aug 04 17:00:59.801754 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.801545    2563 scope.go:117] "RemoveContainer" containerID="52364ef951d40d13ce8efc5941a564ccb7da837399e0ff49b4ea6ba9269f7fcf"
Aug 04 17:00:59.819227 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.819205    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"]
Aug 04 17:00:59.822864 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:00:59.822843    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a125dd-74b7c9b4b-wh4d2"]
Aug 04 17:01:00.225304 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:00.225268    2563 scope.go:117] "RemoveContainer" containerID="4bcf3c2bcbba2b1bb72e819cd491351a01e7fb2a2b3e1708d959d4e464c28b0e"
Aug 04 17:01:01.039479 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:01.039438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:01.724202 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:01.724170    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780e3be8-ab63-4e16-8209-0e1266a71631" path="/var/lib/kubelet/pods/780e3be8-ab63-4e16-8209-0e1266a71631/volumes"
Aug 04 17:01:04.013044 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:04.013010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:26.962146 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:26.962111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:27.063204 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:27.063167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:40.226347 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:40.226313    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:41.563144 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:41.563102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:47.464021 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:47.463979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:48.077847 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:48.077802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:48.194464 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:48.194416    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:52.907973 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:52.907878    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"]
Aug 04 17:01:52.908447 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:52.908176    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l" podUID="440b1d57-ea16-4d61-9f0d-108fa165f36a" containerName="maas-api" containerID="cri-o://0b45805a590dc6a6a374e9ac0f189b6d710b886cd7f0665657d2e28a7709b6d7" gracePeriod=30
Aug 04 17:01:52.924566 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:52.924528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:53.025378 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.025332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:53.099039 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.099002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:53.149720 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.149673    2563 generic.go:356] "Generic (PLEG): container finished" podID="440b1d57-ea16-4d61-9f0d-108fa165f36a" containerID="0b45805a590dc6a6a374e9ac0f189b6d710b886cd7f0665657d2e28a7709b6d7" exitCode=0
Aug 04 17:01:53.149940 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.149748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l" event={"ID":"440b1d57-ea16-4d61-9f0d-108fa165f36a","Type":"ContainerDied","Data":"0b45805a590dc6a6a374e9ac0f189b6d710b886cd7f0665657d2e28a7709b6d7"}
Aug 04 17:01:53.152616 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.152580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:53.188583 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.188557    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 17:01:53.356287 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.356251    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/440b1d57-ea16-4d61-9f0d-108fa165f36a-openshift-service-ca\") pod \"440b1d57-ea16-4d61-9f0d-108fa165f36a\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") "
Aug 04 17:01:53.356451 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.356323    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls\") pod \"440b1d57-ea16-4d61-9f0d-108fa165f36a\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") "
Aug 04 17:01:53.356451 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.356388    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77dbt\" (UniqueName: \"kubernetes.io/projected/440b1d57-ea16-4d61-9f0d-108fa165f36a-kube-api-access-77dbt\") pod \"440b1d57-ea16-4d61-9f0d-108fa165f36a\" (UID: \"440b1d57-ea16-4d61-9f0d-108fa165f36a\") "
Aug 04 17:01:53.356600 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.356574    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/440b1d57-ea16-4d61-9f0d-108fa165f36a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "440b1d57-ea16-4d61-9f0d-108fa165f36a" (UID: "440b1d57-ea16-4d61-9f0d-108fa165f36a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:01:53.356721 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.356704    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/440b1d57-ea16-4d61-9f0d-108fa165f36a-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:01:53.358520 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.358490    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "440b1d57-ea16-4d61-9f0d-108fa165f36a" (UID: "440b1d57-ea16-4d61-9f0d-108fa165f36a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:01:53.358630 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.358555    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/440b1d57-ea16-4d61-9f0d-108fa165f36a-kube-api-access-77dbt" (OuterVolumeSpecName: "kube-api-access-77dbt") pod "440b1d57-ea16-4d61-9f0d-108fa165f36a" (UID: "440b1d57-ea16-4d61-9f0d-108fa165f36a"). InnerVolumeSpecName "kube-api-access-77dbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:01:53.457314 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.457242    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/440b1d57-ea16-4d61-9f0d-108fa165f36a-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:01:53.457314 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.457267    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77dbt\" (UniqueName: \"kubernetes.io/projected/440b1d57-ea16-4d61-9f0d-108fa165f36a-kube-api-access-77dbt\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:01:53.494186 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:53.494153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:01:54.157330 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:54.157292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l" event={"ID":"440b1d57-ea16-4d61-9f0d-108fa165f36a","Type":"ContainerDied","Data":"a8439bc3860e22c4915d65a19d3f8131f8fecb54c53dad7f15547dbe38b18731"}
Aug 04 17:01:54.157796 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:54.157355    2563 scope.go:117] "RemoveContainer" containerID="0b45805a590dc6a6a374e9ac0f189b6d710b886cd7f0665657d2e28a7709b6d7"
Aug 04 17:01:54.157796 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:54.157307    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"
Aug 04 17:01:54.173307 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:54.173260    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"]
Aug 04 17:01:54.176523 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:54.176484    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3589b4-b97c75dff-6nw5l"]
Aug 04 17:01:55.718612 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:55.718578    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="440b1d57-ea16-4d61-9f0d-108fa165f36a" path="/var/lib/kubelet/pods/440b1d57-ea16-4d61-9f0d-108fa165f36a/volumes"
Aug 04 17:01:59.630589 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:59.630555    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"]
Aug 04 17:01:59.630987 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:01:59.630800    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy" containerID="cri-o://e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5" gracePeriod=30
Aug 04 17:02:00.021220 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:00.021187    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 17:02:00.038005 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:00.037977    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 17:02:00.183509 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:00.183461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:00.283671 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:00.283601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:04.583897 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.583857    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 17:02:04.584388 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.583943    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 17:02:04.891247 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.891224    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 17:02:04.968106 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968070    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-podinfo\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968284 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968121    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istiod-ca-cert\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968284 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968164    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-token\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968284 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968180    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-envoy\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968284 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968204    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-data\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968284 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-socket\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968284 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968273    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjt5v\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-kube-api-access-hjt5v\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968594 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968297    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-certs\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968594 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968362    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-credential-socket\") pod \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\" (UID: \"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71\") "
Aug 04 17:02:04.968594 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968553    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-data" (OuterVolumeSpecName: "istio-data") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:04.968761 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968608    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:02:04.968761 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968741    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:04.968875 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968770    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:04.968875 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968776    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:04.968875 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.968813    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:04.969229 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.969050    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:04.970606 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.970578    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:04.970606 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.970587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 17:02:04.970744 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.970643    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-token" (OuterVolumeSpecName: "istio-token") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:02:04.970861 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:04.970845    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-kube-api-access-hjt5v" (OuterVolumeSpecName: "kube-api-access-hjt5v") pod "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" (UID: "6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71"). InnerVolumeSpecName "kube-api-access-hjt5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:02:05.069717 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.069685    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:05.069717 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.069712    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:05.069717 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.069721    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:05.069971 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.069729    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:05.069971 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.069739    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:05.069971 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.069748    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjt5v\" (UniqueName: \"kubernetes.io/projected/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-kube-api-access-hjt5v\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:05.069971 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.069756    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:05.227195 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.227104    2563 generic.go:356] "Generic (PLEG): container finished" podID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerID="e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5" exitCode=0
Aug 04 17:02:05.227195 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.227163    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"
Aug 04 17:02:05.227381 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.227194    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" event={"ID":"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71","Type":"ContainerDied","Data":"e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5"}
Aug 04 17:02:05.227381 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.227249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5" event={"ID":"6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71","Type":"ContainerDied","Data":"a8be9a7a16f95f045bf54a47908bae5e0673994dd1f419184d1a05bd79fbba4a"}
Aug 04 17:02:05.227381 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.227274    2563 scope.go:117] "RemoveContainer" containerID="e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5"
Aug 04 17:02:05.237690 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.237671    2563 scope.go:117] "RemoveContainer" containerID="743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48"
Aug 04 17:02:05.246840 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.246816    2563 scope.go:117] "RemoveContainer" containerID="e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5"
Aug 04 17:02:05.247146 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:02:05.247119    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5\": container with ID starting with e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5 not found: ID does not exist" containerID="e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5"
Aug 04 17:02:05.247233 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.247153    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5"} err="failed to get container status \"e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5\": rpc error: code = NotFound desc = could not find container \"e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5\": container with ID starting with e74317df2eaca17a455c084187d7afb6e7063b573c8e3ff96f3201606aa772c5 not found: ID does not exist"
Aug 04 17:02:05.247233 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.247181    2563 scope.go:117] "RemoveContainer" containerID="743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48"
Aug 04 17:02:05.247458 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:02:05.247436    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48\": container with ID starting with 743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48 not found: ID does not exist" containerID="743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48"
Aug 04 17:02:05.247501 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.247469    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48"} err="failed to get container status \"743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48\": rpc error: code = NotFound desc = could not find container \"743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48\": container with ID starting with 743d77e76d5edcf76ba6a57d73ae48793f4e64807c829478ec136368917f6a48 not found: ID does not exist"
Aug 04 17:02:05.248545 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.248527    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"]
Aug 04 17:02:05.252809 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.252789    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-3589b4-openshift-default-8df94576b-w8xp5"]
Aug 04 17:02:05.717462 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:05.717424    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" path="/var/lib/kubelet/pods/6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71/volumes"
Aug 04 17:02:10.561775 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.561735    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"]
Aug 04 17:02:10.562253 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.562022    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv" podUID="429210e6-a47b-41ab-ba00-c6f70d3cc2cc" containerName="maas-api" containerID="cri-o://f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b" gracePeriod=30
Aug 04 17:02:10.594042 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.594000    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:10.663578 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.663543    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:10.725106 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.725065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:10.779099 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.779052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:10.829123 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.829051    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 17:02:10.925305 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.925273    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls\") pod \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") "
Aug 04 17:02:10.925492 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.925321    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb4bs\" (UniqueName: \"kubernetes.io/projected/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-kube-api-access-nb4bs\") pod \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") "
Aug 04 17:02:10.925492 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.925397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-openshift-service-ca\") pod \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\" (UID: \"429210e6-a47b-41ab-ba00-c6f70d3cc2cc\") "
Aug 04 17:02:10.925853 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.925826    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "429210e6-a47b-41ab-ba00-c6f70d3cc2cc" (UID: "429210e6-a47b-41ab-ba00-c6f70d3cc2cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:02:10.927665 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.927631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-kube-api-access-nb4bs" (OuterVolumeSpecName: "kube-api-access-nb4bs") pod "429210e6-a47b-41ab-ba00-c6f70d3cc2cc" (UID: "429210e6-a47b-41ab-ba00-c6f70d3cc2cc"). InnerVolumeSpecName "kube-api-access-nb4bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:02:10.927665 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:10.927639    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "429210e6-a47b-41ab-ba00-c6f70d3cc2cc" (UID: "429210e6-a47b-41ab-ba00-c6f70d3cc2cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:02:11.026319 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.026291    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:11.026319 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.026314    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb4bs\" (UniqueName: \"kubernetes.io/projected/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-kube-api-access-nb4bs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:11.026493 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.026325    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/429210e6-a47b-41ab-ba00-c6f70d3cc2cc-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:11.143687 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.143580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:11.263986 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.263949    2563 generic.go:356] "Generic (PLEG): container finished" podID="429210e6-a47b-41ab-ba00-c6f70d3cc2cc" containerID="f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b" exitCode=0
Aug 04 17:02:11.264164 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.264006    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"
Aug 04 17:02:11.264164 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.264043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv" event={"ID":"429210e6-a47b-41ab-ba00-c6f70d3cc2cc","Type":"ContainerDied","Data":"f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b"}
Aug 04 17:02:11.264164 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.264089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv" event={"ID":"429210e6-a47b-41ab-ba00-c6f70d3cc2cc","Type":"ContainerDied","Data":"e93906fc08764294a6d72d05722122bd43dc52785a9357b7c455edb7c517bf2a"}
Aug 04 17:02:11.264164 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.264110    2563 scope.go:117] "RemoveContainer" containerID="f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b"
Aug 04 17:02:11.274340 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.274322    2563 scope.go:117] "RemoveContainer" containerID="f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b"
Aug 04 17:02:11.274603 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:02:11.274584    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b\": container with ID starting with f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b not found: ID does not exist" containerID="f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b"
Aug 04 17:02:11.274666 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.274611    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b"} err="failed to get container status \"f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b\": rpc error: code = NotFound desc = could not find container \"f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b\": container with ID starting with f94e314cead30b705e1d0d988437c4f53ba73685a32bed07be4410a2d59f018b not found: ID does not exist"
Aug 04 17:02:11.285053 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.285020    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"]
Aug 04 17:02:11.288566 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.288542    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4e1c51-7d76fbbcb8-8lzfv"]
Aug 04 17:02:11.717766 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:11.717734    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="429210e6-a47b-41ab-ba00-c6f70d3cc2cc" path="/var/lib/kubelet/pods/429210e6-a47b-41ab-ba00-c6f70d3cc2cc/volumes"
Aug 04 17:02:17.115554 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:17.115516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:17.216036 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:17.216002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:17.364150 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:17.364116    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"]
Aug 04 17:02:17.364405 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:17.364381    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy" containerID="cri-o://1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774" gracePeriod=30
Aug 04 17:02:17.377867 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:17.377800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:17.627719 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:17.627670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:22.619108 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.619082    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 17:02:22.732213 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732124    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-socket\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732213 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732181    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6940798a-9168-4072-849b-929ae2c8e70d-istio-podinfo\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732445 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732215    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6940798a-9168-4072-849b-929ae2c8e70d-istiod-ca-cert\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732445 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732240    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-istio-token\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732445 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732264    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-envoy\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732445 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732310    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-credential-socket\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732445 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732372    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-certs\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732445 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732377    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:22.732775 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-data\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732775 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732593    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n77j\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-kube-api-access-7n77j\") pod \"6940798a-9168-4072-849b-929ae2c8e70d\" (UID: \"6940798a-9168-4072-849b-929ae2c8e70d\") "
Aug 04 17:02:22.732775 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732654    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:22.732775 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732684    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6940798a-9168-4072-849b-929ae2c8e70d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:02:22.733021 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732818    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-data" (OuterVolumeSpecName: "istio-data") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:22.733021 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732861    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:22.733021 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.732988    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:22.733021 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.733011    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:22.733021 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.733023    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:22.733235 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.733035    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:22.733235 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.733048    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6940798a-9168-4072-849b-929ae2c8e70d-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:22.734611 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.734566    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:22.734820 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.734797    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-kube-api-access-7n77j" (OuterVolumeSpecName: "kube-api-access-7n77j") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "kube-api-access-7n77j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:02:22.735061 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.735028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6940798a-9168-4072-849b-929ae2c8e70d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 17:02:22.735061 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.735041    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-istio-token" (OuterVolumeSpecName: "istio-token") pod "6940798a-9168-4072-849b-929ae2c8e70d" (UID: "6940798a-9168-4072-849b-929ae2c8e70d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:02:22.833846 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.833819    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n77j\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-kube-api-access-7n77j\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:22.833846 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.833846    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6940798a-9168-4072-849b-929ae2c8e70d-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:22.834027 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.833856    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6940798a-9168-4072-849b-929ae2c8e70d-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:22.834027 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:22.833863    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6940798a-9168-4072-849b-929ae2c8e70d-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:23.336170 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.336134    2563 generic.go:356] "Generic (PLEG): container finished" podID="6940798a-9168-4072-849b-929ae2c8e70d" containerID="1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774" exitCode=0
Aug 04 17:02:23.336170 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.336174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" event={"ID":"6940798a-9168-4072-849b-929ae2c8e70d","Type":"ContainerDied","Data":"1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774"}
Aug 04 17:02:23.336435 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.336247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8" event={"ID":"6940798a-9168-4072-849b-929ae2c8e70d","Type":"ContainerDied","Data":"a9b5546da51196cf6ef9e87e258ff67a1c81ef56a7c0de2bfbedfdd938ade7f7"}
Aug 04 17:02:23.336435 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.336265    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"
Aug 04 17:02:23.336435 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.336271    2563 scope.go:117] "RemoveContainer" containerID="1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774"
Aug 04 17:02:23.347683 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.347659    2563 scope.go:117] "RemoveContainer" containerID="d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c"
Aug 04 17:02:23.356510 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.356492    2563 scope.go:117] "RemoveContainer" containerID="1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774"
Aug 04 17:02:23.356768 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:02:23.356746    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774\": container with ID starting with 1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774 not found: ID does not exist" containerID="1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774"
Aug 04 17:02:23.356868 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.356773    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774"} err="failed to get container status \"1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774\": rpc error: code = NotFound desc = could not find container \"1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774\": container with ID starting with 1f7daa9fac7c5edf9f286d9e2c3617da9abb0f83d33bad745592327b45901774 not found: ID does not exist"
Aug 04 17:02:23.356868 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.356790    2563 scope.go:117] "RemoveContainer" containerID="d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c"
Aug 04 17:02:23.357083 ip-10-0-131-60 kubenswrapper[2563]: E0804 17:02:23.357060    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c\": container with ID starting with d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c not found: ID does not exist" containerID="d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c"
Aug 04 17:02:23.357143 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.357092    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c"} err="failed to get container status \"d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c\": rpc error: code = NotFound desc = could not find container \"d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c\": container with ID starting with d4947fb002ecbd3256e03d13cd5427dda7191d2e7b6f7352e48a3511c963e54c not found: ID does not exist"
Aug 04 17:02:23.359057 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.358991    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"]
Aug 04 17:02:23.362009 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.361988    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4e1c51-openshift-default-5949f77cb-n57k8"]
Aug 04 17:02:23.718070 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:23.717990    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6940798a-9168-4072-849b-929ae2c8e70d" path="/var/lib/kubelet/pods/6940798a-9168-4072-849b-929ae2c8e70d/volumes"
Aug 04 17:02:28.169259 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.169215    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"]
Aug 04 17:02:28.169692 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.169458    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z" podUID="8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" containerName="maas-api" containerID="cri-o://fdb459fd778c66ad2795fa166ee23c5b2d2f65f5978b624db8b7eed212e29fe3" gracePeriod=30
Aug 04 17:02:28.200989 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.200960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:28.275448 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.275415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:28.299409 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.299373    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z" podUID="8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.88:8443/health\": dial tcp 10.134.0.88:8443: connect: connection refused"
Aug 04 17:02:28.330322 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.330291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:28.368216 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.368186    2563 generic.go:356] "Generic (PLEG): container finished" podID="8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" containerID="fdb459fd778c66ad2795fa166ee23c5b2d2f65f5978b624db8b7eed212e29fe3" exitCode=0
Aug 04 17:02:28.368403 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.368254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z" event={"ID":"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1","Type":"ContainerDied","Data":"fdb459fd778c66ad2795fa166ee23c5b2d2f65f5978b624db8b7eed212e29fe3"}
Aug 04 17:02:28.392179 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.392137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:28.431072 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.431005    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 17:02:28.586667 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.586622    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-maas-api-tls\") pod \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") "
Aug 04 17:02:28.586864 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.586676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn6hj\" (UniqueName: \"kubernetes.io/projected/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-kube-api-access-wn6hj\") pod \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") "
Aug 04 17:02:28.586864 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.586717    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-openshift-service-ca\") pod \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\" (UID: \"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1\") "
Aug 04 17:02:28.587160 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.587129    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" (UID: "8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:02:28.588999 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.588972    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" (UID: "8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:02:28.589119 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.588993    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-kube-api-access-wn6hj" (OuterVolumeSpecName: "kube-api-access-wn6hj") pod "8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" (UID: "8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1"). InnerVolumeSpecName "kube-api-access-wn6hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:02:28.688499 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.688401    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-maas-api-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:28.688499 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.688436    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn6hj\" (UniqueName: \"kubernetes.io/projected/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-kube-api-access-wn6hj\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:28.688499 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:28.688455    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1-openshift-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\""
Aug 04 17:02:29.331454 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:29.331418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:29.375399 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:29.375373    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"
Aug 04 17:02:29.375583 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:29.375394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z" event={"ID":"8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1","Type":"ContainerDied","Data":"3c66700baedf0b5d9e477ac697935d488cfa26fda6753470ccaf0446cfcc2db8"}
Aug 04 17:02:29.375583 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:29.375458    2563 scope.go:117] "RemoveContainer" containerID="fdb459fd778c66ad2795fa166ee23c5b2d2f65f5978b624db8b7eed212e29fe3"
Aug 04 17:02:29.396920 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:29.396877    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"]
Aug 04 17:02:29.400383 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:29.400359    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-222eca-7c6dbc4587-g7d4z"]
Aug 04 17:02:29.717844 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:29.717749    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" path="/var/lib/kubelet/pods/8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1/volumes"
Aug 04 17:02:33.139124 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:33.139069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:34.670540 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:34.670492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:34.770737 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:34.770706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:35.048562 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:35.048511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:35.168749 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:35.168709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:41.003077 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:41.003049    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-42tsd_a893012a-c78f-482c-8e9b-b9b27b3d50df/manager/0.log"
Aug 04 17:02:41.263258 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:41.263181    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76cc9b5f7d-685dx_71d2fe32-4e8e-4086-9830-e7a3a693bc6a/manager/0.log"
Aug 04 17:02:41.378885 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:41.378858    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-66w78_c4348217-5101-4ecb-9a5e-8c3df020073e/server/0.log"
Aug 04 17:02:41.761868 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:41.761809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd47f799b-cnqww_74d68e6b-af16-4887-9112-605b2eeeaa24/copy-manifests/0.log"
Aug 04 17:02:41.769858 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:41.769826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd47f799b-cnqww_74d68e6b-af16-4887-9112-605b2eeeaa24/manager/0.log"
Aug 04 17:02:42.246808 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:42.246776    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67c8968587-h8p52_7d39ef9b-93a4-4c1d-9162-a87e71de7b3d/maas-api/0.log"
Aug 04 17:02:42.364276 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:42.364249    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764350-pfj5n_96f44a81-0e67-4188-98d8-d6ce133f0e2d/cleanup/0.log"
Aug 04 17:02:43.619801 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:43.619765    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-9dpzb_9007023b-52bd-40f7-8e30-7cc89d1e20e7/manager/0.log"
Aug 04 17:02:43.734459 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:43.734422    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-jc5h9_6c3d6cd6-67b0-461e-bf85-269379d50f1e/manager/0.log"
Aug 04 17:02:43.969622 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:43.969541    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-zdwth_53371a5b-cf56-4451-81e1-e94c24ea2938/manager/0.log"
Aug 04 17:02:44.582677 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:44.582643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8_5a6728c5-b5b6-4746-abc7-9f92671ba669/istio-proxy/0.log"
Aug 04 17:02:44.716314 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:44.713817    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-czxzd_7256aeeb-72fc-4f5a-be79-1fcf234aeafe/discovery/0.log"
Aug 04 17:02:44.836805 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:44.836723    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb97f6d89-mvwcn_f9db57cc-6dad-495a-92a6-3fe88d3ee2ca/kube-auth-proxy/0.log"
Aug 04 17:02:45.223992 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:45.223868    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-m4q6d_fb1d33ce-0355-4019-af14-5644bd4aef45/payload-pre-processing/0.log"
Aug 04 17:02:45.348029 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:45.347995    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rjj74_67a520b9-9663-482d-90c1-b14743896017/payload-processing/0.log"
Aug 04 17:02:45.807199 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:45.807166    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hrssb_46c6b330-b05e-4138-b79d-615b6960f9a5/main/0.log"
Aug 04 17:02:52.075520 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:52.075479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:52.160587 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:52.160544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log" limit=1024
Aug 04 17:02:54.649363 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:54.649338    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zrvwr_08cde35f-1da6-4574-8865-5bec253c3075/global-pull-secret-syncer/0.log"
Aug 04 17:02:54.704915 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:54.704870    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ffvfl_85981edc-7f69-4fff-a6cb-c4be69bcfa38/konnectivity-agent/0.log"
Aug 04 17:02:54.821022 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:54.820988    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-60.ec2.internal_39a7c3613bf8e5e7fd5e0d2f670dcc7b/haproxy/0.log"
Aug 04 17:02:59.852797 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:59.852760    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-9dpzb_9007023b-52bd-40f7-8e30-7cc89d1e20e7/manager/0.log"
Aug 04 17:02:59.876842 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:02:59.876812    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-jc5h9_6c3d6cd6-67b0-461e-bf85-269379d50f1e/manager/0.log"
Aug 04 17:03:00.063454 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:00.063409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-zdwth_53371a5b-cf56-4451-81e1-e94c24ea2938/manager/0.log"
Aug 04 17:03:01.626557 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.626526    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb295ce-71cd-4259-8c16-66cd689ea14b/alertmanager/0.log"
Aug 04 17:03:01.645884 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.645853    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb295ce-71cd-4259-8c16-66cd689ea14b/config-reloader/0.log"
Aug 04 17:03:01.665152 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.665128    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb295ce-71cd-4259-8c16-66cd689ea14b/kube-rbac-proxy-web/0.log"
Aug 04 17:03:01.691996 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.691969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb295ce-71cd-4259-8c16-66cd689ea14b/kube-rbac-proxy/0.log"
Aug 04 17:03:01.710843 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.710817    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb295ce-71cd-4259-8c16-66cd689ea14b/kube-rbac-proxy-metric/0.log"
Aug 04 17:03:01.733921 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.733890    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb295ce-71cd-4259-8c16-66cd689ea14b/prom-label-proxy/0.log"
Aug 04 17:03:01.752944 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.752921    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb295ce-71cd-4259-8c16-66cd689ea14b/init-config-reloader/0.log"
Aug 04 17:03:01.836996 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.836970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-6qhq6_848c5969-bbc8-403f-b791-1bf4c66b8b98/kube-state-metrics/0.log"
Aug 04 17:03:01.856737 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.856715    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-6qhq6_848c5969-bbc8-403f-b791-1bf4c66b8b98/kube-rbac-proxy-main/0.log"
Aug 04 17:03:01.878789 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:01.878721    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-6qhq6_848c5969-bbc8-403f-b791-1bf4c66b8b98/kube-rbac-proxy-self/0.log"
Aug 04 17:03:02.052673 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.052628    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm6fk_6f770f5a-b792-4b2c-8379-0a518b4f4fa4/node-exporter/0.log"
Aug 04 17:03:02.070292 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.070269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm6fk_6f770f5a-b792-4b2c-8379-0a518b4f4fa4/kube-rbac-proxy/0.log"
Aug 04 17:03:02.088504 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.088483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bm6fk_6f770f5a-b792-4b2c-8379-0a518b4f4fa4/init-textfile/0.log"
Aug 04 17:03:02.182163 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.182068    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-pfhxv_511e2d45-4eee-4bda-a97f-646fdbe71609/kube-rbac-proxy-main/0.log"
Aug 04 17:03:02.202066 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.202045    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-pfhxv_511e2d45-4eee-4bda-a97f-646fdbe71609/kube-rbac-proxy-self/0.log"
Aug 04 17:03:02.223370 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.223340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-pfhxv_511e2d45-4eee-4bda-a97f-646fdbe71609/openshift-state-metrics/0.log"
Aug 04 17:03:02.522455 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.522424    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65b4f6984d-49pqc_4c53fb4f-7a32-44ed-8edd-0cd456b49050/telemeter-client/0.log"
Aug 04 17:03:02.543786 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.543755    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65b4f6984d-49pqc_4c53fb4f-7a32-44ed-8edd-0cd456b49050/reload/0.log"
Aug 04 17:03:02.562554 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.562528    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65b4f6984d-49pqc_4c53fb4f-7a32-44ed-8edd-0cd456b49050/kube-rbac-proxy/0.log"
Aug 04 17:03:02.596198 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.596170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df457cb99-cm26z_8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a/thanos-query/0.log"
Aug 04 17:03:02.615152 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.615125    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df457cb99-cm26z_8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a/kube-rbac-proxy-web/0.log"
Aug 04 17:03:02.636175 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.636142    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df457cb99-cm26z_8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a/kube-rbac-proxy/0.log"
Aug 04 17:03:02.659593 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.659564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df457cb99-cm26z_8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a/prom-label-proxy/0.log"
Aug 04 17:03:02.678520 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.678496    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df457cb99-cm26z_8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a/kube-rbac-proxy-rules/0.log"
Aug 04 17:03:02.698536 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:02.698499    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df457cb99-cm26z_8ab5d2cd-477a-4d6e-a56f-b57c4f633e9a/kube-rbac-proxy-metrics/0.log"
Aug 04 17:03:04.308161 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308130    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"]
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308644    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="440b1d57-ea16-4d61-9f0d-108fa165f36a" containerName="maas-api"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308664    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="440b1d57-ea16-4d61-9f0d-108fa165f36a" containerName="maas-api"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308674    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3dc45b6-df91-4554-8c62-ecaf83f3d192" containerName="payload-processing"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308681    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3dc45b6-df91-4554-8c62-ecaf83f3d192" containerName="payload-processing"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308693    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="429210e6-a47b-41ab-ba00-c6f70d3cc2cc" containerName="maas-api"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308699    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="429210e6-a47b-41ab-ba00-c6f70d3cc2cc" containerName="maas-api"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308708    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780e3be8-ab63-4e16-8209-0e1266a71631" containerName="maas-api"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308714    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="780e3be8-ab63-4e16-8209-0e1266a71631" containerName="maas-api"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308723    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308729    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308740    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy"
Aug 04 17:03:04.308743 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308746    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308752    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d11674-6d1e-42fd-ba35-d761461882a6" containerName="maas-api"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308757    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d11674-6d1e-42fd-ba35-d761461882a6" containerName="maas-api"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308764    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308771    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308778    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" containerName="maas-api"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308783    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" containerName="maas-api"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308792    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308797    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308863    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3dc45b6-df91-4554-8c62-ecaf83f3d192" containerName="payload-processing"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308872    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe3bcaa-492f-4f0c-a41b-ec9c16e1bb71" containerName="istio-proxy"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308880    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ea0bad5-0d8a-4a3d-a2c9-9c260528a0b1" containerName="maas-api"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308889    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="780e3be8-ab63-4e16-8209-0e1266a71631" containerName="maas-api"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308897    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="429210e6-a47b-41ab-ba00-c6f70d3cc2cc" containerName="maas-api"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308926    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308933    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6940798a-9168-4072-849b-929ae2c8e70d" containerName="istio-proxy"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308939    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="440b1d57-ea16-4d61-9f0d-108fa165f36a" containerName="maas-api"
Aug 04 17:03:04.309166 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.308945    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="14d11674-6d1e-42fd-ba35-d761461882a6" containerName="maas-api"
Aug 04 17:03:04.313494 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.313478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.315573 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.315553    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wj42w\"/\"openshift-service-ca.crt\""
Aug 04 17:03:04.316202 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.316179    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wj42w\"/\"default-dockercfg-ddj78\""
Aug 04 17:03:04.316497 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.316224    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wj42w\"/\"kube-root-ca.crt\""
Aug 04 17:03:04.319931 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.319891    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"]
Aug 04 17:03:04.384364 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.384330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-lib-modules\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.384546 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.384385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-proc\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.384546 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.384406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-podres\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.384546 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.384484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-sys\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.384546 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.384536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb8zs\" (UniqueName: \"kubernetes.io/projected/68ac2014-55a9-4f7a-b59a-0dde2ee40855-kube-api-access-bb8zs\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485277 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-podres\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485277 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-sys\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485545 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb8zs\" (UniqueName: \"kubernetes.io/projected/68ac2014-55a9-4f7a-b59a-0dde2ee40855-kube-api-access-bb8zs\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485545 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-lib-modules\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485545 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-proc\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485545 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-podres\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485545 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-sys\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485545 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-proc\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.485545 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.485520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68ac2014-55a9-4f7a-b59a-0dde2ee40855-lib-modules\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.497675 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.497647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb8zs\" (UniqueName: \"kubernetes.io/projected/68ac2014-55a9-4f7a-b59a-0dde2ee40855-kube-api-access-bb8zs\") pod \"perf-node-gather-daemonset-xhdg2\" (UID: \"68ac2014-55a9-4f7a-b59a-0dde2ee40855\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.625379 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.625305    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:04.763059 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:04.763034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"]
Aug 04 17:03:04.765008 ip-10-0-131-60 kubenswrapper[2563]: W0804 17:03:04.764981    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod68ac2014_55a9_4f7a_b59a_0dde2ee40855.slice/crio-b998ace00847445aa5bfa2037d09cf59903ba438cdc7ae1b80515bfed895123c WatchSource:0}: Error finding container b998ace00847445aa5bfa2037d09cf59903ba438cdc7ae1b80515bfed895123c: Status 404 returned error can't find the container with id b998ace00847445aa5bfa2037d09cf59903ba438cdc7ae1b80515bfed895123c
Aug 04 17:03:05.583988 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:05.583945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2" event={"ID":"68ac2014-55a9-4f7a-b59a-0dde2ee40855","Type":"ContainerStarted","Data":"3d708c16db649328c1052f558c5bbc11feb55ed43f1a72564feabfa1963b6f2c"}
Aug 04 17:03:05.584461 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:05.584008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:05.584461 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:05.584028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2" event={"ID":"68ac2014-55a9-4f7a-b59a-0dde2ee40855","Type":"ContainerStarted","Data":"b998ace00847445aa5bfa2037d09cf59903ba438cdc7ae1b80515bfed895123c"}
Aug 04 17:03:05.603183 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:05.603133    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2" podStartSLOduration=1.603118162 podStartE2EDuration="1.603118162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:03:05.600439017 +0000 UTC m=+3666.427136484" watchObservedRunningTime="2026-08-04 17:03:05.603118162 +0000 UTC m=+3666.429815634"
Aug 04 17:03:06.920156 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:06.920127    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dhktx_c47be4d2-196c-493b-86f3-819c7e6ea17c/dns/0.log"
Aug 04 17:03:06.940474 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:06.940442    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dhktx_c47be4d2-196c-493b-86f3-819c7e6ea17c/kube-rbac-proxy/0.log"
Aug 04 17:03:07.081316 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:07.081272    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lp2j4_26f3738f-0609-49c7-bb0d-28275c0b4631/dns-node-resolver/0.log"
Aug 04 17:03:07.684240 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:07.684209    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r9jf7_eab8ef53-e32f-47d5-adac-9e05e28b3026/node-ca/0.log"
Aug 04 17:03:08.630718 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:08.630688    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8_5a6728c5-b5b6-4746-abc7-9f92671ba669/istio-proxy/0.log"
Aug 04 17:03:08.949809 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:08.949719    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-czxzd_7256aeeb-72fc-4f5a-be79-1fcf234aeafe/discovery/0.log"
Aug 04 17:03:08.970197 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:08.970170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb97f6d89-mvwcn_f9db57cc-6dad-495a-92a6-3fe88d3ee2ca/kube-auth-proxy/0.log"
Aug 04 17:03:09.083221 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:09.083187    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-m4q6d_fb1d33ce-0355-4019-af14-5644bd4aef45/payload-pre-processing/0.log"
Aug 04 17:03:09.120592 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:09.120567    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rjj74_67a520b9-9663-482d-90c1-b14743896017/payload-processing/0.log"
Aug 04 17:03:09.906264 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:09.906236    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2dlw2_4db545ec-a482-42cf-a717-17bcee6c145a/serve-healthcheck-canary/0.log"
Aug 04 17:03:10.602713 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:10.602677    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xf4q5_470e83d0-1df7-499f-9dd6-09945419b418/kube-rbac-proxy/0.log"
Aug 04 17:03:10.621009 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:10.620975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xf4q5_470e83d0-1df7-499f-9dd6-09945419b418/exporter/0.log"
Aug 04 17:03:10.640454 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:10.640431    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xf4q5_470e83d0-1df7-499f-9dd6-09945419b418/extractor/0.log"
Aug 04 17:03:11.599809 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:11.599781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-xhdg2"
Aug 04 17:03:12.700431 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:12.700398    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-42tsd_a893012a-c78f-482c-8e9b-b9b27b3d50df/manager/0.log"
Aug 04 17:03:13.325046 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:13.325009    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76cc9b5f7d-685dx_71d2fe32-4e8e-4086-9830-e7a3a693bc6a/manager/0.log"
Aug 04 17:03:13.353479 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:13.353439    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-66w78_c4348217-5101-4ecb-9a5e-8c3df020073e/server/0.log"
Aug 04 17:03:13.681152 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:13.681056    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd47f799b-cnqww_74d68e6b-af16-4887-9112-605b2eeeaa24/manager/0.log"
Aug 04 17:03:13.700454 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:13.700426    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd47f799b-cnqww_74d68e6b-af16-4887-9112-605b2eeeaa24/copy-manifests/0.log"
Aug 04 17:03:13.971122 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:13.971052    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8_5a6728c5-b5b6-4746-abc7-9f92671ba669/istio-proxy/0.log"
Aug 04 17:03:14.288812 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:14.288775    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-czxzd_7256aeeb-72fc-4f5a-be79-1fcf234aeafe/discovery/0.log"
Aug 04 17:03:14.301169 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:14.301132    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb97f6d89-mvwcn_f9db57cc-6dad-495a-92a6-3fe88d3ee2ca/kube-auth-proxy/0.log"
Aug 04 17:03:14.382492 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:14.382458    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-m4q6d_fb1d33ce-0355-4019-af14-5644bd4aef45/payload-pre-processing/0.log"
Aug 04 17:03:14.414650 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:14.414615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rjj74_67a520b9-9663-482d-90c1-b14743896017/payload-processing/0.log"
Aug 04 17:03:15.161039 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:15.161007    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hqlsx_6213d7ea-e693-41d4-bdd0-b11fd5101a3d/openshift-lws-operator/0.log"
Aug 04 17:03:15.905256 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:15.905210    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-p5kx8_5a6728c5-b5b6-4746-abc7-9f92671ba669/istio-proxy/0.log"
Aug 04 17:03:16.213885 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:16.213795    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-czxzd_7256aeeb-72fc-4f5a-be79-1fcf234aeafe/discovery/0.log"
Aug 04 17:03:16.229511 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:16.229475    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb97f6d89-mvwcn_f9db57cc-6dad-495a-92a6-3fe88d3ee2ca/kube-auth-proxy/0.log"
Aug 04 17:03:16.305210 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:16.305170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-m4q6d_fb1d33ce-0355-4019-af14-5644bd4aef45/payload-pre-processing/0.log"
Aug 04 17:03:16.335403 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:16.335370    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-rjj74_67a520b9-9663-482d-90c1-b14743896017/payload-processing/0.log"
Aug 04 17:03:21.474850 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.474823    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8n59_f630238c-046c-4a5c-8859-8213f8dcbb80/kube-multus-additional-cni-plugins/0.log"
Aug 04 17:03:21.494462 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.494436    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8n59_f630238c-046c-4a5c-8859-8213f8dcbb80/egress-router-binary-copy/0.log"
Aug 04 17:03:21.512129 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.512098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8n59_f630238c-046c-4a5c-8859-8213f8dcbb80/cni-plugins/0.log"
Aug 04 17:03:21.530542 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.530517    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8n59_f630238c-046c-4a5c-8859-8213f8dcbb80/bond-cni-plugin/0.log"
Aug 04 17:03:21.550202 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.550173    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8n59_f630238c-046c-4a5c-8859-8213f8dcbb80/routeoverride-cni/0.log"
Aug 04 17:03:21.568365 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.568338    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8n59_f630238c-046c-4a5c-8859-8213f8dcbb80/whereabouts-cni-bincopy/0.log"
Aug 04 17:03:21.588215 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.588191    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8n59_f630238c-046c-4a5c-8859-8213f8dcbb80/whereabouts-cni/0.log"
Aug 04 17:03:21.756061 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.756035    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/0.log"
Aug 04 17:03:21.791168 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.791138    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jksg4_65e9a309-c1b2-41ea-a4dd-9eb493765007/kube-multus/1.log"
Aug 04 17:03:21.814880 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.814850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d2m5z_42464805-3fb9-40f2-9568-3915547e0083/network-metrics-daemon/0.log"
Aug 04 17:03:21.829107 ip-10-0-131-60 kubenswrapper[2563]: I0804 17:03:21.829079    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d2m5z_42464805-3fb9-40f2-9568-3915547e0083/kube-rbac-proxy/0.log"